AI Accelerator - Pipelines 4.0.0 release notes

The retriever pipeline has been renamed to the knowledge base pipeline.

The functions aidb.create_retriever_for_table() and aidb.create_retriever_for_volume() have been renamed to aidb.create_knowledge_base_for_table() and aidb.create_knowledge_base_for_volume(), respectively.

Also renamed is the aidb.delete_retriever function (to aidb.delete_knowledge_base()) and the aidb.RetrieverSourceDataFormat enum has been renamed to aidb.PipelineDataFormat.

For consistency, the preparer pipeline functions have also been renamed. The aidb.create_preparer_for_table() function has been renamed to aidb.create_table_preparer() and aidb.create_preparer_for_volume() has been renamed to aidb.create_volume_preparer().

The aidb.retrievers view is now the aidb.knowledge_bases view. Aliases for the aidb.knowledge_bases and aidb.preparers views have also been added as aidb.kbs and aidb.preps respectively.

The older functions and view names are still available but marked as deprecated. They will be removed in a future release.

The setting for "auto processing" in pipeline creation, config and overview functions has been re-named from processing_mode to auto_processing. We did this to have consistency with the name of the feature itself which is called auto-processing.

The AI Accelerator now supports arm64 architecture on Debian 12 and RHEL 9. This includes support for the arm64 architecture in the aidb packages.

The aidb.rerank_text() function used to rerank a list of texts based on a ranking query, now returns its results in a table, one row per text. The table includes columns for the raw logit_score, the text itself and the index from the input. This makes it much easier to use the result in larger SQL query e.g. by joining with other data or sorting the rows by logit_score.

AIDB now prints rich debugging output for any errors encountered when using external models via API. This includes NIM models and OpenAI API compatible models. The HTTP status code, error response content, and request content are logged to help users debug issues like incorrect endpoints, incorrect model configuration or incorrect credentials, among others.

AIDB now prints rich debugging output for any errors encountered when using external models via API. This includes NIM models and OpenAI API compatible models. The HTTP status code, error response content, and request content are logged to help users debug issues like incorrect endpoints, incorrect model configuration or incorrect credentials, among others.