Pipelines models reference Innovation Release

This reference documentation for EDB Postgres AI - AI Accelerator Pipelines models includes information on the functions and views available in the aidb extension for working with models.

Tables

aidb.model_providers

The aidb.model_providers table stores information about the model providers that are available.

aidb.models

Returns a list of all models in the registry and their configured options, including predefined models and user-created models.

Example

SELECT * FROM aidb.models;

 name  |  provider  |    options
-------+------------+---------------
 bert  | bert_local | {"config={}"}
 clip  | clip_local | {"config={}"}
 t5    | t5_local   | {"config={}"}

Functions

aidb.create_model

Creates a new model in the system by saving its name, provider, and optional configuration.

Parameters

Example

SELECT aidb.create_model(
               name => 'my_t5'::text,
               provider => 't5_local'::character varying,
               config => '{"param1": "value1", "param2": "value2"}'::jsonb,
               credentials => '{"token": "abcd"}'::jsonb
           );

or equivalently, using default values:

SELECT aidb.create_model('my_t5', 't5_local');

or if updating the credentials of a model's provider, which has already been created.

SELECT aidb.create_model(
               name => 'my_t5'::text,
               provider => 't5_local'::character varying,
               config => '{"param1": "value1", "param2": "value2"}'::jsonb,
               credentials => '{"token": "abcd"}'::jsonb,
               replace_credentials => true
           );

TLS Configuration (optional)

To securely connect to HTTPS-based model endpoints, the config object can include a tls_config field:

"tls_config": {
  "insecure_skip_verify": true,  // (optional) disables certificate validation
  "ca_path": "/etc/aidb/myCA.pem"  // (optional) path to a trusted CA certificate
}

aidb.get_model

Returns the configuration for a model in the registry.

Parameters

Returns

Example

SELECT * FROM aidb.get_model('t5');

 name | provider |    options
------+----------+---------------
 t5   | t5_local | {"config={}"}
(1 row)

aidb.delete_model

Deletes a model from the registry.

Parameters

Example

SELECT aidb.delete_model('t5');

     delete_model
---------------------------------
 (t5,t5_local,"{""config={}""}")
(1 row)

Returns

aidb.list_hcp_models

Gets models running on the Hybrid Manager.

Returns

Example

SELECT * FROM  aidb.get_hcp_models();
                 name                  |                                       url                                        |               model                
---------------------------------------+----------------------------------------------------------------------------------+------------------------------------
 llama-3-1-8b-instruct-1xgpu-g6        | http://llama-3-1-8b-instruct-1xgpu-g6-predictor.default.svc.cluster.local        | meta/llama-3.1-8b-instruct
 llama-3-2-nv-embedqa-1b-v2            | http://llama-3-2-nv-embedqa-1b-v2-predictor.default.svc.cluster.local            | nvidia/llama-3.2-nv-embedqa-1b-v2
 meta-nim-llama3-70b-instruct-8xgpu-g5 | http://meta-nim-llama3-70b-instruct-8xgpu-g5-predictor.default.svc.cluster.local | meta/llama3-70b-instruct
(3 rows)

aidb.create_hcp_model

Creates a new model in the system by referencing a running instance in the HCP (Hybrid Manager)

Parameters

aidb.sync_hcp_models

Creates models in the HCP (Hybrid Manager) and sets is_hcp_model=true; deletes models with that setting if not found in the HCP (Hybrid Manager).

Returns

aidb.encode_text

Encodes text using a model, generating a vector representation of a given text input.

Parameters

aidb.encode_text_batch

Encodes a batch of text using a model, generating a vector representation of a given text input.

Parameters

aidb.decode_text

Decodes text using a model, generating a vector representation of a given text input.

Parameters

Returns

aidb.decode_text_batch

Decodes a batch of text using a model, generating a representation of a given text input.

Parameters

Returns

aidb.encode_image

Encodes an image using a model, generating a vector representation of a given image input.

Parameters

Returns

aidb.rerank_text

Reranks text using a model, generating a vector representation of a given text input.

Parameters

Returns

Model configuration helper functions

These helper functions simplify creating JSONB configuration objects for aidb.create_model(). They provide proper parameter types, defaults, and validation.

aidb.embeddings_config

Creates configuration for embeddings model providers (embeddings, openai_embeddings, nim_embeddings).

Parameters

Example

SELECT aidb.create_model(
  'my_model',
  'openai_embeddings',
  aidb.embeddings_config(model => 'text-embedding-3-small'),
  '{"api_key": "sk-..."}'::JSONB
);

aidb.completions_config

Creates configuration for completions model providers (completions, openai_completions, nim_completions).

Parameters

Example

SELECT aidb.create_model(
  'my_model',
  'openai_completions',
  aidb.completions_config(model => 'gpt-4o'),
  '{"api_key": "sk-..."}'::JSONB
);

aidb.max_tokens_config

Creates the max_tokens configuration for completions models.

Parameters

Example

aidb.completions_config(
  model => 'gpt-4o',
  max_tokens => aidb.max_tokens_config(size => 1024, format => 'default')
)

aidb.bert_config

Creates configuration for the bert_local model provider.

Parameters

aidb.clip_config

Creates configuration for the clip_local model provider.

Parameters

aidb.llama_config

Creates configuration for the llama_instruct_local model provider.

Parameters

aidb.t5_config

Creates configuration for the t5_local model provider.

Parameters

aidb.gemini_config

Creates configuration for the gemini model provider.

Parameters

aidb.nim_clip_config

Creates configuration for the nim_clip model provider.

Parameters

aidb.nim_ocr_config

Creates configuration for the nim_paddle_ocr model provider.

Parameters

aidb.nim_reranking_config

Creates configuration for the nim_reranking model provider.

Parameters

aidb.openrouter_chat_config

Creates configuration for the openrouter_chat model provider.

Parameters

aidb.openrouter_embeddings_config

Creates configuration for the openrouter_embeddings model provider.

Parameters