Using models with... v1.3

Suggest edits

This section describes some particular ways to use models with AI Accelerator Pipelines. These techniques show how to use API-compatible services, running locally or in the cloud, with Pipelines and how to make use of NVIDIA NIM.

OpenAI-compatible models

Using an OpenAI-compatible API with Pipelines by setting options and credentials.

NVIDIA NIM Microservices

How to use NVIDIA NIM microservices available on build.nvidia.com, with AI Accelerator Pipelines.

← Prev

Model Serving Quickstart

↑ Up

Pipelines models

Next →

Using an OpenAI-compatible API with Pipelines