AI Factory How-To Guides v1.3

Use these guides to deploy and operate AI Factory capabilities. When you run in Hybrid Manager (recommended), follow the HM-specific notes in each guide.

Topics

Gen AI

• Configure Data Sources in Gen AI Builder — see Gen AI references in the hub
• Configure the Data Lake in Gen AI Builder — see Gen AI references in the hub

Model Serving

• Deploy NVIDIA NIM Microservices
• Monitor model serving deployments
• Update GPU resources
• Configure ServingRuntime
• Access KServe endpoints (internal/external)

Model Library

• Integrate private container registry
• Define repository rules
• Manage repository metadata
• Deploy AI models from Model Library

Learn more

For conceptual background, see:

• AI Factory Concepts
• Model Serving concepts