Support matrix

Model support matrix

Overview of the embedded models that are supported by the AI Factory for various operations. For more details about each model, see the specific page for that model provider.

Provider	Model name	Operations	Configuration
`bert_local`	`bert_all-MiniLM-L12-v1`	`TextEncoder`	`{"model":"sentence-transformers/all-MiniLM-L12-v1","revision":"main"}`
`bert_local`	`bert_all-MiniLM-L6-v1`	`TextEncoder`	`{"model":"sentence-transformers/all-MiniLM-L6-v1","revision":"main"}`
`bert_local`	`bert_all-MiniLM-L6-v2`	`TextEncoder`	`{"model":"sentence-transformers/all-MiniLM-L6-v2","revision":"main"}`
`bert_local`	`bert_all-distilroberta-v1`	`TextEncoder`	`{"model":"sentence-transformers/all-distilroberta-v1","revision":"main"}`
`bert_local`	`bert_msmarco-bert-base-dot-v5`	`TextEncoder`	`{"model":"sentence-transformers/msmarco-bert-base-dot-v5","revision":"main"}`
`bert_local`	`bert_multi-qa-MiniLM-L6-cos-v1`	`TextEncoder`	`{"model":"sentence-transformers/multi-qa-MiniLM-L6-cos-v1","revision":"main"}`
`bert_local`	`bert_multi-qa-MiniLM-L6-dot-v1`	`TextEncoder`	`{"model":"sentence-transformers/multi-qa-MiniLM-L6-dot-v1","revision":"main"}`
`bert_local`	`bert_paraphrase-TinyBERT-L6-v2`	`TextEncoder`	`{"model":"sentence-transformers/paraphrase-TinyBERT-L6-v2","revision":"main"}`
`bert_local`	`bert_paraphrase-multilingual-MiniLM-L12-v2`	`TextEncoder`	`{"model":"sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2","revision":"main"}`
`bert_local`	`bert_paraphrase-multilingual-mpnet-base-v2`	`TextEncoder`	`{"model":"sentence-transformers/paraphrase-multilingual-mpnet-base-v2","revision":"main"}`
`clip_local`	`openai/clip-vit-base-patch32`	`TextEncoder`, `ImageEncoder`	`{}`
`llama_instruct_local`	`HuggingFaceTB/SmolLM2-1.7B-Instruct`	`TextDecoder`	`{"model":"HuggingFaceTB/SmolLM2-1.7B-Instruct","revision":"main"}`
`llama_instruct_local`	`HuggingFaceTB/SmolLM2-135M-Instruct`	`TextDecoder`	`{"model":"HuggingFaceTB/SmolLM2-135M-Instruct","revision":"main"}`
`llama_instruct_local`	`HuggingFaceTB/SmolLM2-360M-Instruct`	`TextDecoder`	`{"model":"HuggingFaceTB/SmolLM2-360M-Instruct","revision":"main"}`
`llama_instruct_local`	`TinyLlama/TinyLlama-1.1B-Chat-v1.0`	`TextDecoder`	`{"model":"TinyLlama/TinyLlama-1.1B-Chat-v1.0","revision":"main"}`
`t5_local`	`t5-base`	`TextEncoder`, `TextDecoder`	`{"model":"t5-base","revision":"main"}`
`t5_local`	`t5-large`	`TextEncoder`, `TextDecoder`	`{"model":"t5-large","revision":"main"}`
`t5_local`	`t5-small`	`TextEncoder`, `TextDecoder`	`{"model":"t5-small","revision":"main"}`

On this page
Model support matrix

← Prev

Pipelines supported models

↑ Up

Pipelines supported models

Next →

T5

Could this page be better? Report a problem or suggest an addition!