Welcome to your LocalAI

The powerful FOSS alternative to OpenAI, Claude, and more

Documentation Model Gallery Import Model

Operations in Progress

Installed Models

5 models ready to use

arcee-ai_afm-4.5b icon

arcee-ai_afm-4.5b

llama-cpp

Chat

Edit

falcon3-10b-instruct

llama-cpp

Chat

Edit

guillaumetell-7b

llama-cpp

Chat

Edit

sd-3.5-large-ggml icon

sd-3.5-large-ggml

stablediffusion-ggml

Image

Edit

t5xxl-Q5_0.gguf

Auto Backend No Config

Configuration required for full functionality

Installed Backends

2 backends ready to use

cpu-llama-cpp

User Installed

Alias: llama-cpp

Installed: 2025-11-06T17:55:50Z

Gallery: github:mudler/LocalAI/backend/index.yaml@master

Path: /var/www/localai/backends/cpu-llama-cpp/run.sh

llama-cpp

User Installed

Alias: llama-cpp

Installed: 2025-11-06T17:55:50Z

Gallery: github:mudler/LocalAI/backend/index.yaml@master

Path: /var/www/localai/backends/cpu-llama-cpp/run.sh