Welcome to your LocalAI

The powerful FOSS alternative to OpenAI, Claude, and more

Documentation Model Gallery Import Model

Operations in Progress

Installed Models

5 models ready to use

ibm-granite.granite-4.0-1b icon

ibm-granite.granite-4.0-1b

llama-cpp
Chat
Edit
ibm-granite_granite-4.0-h-small icon

ibm-granite_granite-4.0-h-small

llama-cpp
Chat
Edit
qwen-image icon

qwen-image

diffusers
Image
Edit
sd-1.5-ggml icon

sd-1.5-ggml

stablediffusion-ggml
Image
Edit
whisper-medium-q5_0 icon

whisper-medium-q5_0

whisper
Edit

Installed Backends

11 backends ready to use

cpu-diffusers

User Installed
Alias: diffusers
Installed: 2025-11-04T11:49:32+08:00
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /home/harish/local-ai/backends/cpu-diffusers/run.sh

cpu-llama-cpp

User Installed
Alias: llama-cpp
Installed: 2025-11-03T15:51:09+08:00
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /home/harish/local-ai/backends/cpu-llama-cpp/run.sh

cpu-rfdetr

User Installed
Alias: rfdetr
Installed: 2025-11-03T15:32:55+08:00
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /home/harish/local-ai/backends/cpu-rfdetr/run.sh

cpu-stablediffusion-ggml

User Installed
Alias: stablediffusion-ggml
Installed: 2025-11-04T12:01:11+08:00
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /home/harish/local-ai/backends/cpu-stablediffusion-ggml/run.sh

cpu-whisper

User Installed
Alias: whisper
Installed: 2025-11-04T11:56:36+08:00
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /home/harish/local-ai/backends/cpu-whisper/run.sh

diffusers

User Installed
Alias: diffusers
Installed: 2025-11-04T11:49:32+08:00
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /home/harish/local-ai/backends/cpu-diffusers/run.sh

llama-cpp

User Installed
Alias: llama-cpp
Installed: 2025-11-03T15:51:09+08:00
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /home/harish/local-ai/backends/cpu-llama-cpp/run.sh

localai@whisper

User Installed Meta
Installed: 2025-11-04T11:58:05+08:00
Meta backend for: cpu-whisper
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /home/harish/local-ai/backends/cpu-whisper/run.sh

rfdetr

User Installed
Alias: rfdetr
Installed: 2025-11-03T15:32:55+08:00
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /home/harish/local-ai/backends/cpu-rfdetr/run.sh

stablediffusion-ggml

User Installed
Alias: stablediffusion-ggml
Installed: 2025-11-04T12:01:11+08:00
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /home/harish/local-ai/backends/cpu-stablediffusion-ggml/run.sh

whisper

User Installed
Alias: whisper
Installed: 2025-11-04T11:56:36+08:00
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /home/harish/local-ai/backends/cpu-whisper/run.sh