LocalAI
LocalAI is an open-source AI infrastructure engine that enables operating LLM, visual, audio, image and video models on different hardware. OpenAI works in accordance with Anthropic and ElevenLabs API, ensuring that data does not leave your infrastructure. The backends of the models are installed separately on demand, and the API key contains multiple user features such as user quotas with authentication.
LocalAI
100mudler · Local AI / Self-Hosted LLM
Common commercial products in this category: ChatGPT, Claude, Gemini
- On different hardware architectures, you run LLM, visual, audio, video and video models through a single API
- You manage multiple user access with API key authentication and user quotas
- You configure built-in AI agents with tool usage, RAG and skills in your infrastructure
- • NeutralGitHub Issue
Better Support for AMD and ROCM via docker containers.
“Presently it is very hard to get a docker container to build with the rocm backend, some elements seem to fail independently during the build process. There are other related projects with functional docker implementations that do work with rocm out of the box (aka llama.cpp). I…”
- ↓ NegativeGitHub Issue
rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1">127.0
“**LocalAI version:** V1.21 root@63429046747f:/build# ./local-ai --version LocalAI version 4548473 (4548473acf4f57ff149492272cc1fdba3521f83a) llmai-api-1 | 3:04AM DBG Loading model ' **Environment, CPU architecture, OS, and Version:** Intel X86 centos **Describe the bug** Grpc…”
Verified against README · Oct 26, 2026 · source