Ollama
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
LLMKube
awesome-selfhosted
Generative AI
Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API.
Descriptions are the source's original English text.
Get it free ↗
Website ↗
- Stars
- 232
- Last activity
- 2026-10-11
- Latest release
- v0.10.2 · 2026-10-07
- Commits in the last 90 days
- 342
Licenses
- Apache-2.0 Apache, Version 2.0
Platforms
GoDockerK8S
Free solutions in the same category
LobeHub
Modern design AI chat framework supporting multiple AI providers, one click install MCP Marketplace and Artifacts / Thinking.
AnythingLLM
All-in-one desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.
LocalAI
Run your AI models locally and generate images and audio (alternative to OpenAI and Claude).
LibreChat
Enhanced ChatGPT-compatible AI chat interface supporting multiple AI providers, with multi-user auth, message search, and plugin support.
awesome-selfhosted (CC-BY-SA 3.0) · collected 2026-10-12 · The free solution list is based on awesome-selfhosted (CC-BY-SA 3.0) and awesome-sysadmin (CC-BY-SA 4.0) data; each entry remains the copyright of its project.