Local AI Runners

Tools for running large language models locally on your own hardware

Local AI Runners — comparison of ollama, llama.cpp, gpt4all
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
LLM inference in C/C++
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Popularity
Stars175,956120,11377,387
Global Rank#40#79#201
Weekly Activity(Jul 4 – Jul 11)
New Stars+6+10+1
Pushes4150
Issues Closed140
Community
Forks16,94820,4868,305
Contributors6101,806122
Open Issues3,4311,842768
Project Info
Ownerollamaggml-orgnomic-ai
LicenseMITMITMIT
LanguageGoC++C++
CreatedJun 2023Mar 2023Mar 2023