Local AI Runners

Tools for running large language models locally on your own hardware

Local AI Runners — comparison of ollama, llama.cpp, gpt4all
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
LLM inference in C/C++
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Popularity
Stars183,699131,57577,350
Global Rank#44#82#234
Weekly Activity(Oct 11 – Oct 17)
New Stars+1,117+867+26
Pushes11180
Issues Closed310
Community
Forks18,37624,5198,262
Contributors6272,133122
Open Issues4,3312,576775
Project Info
Ownerollamaggml-orgnomic-ai
LicenseMITMITMIT
LanguageGoC++C++
CreatedJun 2023Mar 2023Mar 2023