Local AI Runners

Tools for running large language models locally on your own hardware

Local AI Runners — comparison of ollama, llama.cpp, gpt4all
Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
LLM inference in C/C++
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Popularity
Stars172,317112,86277,352
Global Rank#37#83#189
Weekly Activity(May 20 – May 27)
New Stars+60+132+3
Pushes8600
Issues Closed6150
Community
Forks16,29418,7428,326
Contributors6011,707122
Open Issues3,2731,718759
Project Info
Ownerollamaggml-orgnomic-ai
LicenseMITMITMIT
LanguageGoC++C++
CreatedJun 2023Mar 2023Mar 2023