Local AI Runners

Tools for running large language models locally on your own hardware

Local AI Runners — comparison of ollama, llama.cpp, gpt4all
Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
LLM inference in C/C++
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Popularity
Stars168,664103,22177,310
Global Rank#35#93#170
Weekly Activity(Apr 5 – Apr 11)
New Stars+324+375+32
Pushes20410
Issues Closed9150
Community
Forks15,54316,7198,336
Contributors5961,614122
Open Issues2,9161,470758
Project Info
Ownerollamaggml-orgnomic-ai
LicenseMITMITMIT
LanguageGoC++C++
CreatedJun 2023Mar 2023Mar 2023