Top 100 llama.cpp Repositories

Back to Home

Ranking

Ranking	Project Name	Stars	Forks	Language	Open Issues	Description	Last Commit
1	llama.cpp	111,543	18,461	C++	680	LLM inference in C/C++	2026-05-20
2	h2ogpt	11,987	1,313	Python	292	Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/	2025-10-09
3	llama-cpp-python	10,317	1,405	Python	601	Python bindings for llama.cpp	2026-05-18
4	ipex-llm	8,806	1,426	Python	1213	Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete...	2026-01-28
5	local-deep-research	7,858	680	Python	91	~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encry...	2026-05-20
6	serge	5,732	397	Svelte	18	A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.	2025-11-21
7	smolvlm-realtime-webcam	5,554	896	HTML	12	Real-time webcam demo with SmolVLM and llama.cpp server	2025-05-12
8	llama-swap	4,165	322	Go	39	Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc	2026-05-18
9	Sidekick	3,241	143	Swift	33	A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp...	2026-05-10
10	ik_llama.cpp	2,502	322	C++	48	llama.cpp fork with additional SOTA quants and improved performance	2026-05-20
11	maid	2,491	264	TypeScript	9	Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.	2026-04-07
12	node-llama-cpp	2,062	194	TypeScript	28	Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level	2026-05-06
13	llama.go	1,407	73	Go	16	llama.go is like llama.cpp in pure Golang!	2024-09-20
14	gpu_poor	1,399	89	JavaScript	8	Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization	2024-12-03
15	minuet-ai.nvim	1,216	52	Lua	11	💃 Dance with Intelligence in Your Code. Minuet offers code completion as-you-type from popular LLMs including OpenAI, Gemini, Claude, Ollama, Llama.cpp, Codestral, and more.	2026-05-16
16	wllama	1,071	93	TypeScript	42	WebAssembly binding for llama.cpp - Enabling on-browser LLM inference	2026-05-17
17	club-3090	1,015	50	Python	10	Community recipes for serving LLMs on RTX 3090/CUDA gpus. Multi-engine (vLLM, llama.cpp, SGLang) and model-agnostic. Currently shipping Qwen3.6-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1× a...	2026-05-20
18	pygpt4all	1,012	157	C++	19	Official supported Python bindings for llama.cpp + gpt4all	2023-05-12
19	rotorquant	992	85	Python	7	KV cache compression via block-diagonal rotation. Beats TurboQuant: better PPL (6.91 vs 7.07), 28% faster decode, 5.3x faster prefill, 44x fewer params. Drop-in llama.cpp integration.	2026-04-23
20	vllm-studio	983	77	TypeScript	0	Control panel for VLLM, Sglang, llama.cpp, exllamav3	2026-05-19
21	llama.rn	950	101	C++	11	React Native binding of llama.cpp	2026-05-20
22	go-llama.cpp	897	112	C++	30	LLama.cpp golang bindings	2026-05-18
23	llama-node	865	65	Rust	45	Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.	2023-08-03
24	DevoxxGenieIDEAPlugin	649	88	Java	53	DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All, Jan and Llama.cpp) and Cloud based LLMs to help review, test, explain your project code. Latest version now ...	2026-05-19
25	llama-cpp-agent	634	70	Python	22	The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured ou...	2026-03-09
26	kronk	625	35	Go	7	Your personal engine for running open source models locally. Use Go for hardware accelerated local inference with llama.cpp directly integrated into your Go applications via the yzma module. Kronk pro...	2026-05-20
27	gpt-llama.cpp	595	67	JavaScript	28	A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI.	2023-06-12
28	llama-cpp-rs	568	195	Rust	33		2026-05-20
29	search	546	24	Go	5	Go library for embedded vector search and semantic embeddings using llama.cpp	2026-03-06
30	FreeChat	500	44	Swift	21	llama.cpp based AI chat app for macOS	2024-11-25
31	llavavision	495	34	JavaScript	2	A simple "Be My Eyes" web app with a llama.cpp/llava backend	2023-11-28
32	llamacpp-rocm	471	48	Python	22	Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration	2026-05-20
33	yzma	471	15	Go	2	Go with your own intelligence - Go applications that directly integrate llama.cpp for local inference using hardware acceleration.	2026-05-18
34	Box	449	23	Kotlin	4	Private on-device AI suite for Android. Fork of Google AI Edge Gallery with llama.cpp, whisper.cpp, stable-diffusion.cpp, GGUF import, voice chat, vision AI, on-device image generation, biometric lock...	2026-05-19
35	icebreaker	434	32	Rust	4	A local AI chat app powered by 🦀 Rust, 🧊 iced, 🤗 Hugging Face, and 🦙 llama.cpp	2026-02-16
36	rust-llama.cpp	423	53	Rust	13	LLama.cpp rust bindings	2024-06-27
37	java-llama.cpp	418	61	C++	37	Java Bindings for llama.cpp - A Port of Facebook's LLaMA model in C/C++	2025-06-20
38	hf-agents	411	25	Shell	2	HF CLI extension to run local coding agent powered by llmfit and llama.cpp	2026-03-25
39	Crane	390	44	Rust	9	A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler and cleaner..	2026-05-04
40	llama-throughput-lab	389	59	Python	4	Interactive launcher and benchmarking harness for llama.cpp server throughput, with tests, sweeps, and round‑robin load tools.	2026-02-08
41	Auto-Llama-cpp	384	65	Python	5	Uses Auto-GPT with Llama.cpp	2024-04-08
42	realtime-bakllava	379	42	Python	3	llama.cpp with BakLLaVA model describes what does it see	2023-11-08
43	Web-LLM-Assistant-Llamacpp-Ollama	376	47	Python	4	A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp	2024-10-27
44	minuet-ai.el	355	14	Emacs Lisp	8	💃 Dance with LLM in Your Code. Minuet offers code completion as-you-type from popular LLMs including OpenAI, Gemini, Claude, Ollama, Llama.cpp, Codestral, and more.	2026-05-19
45	llamanet	329	30	JavaScript	4	Replace OpenAI with Llama.cpp Automagically.	2024-06-09
46	sherpa	328	36	Dart	20	A mobile Implementation of llama.cpp	2024-02-01
47	llama_cpp_dart	294	62	Dart	1	dart binding for llama.cpp	2026-04-30
48	llama-cpp-wasm	291	34	JavaScript	7	WebAssembly (Wasm) Build and Bindings for llama.cpp	2024-07-23
49	iris_android	279	38	Kotlin	6	IRIS is an android app for interfacing with GGUF / llama.cpp models locally.	2025-02-01
50	llama.cpp-deepseek-v4-flash	269	47	C++	6	Experimental implementation of DeepSeek v4 flaash in llama.cpp	2026-04-27
51	sqlite-lembed	255	14	C	11	A SQLite extension for generating text embeddings from GGUF models using llama.cpp	2024-11-24
52	llama_ros	252	46	C++	0	llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2	2026-05-19
53	llama_cpp-rs	246	38	Rust	16	High-level, optionally asynchronous Rust bindings to llama.cpp	2024-06-05
54	llama_cpp.rb	236	18	C	7	llama_cpp.rb provides Ruby bindings for llama.cpp	2026-05-17
55	ML-gfx906	220	27	C#	2	ML software (llama.cpp, ComfyUI, vLLM) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60	2026-05-19
56	llm-server	216	9	Shell	2	Smart launcher for llama.cpp / ik_llama.cpp — auto-detects GPUs, optimizes MoE placement, crash recovery	2026-05-19
57	fllama	207	42	C++	17	llama.cpp for Flutter	2026-05-19
58	llamacpp-python	199	28	C++	10	Python bindings for llama.cpp	2023-04-22
59	kantv	192	24	C++	0	workbench for learning and practicing on-device AI technology in real scenario with online-TV on Android phone, powered by ggml(llama.cpp,whisper.cpp...) and FFmpeg and opencv-mobile	2025-06-12
60	llava-cpp-server	184	11	C++	1	LLaVA server (llama.cpp).	2023-10-20
61	ggify	178	15	Python	1	Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp	2025-04-29
62	llama-on-lambda	177	26	Python	8	Deploy llama.cpp compatible Generative AI LLMs on AWS Lambda!	2026-05-16
63	llama.clj	176	10	Clojure	2	Run LLMs locally. A clojure wrapper for llama.cpp.	2026-04-20
64	BlahST	173	10	Shell	0	Input text from speech in any Linux window, the lean, fast and accurate way, using whisper.cpp OFFLINE. Speak with local LLMs via llama.cpp.	2025-07-25
65	Llama-Unreal	170	27	C++	7	Llama.cpp plugin for Unreal Engine 5	2026-05-10
66	llama.cpp-android-tutorial	165	15	-	1	llama.cpp tutorial on Android phone	2026-03-21
67	Qwen3-ASR-GGUF	161	24	C++	12	将 Qwen3-ASR 的 LLM 部分导出为 GGUF，用 llama.cpp 进行加速推理。后者支持 Vulkan 和 Cuda 加速。	2026-04-29
68	llama.cpp-omni	152	35	C++	2	Omni inference in C/C++	2026-05-18
69	llm-llama-cpp	146	19	Python	11	LLM plugin for running models using llama.cpp	2024-01-29
70	llama-cpp-desktop	146	20	JavaScript	1	Windows desktop control panel for local llama.cpp server	2026-05-04
71	gbnfgen	143	10	TypeScript	3	TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces	2024-07-09
72	pi-llamacpp	141	10	TypeScript	2	An experimental pi extension that runs and manages qwen with llama.cpp	2026-05-11
73	OfflineLLM	139	9	Kotlin	0	A privacy-first Android chat app that runs large language models entirely on-device. No internet, no cloud, no tracking. Built with Kotlin, Jetpack Compose, and llama.cpp with optimized ARM NEON...	2026-05-16
74	ComfyUI-Prompt-MZ	133	13	Python	5	基于llama.cpp的一些和提示词相关的节点，目前包括美化提示词和类似clip-interrogator的图片反推 | Use llama.cpp to assist in generating some nodes related to prompt words, including beautifying prompt words and image recognition s...	2025-08-14
75	Llamatik	129	22	Kotlin	16	True on-device AI for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM, Speech-to-Text and Image Generation — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.	2026-05-19
76	SmarterRouter	129	11	Python	0	SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.	2026-05-10
77	Qwen3-TTS-GGUF	128	17	C++	15	最极速的Qwen3-TTS推理方案。将 Qwen3-TTS 的 LLM 部分导出为 GGUF，用 llama.cpp 进行加速推理。后者支持 Vulkan 和 Cuda 加速。	2026-03-27
78	docmind-ai-llm	125	22	Python	6	DocMind AI is a powerful, open-source Streamlit application leveraging LlamaIndex, LangGraph, and local Large Language Models (LLMs) via Ollama, LMStudio, llama.cpp, or vLLM for advanced document anal...	2026-05-20
79	CustomChar	122	13	C++	2	Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.	2023-12-05
80	llm-interface	122	13	JavaScript	2	A simple NPM interface for seamlessly interacting with 36 Large Language Model (LLM) providers, including OpenAI, Anthropic, Google Gemini, Cohere, Hugging Face Inference, NVIDIA AI, Mistral AI, AI21 ...	2026-05-17
81	llamactl	120	17	Go	3	Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.	2026-05-19
82	chat-llama-discord-bot	120	24	Python	8	A Discord Bot for chatting with LLaMA, Vicuna, Alpaca, MPT, or any other Large Language Model (LLM) supported by text-generation-webui or llama.cpp.	2023-06-04
83	llama_sdk	118	26	C++	8	lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)	2026-05-20
84	neurochat	117	13	Pascal	2	Native gui to serveral AI services plus llama.cpp local AIs.	2024-01-14
85	gpt4all-ui	111	33	Python	0	Simple Docker Compose to load gpt4all (Llama.cpp) as an API and chatbot-ui for the web interface. This mimics OpenAI's ChatGPT but as a local instance (offline).	2023-05-27
86	ContextPilot	110	6	Python	5	Accelerating Long Context LLM Inference with Accuracy-Preserving Context Optimization in SGLang, vLLM, llama.cpp, OpenClaw, RAG, and Agentic AI.	2026-05-14
87	llama-cpp-power8	105	17	C	2	llama.cpp optimizations for IBM POWER8: vec_perm non-bijunctive collapse, PSE hardware entropy, DCBT prefetch. Sovereign inference. Part of the Proof of Physical AI stack.	2026-05-18
88	easy-llama	105	7	Python	4	Python package wrapping llama.cpp for on-device LLM inference	2026-04-02
89	llama-cpp-python-cuBLAS-wheels	103	50	HTML	11	Wheels for llama-cpp-python compiled with cuBLAS support	2024-02-01
90	anemll-flash-llama.cpp	102	11	C++	0	Flash-MoE sidecar slot-bank runtime for large GGUF MoE models on Apple Silicon — llama.cpp fork	2026-05-16
91	AI.Labs	101	8	C#	1	openai chatgpt or local llm(llama.cpp gguf format)+TTS+STT+Word+Excel	2024-07-01
92	ComfyUI-Prompt-Manager	101	7	JavaScript	0	Prompt Manager for ComfyUI, with integration with llama.cpp for prompt generation. Allowing users to generate and save prompts, as well as extract prompts from images and video with Comfy/A1111 metada...	2026-05-20
93	LLMKube	96	16	Go	38	Kubernetes operator for local LLM inference with llama.cpp, vLLM, and TGI - multi-GPU, autoscaling, air-gapped, production-ready	2026-05-20
94	SwiftLlama	94	41	Swift	2	A Swift Wrapper for llama.cpp	2025-08-26
95	llama.cpp-hub	93	18	Java	1	自用的llama.cpp集成小工具，自用于AI MAX+ 395机器和双3090服务器。如有问题可以提ISSUE，回复不一定及时；也可以加QQ群：829631748，入群问题的答案是：防爆键盘	2026-05-20
96	rllama	91	4	Ruby	0	Ruby FFI bindings for llama.cpp to run open-source LLMs such as GPT-OSS, Qwen 3.5, Gemma 4, and Llama 3 locally with Ruby.	2026-04-12
97	signal-aichat	89	16	Python	4	An AI chatbot for Signal powered by Google Bard, Bing Chat, ChatGPT, HuggingChat, and llama.cpp	2024-04-22
98	running-llms-locally	89	9	Markdown	0	A comprehensive guide for running Large Language Models on your local hardware using popular frameworks like llama.cpp, Ollama, HuggingFace Transformers, vLLM, and LM Studio. Includes optimization tec...	2026-04-20
99	Medical-RAG-using-Bio-Mistral-7B	88	35	HTML	0	This is a RAG implementation using Open Source stack. BioMistral 7B has been used to build this app along with PubMedBert as an embedding model, Qdrant as a self hosted Vector DB, and Langchain & Llam...	2025-03-19
100	Framework-strix-halo-llm-setup	84	4	-	1	Complete guide to running large language models locally on AMD Ryzen AI Max+ 395 (Strix Halo) with 128GB unified memory. Covers BIOS config, kernel setup, ROCm installation, and llama.cpp deployment. ...	2025-12-14