Top 100 LLaMA Repositories

Back to Home

Ranking

Ranking	Project Name	Stars	Forks	Language	Open Issues	Description	Last Commit
1	ollama	171,776	16,194	Go	2353	Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.	2026-05-20
2	llama.cpp	111,507	18,455	C++	675	LLM inference in C/C++	2026-05-20
3	vllm	80,512	16,991	Python	1982	A high-throughput and memory-efficient inference and serving engine for LLMs	2026-05-20
4	LlamaFactory	71,425	8,720	Python	966	Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)	2026-05-19
5	unsloth	64,749	5,728	Python	1074	Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.	2026-05-20
6	llama	59,436	9,795	Python	464	Inference code for Llama models	2025-01-26
7	llama_index	49,517	7,429	Python	184	LlamaIndex is the leading document agent and OCR platform	2026-05-20
8	LocalAI	46,361	4,091	Go	138	LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.	2026-05-19
9	aider	45,036	4,449	Python	1234	aider is AI pair programming in your terminal	2026-05-16
10	quivr	39,153	3,744	Python	4	Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama. Any Vectorstore: PGVector, Faiss. Any Files. Anyway you want.	2025-07-09
11	Langchain-Chatchat	38,052	6,211	Python	14	Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain	2025-11-10
12	khoj	34,622	2,204	Python	81	Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.	2026-03-26
13	AstrBot	32,622	2,248	Python	898	AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨	2026-05-19
14	fish-speech	30,416	2,586	Python	12	SOTA Open Source TTS	2026-05-12
15	llama3	29,290	3,527	Python	178	The official Meta Llama 3 GitHub site	2025-01-26
16	sglang	28,035	6,014	Python	648	SGLang is a high-performance serving framework for large language models and multimodal models.	2026-05-20
17	repomix	25,143	1,270	TypeScript	131	📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.	2026-05-19
18	LLaVA	24,811	2,764	Python	1096	[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.	2024-08-12
19	llamafile	24,470	1,360	C++	186	Distribute and run LLMs with a single file.	2026-05-19
20	Awesome-Chinese-LLM	22,567	2,127	-	7	整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。	2026-05-10
21	free-llm-api-resources	21,886	2,233	Python	15	A list of free LLM inference resources accessible via API.	2026-05-20
22	llama2.c	19,529	2,550	C	126	Inference Llama 2 in one file of pure C	2024-08-06
23	Chinese-LLaMA-Alpaca	18,944	1,853	Python	1	中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)	2026-04-19
24	alpaca-lora	18,926	2,190	Jupyter Notebook	333	Instruct-tune LLaMA on consumer hardware	2024-07-29
25	llama-cookbook	18,330	2,730	Jupyter Notebook	19	Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services	2026-05-19
26	airllm	18,105	1,965	Jupyter Notebook	137	AirLLM 70B inference with single 4GB GPU	2026-03-10
27	ChuanhuChatGPT	15,334	2,240	Python	122	GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.	2026-04-30
28	llama3-from-scratch	15,236	1,284	Jupyter Notebook	16	llama3 implementation one matrix multiplication at a time	2024-05-23
29	Llama-Chinese	14,716	1,300	Python	194	Llama中文社区，实时汇总最新Llama学习资料，构建最好的中文Llama大模型开源生态，完全开源可商用	2025-04-06
30	ms-swift	14,180	1,419	Python	994	Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-R1, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).	2026-05-20
31	PaddleNLP	12,946	3,039	Python	112	Easy-to-use and powerful LLM and SLM library with awesome model zoo.	2025-12-17
32	dalai	12,935	1,341	CSS	291	The simplest way to run LLaMA on your local machine	2024-06-18
33	OpenLLM	12,327	811	Python	4	Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.	2026-05-18
34	shell_gpt	12,064	961	Python	86	A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.	2026-05-06
35	langchain4j	12,029	2,241	Java	592	LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.	2026-05-17
36	h2ogpt	11,987	1,313	Python	292	Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/	2025-10-09
37	ludwig	11,703	1,219	Python	0	Low-code framework for building custom LLMs, neural networks, and other AI models	2026-05-19
38	tensorzero	11,380	830	Rust	334	TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.	2026-05-20
39	bisheng	11,376	1,869	TypeScript	104	BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.	2026-05-20
40	llama-gpt	10,964	714	TypeScript	84	A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!	2024-04-23
41	llama-cpp-python	10,316	1,405	Python	601	Python bindings for llama.cpp	2026-05-18
42	petals	10,140	609	Python	92	🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading	2024-09-07
43	ART	9,480	833	Python	67	Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!	2026-05-19
44	PowerInfer	9,469	576	C++	123	High-speed Large Language Model Serving for Local Deployment	2026-05-11
45	inference	9,308	826	Python	25	Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.	2026-05-19
46	oumi	9,235	766	Python	0	Easily fine-tune, evaluate and deploy Gemma 4, Qwen3.5, Qwen3.6, gpt-oss, DeepSeek-R1, or any open source LLM / VLM!	2026-05-19
47	TinyLlama	8,962	616	Python	45	The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.	2024-05-03
48	ipex-llm	8,806	1,426	Python	1213	Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.	2026-01-28
49	reor	8,562	525	JavaScript	113	Private & local AI personal knowledge management app for high entropy people.	2025-05-13
50	awesome-LLM-resources	8,364	870	-	1	🧑‍🚀 全世界最好的LLM资料总结（多模态生成、Agent、辅助编程、AI审稿、数据处理、模型训练、模型推理、o1 模型、MCP、小语言模型、视觉语言模型） | Summary of the world's best LLM resources.	2026-05-16
51	BELLE	8,281	766	HTML	106	BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）	2024-10-16
52	nexa-sdk	8,055	999	Kotlin	47	Run frontier LLMs and VLMs with day-0 model support across GPU, NPU, and CPU, with comprehensive runtime coverage for PC (Python/C++), mobile (Android & iOS), and Linux/IoT (Arm64 & x86 Docker). Supporting OpenAI GPT-OSS, IBM Granite-4, Qwen-3-VL, Gemma-3n, Ministral-3, and more.	2026-04-14
53	GPTCache	8,036	583	Python	75	Semantic cache for LLMs. Fully integrated with LangChain and llama_index.	2025-07-11
54	lmdeploy	7,864	698	Python	525	LMDeploy is a toolkit for compressing, deploying, and serving LLMs.	2026-05-19
55	local-deep-research	7,852	679	Python	91	~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.	2026-05-19
56	k8sgpt	7,796	996	Go	85	Giving Kubernetes Superpowers to everyone	2026-05-19
57	llama-models	7,607	1,368	Python	176	Utilities intended for use with Llama models.	2026-02-11
58	open_llama	7,525	406	-	37	OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset	2023-07-16
59	Chinese-LLaMA-Alpaca-2	7,139	565	Python	1	中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)	2026-04-19
60	mergekit	7,086	715	Python	240	Tools for merging pretrained large language models.	2026-05-06
61	llamacoder	6,934	1,643	TypeScript	2	Open source Claude Artifacts – built with Llama 3.1 405B	2026-05-08
62	llm-scraper	6,650	426	TypeScript	3	Turn any webpage into structured data using LLMs	2026-04-13
63	Firefly	6,643	587	Python	203	Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型	2024-10-24
64	Liger-Kernel	6,365	530	Python	94	Efficient Triton Kernels for LLM Training	2026-05-18
65	YuE	6,231	741	Python	84	YuE: Open Full-song Music Generation Foundation Model, something similar to Suno.ai but open	2025-06-04
66	lit-llama	6,079	521	Python	100	Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.	2025-07-01
67	LaWGPT	6,040	548	Python	86	🎉 Repo for LaWGPT, Chinese-Llama tuned with Chinese Legal knowledge. 基于中文法律知识的大语言模型	2024-06-11
68	enchanted	5,939	416	Swift	102	Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.	2025-03-19
69	LLaMA-Adapter	5,921	382	Python	109	[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters	2024-03-14
70	sdk-python	5,892	843	Python	333	A model-driven approach to building AI agents in just a few lines of code.	2026-05-19
71	serge	5,732	397	Svelte	18	A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.	2025-11-21
72	llama-fs	5,727	377	TypeScript	53	A self-organizing file system with llama 3	2025-08-08
73	paperless-ai	5,667	306	JavaScript	54	An automated document analyzer for Paperless-ngx using OpenAI API, Ollama, Deepseek-r1, Azure and all OpenAI API compatible Services to automatically analyze and tag your documents.	2026-05-13
74	Baichuan-7B	5,660	503	Python	85	A large-scale 7B pretraining language model developed by BaiChuan-Inc.	2024-07-18
75	smolvlm-realtime-webcam	5,554	896	HTML	12	Real-time webcam demo with SmolVLM and llama.cpp server	2025-05-12
76	MedicalGPT	5,421	751	Python	5	MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。	2026-04-28
77	shimmy	5,147	471	Rust	35	⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.	2026-03-26
78	gpustack	5,030	529	Python	527	A GPU cluster manager that configures and orchestrates inference engines like vLLM and SGLang for high-performance AI model deployment.	2026-05-19
79	obsidian-smart-connections	5,014	312	JavaScript	474	Chat with your notes & see links to related content with AI embeddings. Use local models or 100+ via APIs like Claude, Gemini, ChatGPT & Llama 3	2026-05-14
80	Huatuo-Llama-Med-Chinese	4,968	501	Python	28	Repo for BenCao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草（原名：华驼）模型仓库，基于中文医学知识的大语言模型指令微调	2026-04-14
81	h2o-llmstudio	4,967	530	Python	48	H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/	2026-04-29
82	transformerlab-app	4,945	511	Python	21	The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.	2026-05-20
83	tiny-universe	4,857	464	Jupyter Notebook	10	《大模型白盒子构建指南》：一个全手搓的Tiny-Universe	2026-02-12
84	Operit	4,694	378	Kotlin	97	The most powerful AI agent and AI chat software on Android/Operit是一款Android上能力最为强大、发展最久的AI Agent	2026-05-18
85	GPT-4-LLM	4,336	309	HTML	13	Instruction Tuning with GPT-4	2023-06-11
86	llama-stack-apps	4,300	644	-	25	Agentic components of the Llama Stack APIs	2025-08-05
87	llama_cloud_services	4,254	473	TypeScript	352	Knowledge Agents and Management in the Cloud	2026-05-18
88	PurpleLlama	4,183	734	Python	28	Set of tools to assess and improve LLM security.	2026-05-20
89	g1	4,183	361	Python	0	g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains	2025-12-30
90	llama-swap	4,165	321	Go	39	Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc	2026-05-18
91	llms-from-scratch-cn	4,162	573	Jupyter Notebook	11	仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理	2026-03-26
92	llama3-Chinese-chat	4,157	335	Python	30	Llama3-中文后训练版	2026-02-21
93	llama-dl	4,128	399	Shell	9	High-speed download of LLaMA, Facebook's 65B parameter GPT model	2023-06-28
94	Chinese-Vicuna	4,123	409	C	65	Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca	2025-04-18
95	LightLLM	4,069	328	Python	85	LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.	2026-05-20
96	lemonade	4,061	312	C++	228	Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk	2026-05-20
97	langroid	4,020	375	Python	51	Harness LLMs with Multi-Agent Programming	2026-05-06
98	SwanLab	3,941	207	Python	69	⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.	2026-05-20
99	zero_nlp	3,817	446	Jupyter Notebook	102	中文nlp解决方案(大模型、数据、模型、训练、推理)	2025-08-05
100	lorax	3,781	313	Python	149	Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs	2026-05-15