Top 100 MoE Repositories

Back to Home

Ranking

Ranking	Project Name	Stars	Forks	Language	Open Issues	Description	Last Commit
1	vllm	80,512	16,991	Python	1982	A high-throughput and memory-efficient inference and serving engine for LLMs	2026-05-20
2	LlamaFactory	71,425	8,720	Python	966	Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)	2026-05-19
3	sglang	28,035	6,014	Python	648	SGLang is a high-performance serving framework for large language models and multimodal models.	2026-05-20
4	ms-swift	14,180	1,419	Python	994	Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-R1, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).	2026-05-20
5	TensorRT-LLM	13,678	2,394	Python	589	TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.	2026-05-20
6	MoeKoeMusic	5,651	370	Vue	2	一款开源简洁高颜值的酷狗第三方客户端 An open-source, concise, and aesthetically pleasing third-party client for KuGou that supports Windows / macOS / Linux / Web :electron:	2026-05-15
7	flashinfer	5,639	985	Python	360	FlashInfer: Kernel Library for LLM Serving	2026-05-19
8	Bangumi	5,475	162	TypeScript	33	:electron: An unofficial https://bgm.tv ui first app client for Android and iOS, built with React Native. 一个无广告、以爱好为驱动、不以盈利为目的、专门做 ACG 的类似豆瓣的追番记录，bgm.tv 第三方客户端。为移动端重新设计，内置大量加强的网页端难以实现的功能，且提供了相当的自定义选项。 目前已适配 iOS / Android。	2026-05-19
9	xtuner	5,131	422	Python	238	A Next-Generation Training Engine Built for Ultra-Large MoE Models	2026-05-20
10	trace.moe	4,987	261	-	0	Trace back an anime scene with a screenshot	2026-04-06
11	fastllm	4,663	464	C++	283	fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型，任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署DeepSeek满血满精度原版模型，单并发20tps；INT4量化模型单并发30tps，多并发可达60+。	2026-05-18
12	GLM-4.5	4,344	454	Python	24	GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models	2026-02-01
13	Moeditor	4,114	270	JavaScript	106	(discontinued) Your all-purpose markdown editor.	2020-07-07
14	flash-moe	3,873	482	Objective-C	10	Running a big model on a small laptop	2026-03-19
15	Moe-Counter	2,906	287	JavaScript	3	Moe counter badge with multiple themes! - 多种风格可选的萌萌计数器	2026-04-16
16	moemail	2,573	2,289	TypeScript	47	A cute temporary email service built with NextJS + Cloudflare technology stack 🎉 | 一个基于 NextJS + Cloudflare 技术栈构建的可爱临时邮箱服务🎉	2026-03-30
17	MoeGoe	2,412	245	Python	28	Executable file for VITS inference	2023-08-22
18	MoE-LLaVA	2,315	141	Python	65	【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models	2025-07-15
19	MoBA	2,119	148	Python	10	MoBA: Mixture of Block Attention for Long-Context LLMs	2025-04-03
20	ICEdit	2,100	114	Python	23	[NeurIPS 2025] Image editing is worth a single LoRA! 0.1% training data for fantastic image editing! Surpasses GPT-4o in ID persistence~ MoE ckpt released! Only 4GB VRAM is enough to run!	2025-12-19
21	DeepSeek-MoE	1,933	308	Python	17	DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models	2024-01-16
22	fastmoe	1,850	206	Python	27	A fast MoE impl for PyTorch	2025-02-10
23	OpenMoE	1,679	86	Python	6	A family of open-sourced Mixture-of-Experts (MoE) Large Language Models	2024-03-08
24	paimon-moe	1,517	281	JavaScript	310	Your best Genshin Impact companion! Help you plan what to farm with ascension calculator and database. Also track your progress with todo and wish counter.	2026-05-20
25	uccl	1,370	146	C++	51	UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)	2026-05-20
26	moepush	1,347	432	TypeScript	14	一个基于 NextJS + Cloudflare 技术栈构建的可爱消息推送服务, 支持多种消息推送渠道✨	2025-05-10
27	SpikingBrain-7B	1,322	189	Python	7	Spiking Brain-inspired Large Models, integrating hybrid efficient attention, MoE modules and spike encoding into its architecture	2026-05-14
28	MOE	1,321	139	C++	170	A global, black box optimization engine for real world metric optimization.	2023-03-24
29	mixture-of-experts	1,243	112	Python	6	PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538	2024-04-19
30	Uni-MoE	1,106	69	Python	26	Uni-MoE: Lychee's Large Multimodal Model Family.	2025-12-22
31	MoeMemosAndroid	1,088	121	Kotlin	93	An app to help you capture thoughts and ideas	2026-05-19
32	Aria	1,088	87	Jupyter Notebook	32	Codebase for Aria - an Open Multimodal Native MoE	2025-01-22
33	SmartImage	1,021	55	C#	5	Reverse image search tool (SauceNao, IQDB, Ascii2D, trace.moe, and more)	2026-05-16
34	MiniMind-in-Depth	1,013	86	-	6	轻量级大语言模型MiniMind的源码解读，包含tokenizer、RoPE、MoE、KV Cache、pretraining、SFT、LoRA、DPO等完整流程	2025-06-16
35	llama-moe	1,001	60	Python	6	⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)	2024-12-06
36	MoeTTS	995	75	-	0	Speech synthesis model /inference GUI repo for galgame characters based on Tacotron2, Hifigan, VITS and Diff-svc	2023-03-03
37	Tutel	991	108	C	54	Tutel MoE: Optimized Mixture-of-Experts Library, Support GptOss/DeepSeek/Kimi-K2/Qwen3 using FP8/NVFP4/MXFP4	2026-05-13
38	Time-MoE	964	114	Python	15	[ICLR 2025 Spotlight] Official implementation of "Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts"	2026-03-21
39	moebius	937	52	JavaScript	40	Modern ANSI & ASCII Art Editor	2024-05-02
40	Adan	817	70	Python	6	Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models	2025-06-08
41	cudnn-frontend	816	163	Python	41	cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it	2026-05-20
42	Hunyuan-A13B	812	117	Python	24	Tencent Hunyuan A13B (short as Hunyuan-A13B), an innovative and open-source LLM built on a fine-grained MoE architecture.	2025-07-08
43	DeepSeek-671B-SFT-Guide	805	98	Python	1	An open-source solution for full parameter fine-tuning of DeepSeek-V3/R1 671B, including complete code and scripts from training to inference, as well as some practical experiences and conclusions. (DeepSeek-V3/R1 满血版 671B 全参数微调的开源解决方案，包含从训练到推理的完整代码和脚本，以及实践中积累一些经验和结论。)	2025-03-13
44	diy-llm	800	86	Jupyter Notebook	1	🎓 系统性大语言模型构建课程｜🛠️ 覆盖预训练数据工程、Tokenizer、Transformer、MoE、GPU 编程 (CUDA/Triton)、分布式训练、Scaling Laws、推理优化及对齐 (SFT/RLHF/GRPO)｜🚀 6 个渐进式作业 + 代码驱动，建立 LLM 全栈认知体系	2026-05-18
45	MoeMemos	797	71	Swift	68	An app to help you capture thoughts and ideas	2026-05-01
46	MixtralKit	774	75	Python	12	A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI	2023-12-15
47	moe-theme.el	770	66	Emacs Lisp	15	A customizable colorful eye-candy theme for Emacser. Moe, moe, kyun!	2026-05-15
48	moe	714	33	Nim	39	A command line based editor inspired by Vim. Written in Nim.	2026-05-19
49	sonic-moe	685	86	Python	8	Accelerating MoE with IO and Tile-aware Optimizations	2026-05-14
50	DeepSeek-V4-Pro-App	676	3	C++	2	DeepSeek V4 Pro: Advanced AI desktop app. Features: 1.6T MoE architecture, 1M token context window, Engram memory. Pro coding agent, Think Mode (High/Max), repo-level reasoning, complex bug fixing. Real-time web search, local API key storage, cross-file analysis, low-latency streaming interface.	2026-05-12
51	Awesome-Mixture-of-Experts-Papers	665	47	-	3	A curated reading list of research in Mixture-of-Experts(MoE).	2024-10-30
52	MoePeek	664	39	Swift	9	A lightweight macOS selection translator built with pure Swift 6, featuring on-device Apple Translate for privacy, only 5MB install size and stable ~50MB memory usage. 一款轻量级 macOS 划词翻译工具，纯 Swift 6 开发，设备端 Apple 翻译保护隐私，安装体积仅 5MB，后台运行内存稳定约 50MB	2026-05-16
53	SwiftLM	649	36	Swift	1	⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.	2026-05-19
54	moedict-webkit	647	99	Objective-C	102	萌典網站	2026-05-19
55	MoeList	636	23	Kotlin	32	Another unofficial Android MAL client	2026-05-06
56	vtbs.moe	631	36	Vue	34	Virtual YouTubers in bilibili	2025-07-31
57	satania.moe	617	54	HTML	3	Satania IS the BEST waifu, no really, she is, if you don't believe me, this website will convince you	2022-10-09
58	Chinese-Mixtral	612	43	Python	0	中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）	2026-04-19
59	moebius	609	42	Elixir	3	A functional query tool for Elixir	2024-10-23
60	moebooru	600	80	Ruby	30	Moebooru, a fork of danbooru1 that has been heavily modified	2026-05-19
61	MoeGoe_GUI	573	69	C#	8	GUI for MoeGoe	2023-08-22
62	trace.moe-telegram-bot	552	79	TypeScript	0	This Telegram Bot can tell the anime when you send an screenshot to it	2026-05-12
63	BitSoulStockSkill	543	45	Python	0	由BitSoul出品的A股市场全能Skill，自带免费历史数据，内置100+行业主流因子，完整的回测框架，基于MOE架构的股票筛选与买卖判断，更提供因子挖矿等趣味接口，欢迎安装试用，也欢共同开发交流！	2026-03-21
64	moerail	524	41	JavaScript	22	铁路车站代码查询 × 动车组交路查询	2025-08-13
65	YOLO-Master	511	60	Python	16	[CVPR2026]🚀🚀🚀Official code for the paper "YOLO-Master: MOE-Accelerated with Specialized Transformers for Enhanced Real-time Detection." (YOLO = You Only Look Once) 🔥🔥🔥	2026-05-16
66	LPLB	503	36	Python	1	An early research stage expert-parallel load balancer for MoE models based on linear programming.	2025-11-19
67	step_into_llm	478	126	Jupyter Notebook	27	MindSpore online courses: Step into LLM	2025-12-22
68	MOE	423	78	Java	18	Make Opensource Easy - tools for synchronizing repositories	2022-06-20
69	DiT-MoE	421	19	Python	7	Scaling Diffusion Transformers with Mixture of Experts	2024-09-09
70	MoeSR	416	12	JavaScript	8	An application specialized in image super-resolution for ACGN illustrations and Visual Novel CG. 专注于插画/Galgame CG等ACGN领域的图像超分辨率的应用	2026-03-09
71	hydra-moe	415	16	Python	10		2023-11-02
72	eLLM	412	42	Rust	1	eLLM can infer LLM on CPUs faster than on GPUs	2026-05-20
73	MoeLoaderP	409	28	C#	12	🖼二次元图片下载器 Pics downloader for booru sites,Pixiv.net,Bilibili.com,Konachan.com,Yande.re , behoimi.org, safebooru, danbooru,Gelbooru,SankakuComplex,Kawainyan,MiniTokyo,e-shuushuu,Zerochan,WorldCosplay ,Yuriimg etc.	2025-05-19
74	Awesome-Efficient-Arch	407	33	-	0	Speed Always Wins: A Survey on Efficient Architectures for Large Language Models	2025-11-11
75	moe-sticker-bot	406	60	Go	37	A Telegram bot that imports LINE/kakao stickers or creates/manages new sticker set.	2024-06-06
76	awesome-moe-inference	389	15	-	0	Curated collection of papers in MoE model inference	2026-03-12
77	nmoe	386	33	Python	2	MoE training for Me and You and maybe other people	2026-03-15
78	st-moe-pytorch	384	33	Python	4	Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch	2024-06-17
79	WThermostatBeca	371	70	C++	4	Open Source firmware replacement for Tuya Wifi Thermostate from Beca and Moes with Home Assistant Autodiscovery	2023-08-26
80	pixiv.moe	370	42	TypeScript	0	😘 A pinterest-style layout site, shows illusts on pixiv.net order by popularity.	2023-03-08
81	FreeMoe	370	8	-	10	Unlock App Vip	2026-01-30
82	Lvllm	364	34	Python	1	LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features an efficient GPU parallel and NUMA parallel architecture, supporting hybrid inference for MOE large models.	2026-04-28
83	MOEAFramework	356	129	Java	0	A Free and Open Source Java Framework for Multiobjective Optimization	2026-01-21
84	notify.moe	352	46	Go	86	💃 Anime tracker, database and community. Moved to https://git.akyoto.dev/web/notify.moe	2022-09-26
85	soft-moe-pytorch	347	10	Python	4	Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch	2025-04-02
86	dialogue.moe	344	11	Python	1		2022-12-14
87	MoH	312	15	Python	5	MoH: Multi-Head Attention as Mixture-of-Head Attention	2024-10-29
88	MoE-Infinity	304	28	Python	8	PyTorch library for cost-effective, fast and easy serving of MoE models.	2026-05-04
89	kimi-agent-internals	304	93	Fluent	0	Extracted artifacts from Kimi OK-Computer (and other agents) system for AI studies in agentic architecture.	2026-03-29
90	android-app	303	31	Kotlin	4	Official LISTEN.moe Android app	2026-05-17
91	apex-quant	303	25	Shell	4	Adaptive Precision for EXpert Models: MoE-aware mixed-precision quantization	2026-05-17
92	moell-blog	302	79	PHP	2	基于 Laravel 开发，支持 Markdown 语法的博客	2022-07-31
93	Project_Chronos	300	57	Python	0	⚡ Zero-Stall MoE Inference via Lookahead Prediction & Async DMA Prefetching. Optimized for SSD I/O with Hybrid MLA+Sliding Window Attention.	2026-04-26
94	moeSS	296	104	PHP	11	moe SS Front End for https://github.com/mengskysama/shadowsocks/tree/manyuser	2015-02-27
95	WAM-Diff	286	51	Python	1	WAM-Diff: A Masked Diffusion VLA Framework with MoE and Online Reinforcement Learning for Autonomous Driving	2026-02-01
96	moe	277	47	Scala	18	An -OFun prototype of an Ultra Modern Perl 5	2013-09-27
97	parameter-efficient-moe	276	17	Python	1		2023-10-31
98	Cornell-MOE	275	64	C++	25	A Python library for the state-of-the-art Bayesian optimization algorithms, with the core implemented in C++.	2020-02-04
99	MoE-Adapters4CL	274	27	Python	7	Code for paper "MoE-Adapters" CVPR2024 and "MoE-Adapters++" TPAMI2025	2025-09-18
100	Ling-V2	270	17	Python	4	Ling-V2 is a MoE LLM provided and open-sourced by InclusionAI.	2025-10-04