Top 100 AI Safety Repositories
Ranking
| Ranking | Project Name | Stars | Forks | Language | Open Issues | Description | Last Commit |
|---|---|---|---|---|---|---|---|
| 1 | wasp | 18,569 | 1,461 | TypeScript | 769 | The batteries-included full-stack framework for the AI era. Develop JS/TS web apps (React, Node.js, and Prisma) using declarative code that abstracts away complex full-stack features like auth, backgr... | 2026-07-09 |
| 2 | Zero | 10,674 | 1,314 | TypeScript | 0 | Experience email the way you want with Mail0 – the first open source email app that puts your privacy and safety first. Join the discord: https://mail0.link/discord | 2026-05-26 |
| 3 | plano | 6,687 | 444 | Rust | 104 | Plano is an AI-native proxy and data plane for agentic apps — with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic. | 2026-07-09 |
| 4 | superagent | 6,668 | 962 | TypeScript | 6 | Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app and prove compliance to your customers. | 2026-04-11 |
| 5 | Awesome-OSINT-List | 3,676 | 480 | Shell | 0 | 📡 Comprehensive collection of OSINT tools for cybersecurity professionals, researchers, and bug bounty hunters. Topics: information gathering, reverse search, red team, trust & safety, AI. | 2026-07-05 |
| 6 | goclaw | 3,414 | 964 | Go | 168 | GoClaw - GoClaw is OpenClaw rebuilt in Go — with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compromising on safety. | 2026-07-10 |
| 7 | sunnypilot | 2,008 | 1,408 | Python | 22 | sunnypilot is an open source driver assistance system. sunnypilot offers the user a unique driving experience for over 350 supported car makes and models with modified behaviors of driving assist enga... | 2026-07-09 |
| 8 | agentic_coding_flywheel_setup | 1,533 | 176 | Shell | 0 | Bootstraps a fresh Ubuntu VPS into a complete multi-agent AI development environment in 30 minutes: coding agents, session management, safety tools, and coordination infrastructure | 2026-07-08 |
| 9 | Awesome-Jailbreak-on-LLMs | 1,511 | 118 | - | 0 | Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, datasets, evaluations, and analyses. | 2026-06-07 |
| 10 | valqore | 979 | 139 | Python | 1 | Safety-first guardrails for AI-driven cloud and Kubernetes operations | 2026-07-07 |
| 11 | shellfirm | 920 | 33 | Rust | 1 | Safety guardrails for ai coding agents and human terminal commands | 2026-05-15 |
| 12 | Synthid-Bypass | 833 | 119 | Python | 15 | Ai safety research showing a working bypass to Google's synthid on Nano Banana Pro | 2026-07-01 |
| 13 | AgentDoG | 657 | 29 | Python | 0 | A Diagnostic Guardrail Framework for AI Agent Safety and Security | 2026-06-08 |
| 14 | ai-safety-gridworlds | 635 | 126 | Python | 0 | This is a suite of reinforcement learning environments illustrating various safety properties of intelligent agents. | 2022-05-18 |
| 15 | polymarket-mcp-server | 588 | 132 | Python | 6 | 🤖 AI-Powered MCP Server for Polymarket - Enable Claude to trade prediction markets with 45 tools, real-time monitoring, and enterprise-grade safety features | 2026-06-23 |
| 16 | ai-scanner | 569 | 90 | Ruby | 0 | AI model safety scanner built on NVIDIA garak | 2026-07-09 |
| 17 | roam-code | 495 | 47 | Python | 1 | Local codebase intelligence CLI + MCP server for AI coding agents: SQLite code graph, 28 languages, 238 commands, 224 MCP tools, change-safety gates, audit evidence, zero API keys. | 2026-07-10 |
| 18 | dark-web-scraping-guide | 491 | 105 | - | 2 | Comprehensive guide for NetworkChuck Episode 480 - Robin AI Dark Web Scraping Tool. Installation, usage, safety guidelines, and troubleshooting for educational security research. | 2025-11-17 |
| 19 | Sponsio | 466 | 28 | Python | 0 | Deterministic safety solutions for probabilistic AI agents | 2026-07-03 |
| 20 | tiger | 403 | 27 | Jupyter Notebook | 7 | Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning) | 2023-12-02 |
| 21 | RAMPART | 378 | 46 | Python | 4 | A pytest-native safety and security testing framework for agentic AI applications | 2026-07-10 |
| 22 | AutoHarness | 347 | 26 | Python | 1 | AutoHarness: Automated Harness Engineering for AI Agents | 2026-04-02 |
| 23 | scope | 330 | 21 | Python | 0 | Configurable Multi-layered AI Agentic Safety Framework | 2026-06-27 |
| 24 | apple_generative_model_safety_decrypted | 317 | 33 | Python | 1 | Decrypted Generative Model safety files for Apple Intelligence containing filters | 2026-01-26 |
| 25 | clawshell | 299 | 23 | Rust | 0 | The Runtime Security Layer for OpenClaw/Hermes-agent, the essential safety harness for PII & sensitive credentials protection. | 2026-07-09 |
| 26 | Infosys-Responsible-AI-Toolkit | 298 | 72 | Python | 32 | The Infosys Responsible AI toolkit incorporates various features including safety, security, explainability, fairness, bias and hallucination detection to ensure AI solutions are trustworthy and trans... | 2026-06-09 |
| 27 | scirs | 267 | 33 | Rust | 0 | SciRS2 - Scientific Computing and AI in Rust., providing SciPy-compatible APIs while leveraging Rust's performance, safety, and concurrency features. Unlike traditional scientific libraries | 2026-07-08 |
| 28 | korean-safety-benchmarks | 252 | 18 | Python | 0 | Official datasets and pytorch implementation repository of SQuARe and KoSBi (ACL 2023) | 2023-06-29 |
| 29 | 6S191_MIT_DeepLearning | 251 | 78 | Jupyter Notebook | 1 | MIT Introduction to Deep Learning (6.S191) Instructors: Alexander Amini and Ava Soleimany Course Information Summary Prerequisites Schedule Lectures Labs, Final Projects, Grading, and Prizes Software ... | 2022-01-16 |
| 30 | AISafetyLab | 247 | 18 | Python | 0 | AISafetyLab: A comprehensive framework covering safety attack, defense, evaluation and paper list. | 2026-04-21 |
| 31 | CL1_LLM_Encoder | 232 | 41 | Python | 1 | Using Cortical Labs CL1 to train neurons to encode tokenization patterns on LLMs and measure consciousness metrics for advanced AI safety and sentience testing. EXPERIMENTAL: I AM IN NO WAY ASSOCIATED... | 2026-03-01 |
| 32 | river | 226 | 10 | TypeScript | 3 | the sane way to work with ai agent streams (type safety and stream resuming out of the box) | 2026-03-27 |
| 33 | Awesome-Embodied-AI | 224 | 10 | Python | 0 | Curated embodied AI list: surveys, VLA models, datasets, simulators, humanoids, robot learning, and safety resources. | 2026-06-14 |
| 34 | mental-wellness-prompts | 221 | 53 | - | 0 | Templates for AI-powered mental wellness support. Includes conversation frameworks, safety protocols, crisis resources, and implementation guides derived from evidence-based practices. | 2026-03-25 |
| 35 | awesome-ai-safety | 218 | 38 | - | 5 | 📚 A curated list of papers & technical articles on AI Quality & Safety | 2025-04-14 |
| 36 | anti-crime-ecosystem-research | 214 | 18 | - | 2 | Independent research white paper by Jon “GainSec” Gaines examining the security posture of a connected public safety technology ecosystem. | 2025-11-16 |
| 37 | paig | 213 | 220 | CSS | 53 | PAIG (Pronounced similar to paige or payj) is an open-source project designed to protect Generative AI (GenAI) applications by ensuring security, safety, and observability. | 2025-08-05 |
| 38 | 2.0-Healthcare-Ai-Systems | 205 | 33 | Python | 0 | Machine learning and decision intelligence models designed to improve healthcare safety through clinical risk prediction and medical interaction analysis. | 2026-03-19 |
| 39 | vault-operator | 204 | 21 | TypeScript | 2 | Real AI agent for your vault. Coworker, Copilot & thinking partner, that maintains your memory & knowledge, adapts to your workflows, uses plugins, skills & tools with full safety controls. BYOK & MCP... | 2026-07-08 |
| 40 | FlipAttack | 176 | 14 | Python | 0 | [ICML 2025] An official source code for paper "FlipAttack: Jailbreak LLMs via Flipping". | 2025-05-02 |
| 41 | sd0x-dev-flow | 173 | 23 | JavaScript | 3 | The harness layer for Claude Code — a reference implementation of harness engineering with hook-enforced dual review, state-machine gates that survive context compaction, and fail-closed safety where ... | 2026-07-10 |
| 42 | aismessages | 168 | 69 | Java | 2 | AISmessages is a Java-based light-weight, zero-dependency, and ultra-efficient message decoder for maritime navigation and safety messages compliant with ITU 1371 (NMEA armoured AIS messages). | 2026-07-08 |
| 43 | P4RS3LT0NGV3 | 162 | 42 | JavaScript | 0 | Parseltongue 3.1 - LLM Payload Crafter for AI safety research | 2025-11-14 |
| 44 | rosclaw | 158 | 31 | Python | 2 | Self-evolving runtime infrastructure for Physical AI and embodied agents. Ground AI agents into robot bodies with e-URDF, sandbox safety, capability routing, praxis capture, physical memory, runtime i... | 2026-07-10 |
| 45 | xcode27-skills | 129 | 8 | Python | 0 | Apple's official Agent Skills exported from Xcode 27 — SwiftUI, UIKit modernization, Swift Testing, C bounds-safety, and security hardening for AI coding agents. | 2026-06-09 |
| 46 | modelbench | 128 | 30 | Python | 531 | Run safety benchmarks against AI models and view detailed reports showing how well they performed. | 2026-07-09 |
| 47 | ais | 118 | 56 | Python | 4 | Toolkit for research purposes in AIS. See the website for the paper. | 2021-02-15 |
| 48 | model-community | 118 | 15 | Jupyter Notebook | 9 | Making open safety AI models accessible and beneficial to the safety community | 2026-07-09 |
| 49 | guardian-sdk | 114 | 13 | Python | 0 | Ethicore Engine™ is an AI safety, ethics, and compliance platform. This repo consists of the open-source components of Ethicore Engine™ - Guardian SDK; designed to protect your AI applications from pr... | 2026-07-03 |
| 50 | Awesome-Embodied-AI-Safety | 111 | 3 | JavaScript | 0 | Safety in Embodied AI: A Survey of Risks, Attacks, and Defenses | 500+ Papers | Perception, Cognition, Planning, Interaction, Agentic System | 2026-07-09 |
| 51 | Doberman-Core | 111 | 3 | Python | 0 | Doberman is an AI agent security framework for guardrails, prompt injection defense, runtime policy enforcement, tool-use permissions, agent monitoring, audit logs, LLM safety, autonomous workflow pro... | 2026-07-09 |
| 52 | Awesome-Embodied-AI-Safety | 110 | 5 | - | 0 | Focused on the safety and security of Embodied AI | 2026-06-08 |
| 53 | ultraship | 109 | 13 | JavaScript | 0 | "ULTRASHIP" Claude Code plugin — 39 skills, 33 tools, 11 agents for ship-ready workflows: planning, review, pentesting, safety guardrails, canary monitoring, SEO/AI-readiness check, penetration testin... | 2026-07-08 |
| 54 | tue-ai-safety-course | 104 | 8 | HTML | 0 | AI safety course at the University of Tübingen (Summer Semester 2026) | 2026-07-06 |
| 55 | agent-lens | 104 | 10 | Python | 1 | Agent observability and replay tooling for AI safety & interpretability research. | 2026-06-19 |
| 56 | airisc_core_complex | 104 | 22 | Verilog | 1 | Fraunhofer IMS processor core. RISC-V ISA (RV32IM) with additional peripherals for embedded AI applications and smart sensors. | 2025-06-24 |
| 57 | thebrain | 103 | 11 | JavaScript | 0 | A Claude Code plugin that gives your AI persistent memory, code awareness, safety guardrails, and a behavioral system that learns how you work | 2026-04-17 |
| 58 | OctoGuard--Free-OpenClaw-Security-Supervision-System | 101 | 0 | JavaScript | 0 | Safety Is All You Need ！Meet OctoGuard, the toughest boss for Lobster AI employees — a security governance and audit system designed for OpenClaw. Featuring an innovative security policy engine, it cu... | 2026-04-04 |
| 59 | ai-driven-development | 98 | 6 | Python | 0 | Practices, protocols, and skills for AI-driven software development. Skills and safety hooks for Claude Code, Codex, OpenCode, Cursor, Antigravity, and any agent supporting the Agent Skills standard. | 2026-06-30 |
| 60 | no0 | 97 | 2 | Python | 0 | No.0 — AI Agent Safety Guardian (cognitive-file monitor + internal control DLC) | 2026-05-10 |
| 61 | gensee-crate | 97 | 10 | Rust | 1 | Runtime safety for AI coding agents with real-time enforcement, system-event monitoring, and long-horizon provenance. Supports Claude Code, Codex, Antigravity, Omnigent on native macOS and Linux. | 2026-07-09 |
| 62 | TaskTracker | 92 | 21 | Jupyter Notebook | 1 | TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a simple linear probe-based method and a more sophisticated metr... | 2025-09-01 |
| 63 | ai-agent-evals | 91 | 22 | Python | 14 | Github action to evaluate AI agent applications using model as the judge, content safety and mathematical metrics. | 2026-05-20 |
| 64 | AgentLoom | 89 | 8 | Python | 4 | Simple, flexible workflow orchestration for multi-agent AI apps, with YAML configuration, runtime safety, observability, and resume support. | 2026-07-03 |
| 65 | AnoShip | 87 | 11 | Python | 6 | Anoamly-detection-driven deployment safety for production AI/ML systems | 2026-06-17 |
| 66 | MONET | 87 | 12 | Python | 5 | Transparent medical image AI via an image–text foundation model grounded in medical literature | 2025-04-08 |
| 67 | agent-safe-probe-x | 82 | 0 | TypeScript | 0 | ASP-X (Agent Safe Probe X) — An open-source framework for automated safety evaluation of intelligent agents, providing systematic, extensible tools for probing and assessing AI safety across diverse e... | 2026-05-29 |
| 68 | Awesome-Agentic-System-Design | 80 | 16 | - | 1 | A curated collection of resources, frameworks, papers, and best practices for designing, evaluating, and deploying agentic AI systems—from architecture patterns and safety considerations to real-world... | 2026-06-25 |
| 69 | heinzel | 79 | 12 | Shell | 0 | A ruleset that turns AI coding assistants (e.g. Claude Code) into disciplined Linux, FreeBSD & macOS sysadmins. Manages servers via SSH and localhost with safety guardrails, checklists, and team suppo... | 2026-07-01 |
| 70 | c-basic-programs | 79 | 23 | - | 0 | What is C#? C# is pronounced "C-Sharp". It is an object-oriented programming language created by Microsoft that runs on the .NET Framework. C# has roots from the C family, and the language is close ... | 2021-07-24 |
| 71 | Weapon-Detection-for-Police-use | 76 | 0 | HTML | 0 | AI-powered weapon detection system built for a project. Uses COCO-SSD and computer vision to detect guns/knives in CCTV or drone feeds, sending instant alerts to law enforcement for faster response an... | 2025-09-30 |
| 72 | gargantua | 74 | 6 | Swift | 0 | Native macOS system cleaner with YAML-driven safety rules, local AI explainability via MLX, and an MCP server for agent-controlled cleanup workflows. | 2026-07-05 |
| 73 | deepsafe-scan | 74 | 11 | Python | 0 | Universal preflight security scanner for AI coding agents — Detects hooks injection, credential exfiltration & backdoors in .cursorrules, CLAUDE.md, AGENTS.md and more. | 2026-05-29 |
| 74 | ActPlane | 73 | 8 | C | 2 | eBPF Information Flow Enforcement for AI Agent safety, security and effectiveness | 2026-07-09 |
| 75 | ASTRA | 73 | 5 | Python | 1 | 🥇 Amazon Nova AI Challenge Winner - ASTRA emerged victorious as the top attacking team in Amazon's global AI safety competition, defeating elite defending teams from universities worldwide in live ad... | 2026-05-11 |
| 76 | slb | 72 | 13 | Go | 0 | Two-person rule CLI for AI coding agents: peer review and approval required before running potentially destructive commands | 2026-06-23 |
| 77 | agent-guardrails-template | 70 | 2 | Go | 0 | Template repository with AI agent guardrails, safety protocols, and sprint task framework. For Claude, GPT, Gemini, and all LLMs. | 2026-06-16 |
| 78 | TIANCHI_BlackboxAdversial | 69 | 15 | Jupyter Notebook | 2 | 安全AI挑战者计划第一期-人脸识别对抗正式赛第四名 Safety AI Challenger Program Phase 1 - Face Recognition Adversarial Example the 4th Place | 2019-12-09 |
| 79 | ai-driver-safety | 68 | 23 | Python | 0 | Intelligent Driver Monitoring system for Autonomous Vehicles | 2026-05-14 |
| 80 | awesome-ai-safety | 67 | 7 | - | 0 | A curated list of awesome AI safety papers, projects and communities. | 2020-02-09 |
| 81 | Hybrid-RAG-System | 65 | 5 | Python | 0 | Hybrid-RAG is a full-stack enterprise-grade RAG system for healthcare AI, featuring hybrid retrieval, multi-dimensional conflict detection, intelligent dialogue management, and dual-layer safety check... | 2025-07-10 |
| 82 | prompt-generating | 65 | 19 | Python | 0 | is an elite, highly advanced command-line framework designed for generating complex prompt structures. It is built to push the boundaries of AI models by testing their alignment, safety filters, and o... | 2026-03-11 |
| 83 | awesome-safety-critical-ai | 64 | 19 | JavaScript | 0 | When the stakes are high, intelligence is only half the equation - reliability is the other ⚠️ | 2026-07-01 |
| 84 | ai-safety-dance | 63 | 7 | HTML | 3 | 2026-06-30 | |
| 85 | ai-data-model-safety.github.io | 62 | 4 | HTML | 1 | 2024-12-04 | |
| 86 | fastapi-ai-sdk | 62 | 3 | Python | 0 | FastAPI helper library for Vercel AI SDK backend implementation - Stream AI responses from FastAPI to Next.js with full type safety and SSE support | 2026-06-23 |
| 87 | Oyster | 62 | 3 | Python | 1 | The Oyster series is a set of safety models developed in-house by Alibaba-AAIG, devoted to building a responsible AI ecosystem. | Oyster 系列是 Alibaba-AAIG 自研的安全模型，致力于构建负责任的 AI 生态。 | 2026-04-29 |
| 88 | Optimization_of_Airway_Scheduling | 61 | 0 | Python | 0 | AI-powered airport runway scheduler using Graph Neural Networks on real ADS-B data. Detects takeoff/landing events, enforces wake-turbulence separation, and benchmarks against FCFS, GA & MILP baseline... | 2026-03-30 |
| 89 | ALERT | 60 | 9 | Python | 0 | Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming" | 2024-09-20 |
| 90 | RailMind-AI | 59 | 2 | Python | 0 | Agentic AI platform transforming passive CCTV into proactive railway safety intelligence. Real-time behavioural detection (suicide risk, pickpocketing) via YOLOv8 + BiLSTM + multi-agent reasoning — ze... | 2026-07-02 |
| 91 | awesome-ai-guardrails | 58 | 11 | Python | 0 | A curated list of materials on AI guardrails | 2026-06-22 |
| 92 | autogit | 57 | 12 | JavaScript | 0 | Auto commit & push for AI coding agents, with a safety level you pick. | 2026-07-04 |
| 93 | a1 | 55 | 3 | Python | 0 | The agent-to-code compiler that optimizes AI for speed 🏎️ and safety 🏁 | 2026-02-23 |
| 94 | landmine_det_rover | 55 | 1 | HTML | 0 | LIRA is a rugged, AI-powered rover designed to autonomously scan, detect, and map landmines in conflict zones. Beyond metal detection, it utilizes Computer Vision to identify human casualties and anim... | 2026-01-25 |
| 95 | AgentForge | 54 | 5 | Python | 0 | Open-source terminal AI coding-agent harness for studying agent loops, tools, MCP, skills, safety, and persistence. | 2026-06-27 |
| 96 | DermaDetect-AI | 54 | 0 | Jupyter Notebook | 0 | "Your skin's safety, Our prority" | 2026-01-31 |
| 97 | AI-safety-report | 53 | 1 | Python | 2 | The evaluation code for A Safety Report on GPT-5.2, Gemini 3 Pro, Qwen3-VL, Grok 4.1 Fast, Nano Banana Pro, and Seedream 4.5 | 2026-01-18 |
| 98 | AzureAIContentSafety | 51 | 32 | Python | 1 | 2024-06-11 | |
| 99 | frai | 51 | 4 | JavaScript | 0 | Open-source toolkit for responsible AI: CLI + SDK to scan code, collect evidence, and generate model cards, risk files, evals, and RAG indexes. | 2026-04-25 |
| 100 | yes.md | 50 | 6 | Shell | 0 | ✅ AI governance skill for Claude Code | AI 治理框架 | AI ガバナンスフレームワーク — Safety gates, evidence rules, anti-slack | 2026-05-18 |