Browse 2,559 Frameworks

By metainternal

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services. An open-source AI framework/SDK by metainternal, hosted on GitHub.

By comet-ml

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. An open-source AI framework/SDK by comet-ml, hosted on GitHub.

By 1Panel-dev

🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。. An open-source AI framework/SDK by 1Panel-dev, hosted on GitHub.

By NirDiamant

50+ tutorials and implementations for Generative AI Agent techniques, from basic conversational bots to complex multi-agent systems. An open-source AI framework/SDK by NirDiamant, hosted on GitHub.

By langchain-ai

The batteries-included agent harness. An open-source AI framework/SDK by langchain-ai, hosted on GitHub.

By mlflow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data. An open-source AI framework/SDK by mlflow, hosted on GitHub.

By NirDiamant

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial. An open-source AI framework/SDK by NirDiamant, hosted on GitHub.

By huggingface

This repository contains the Hugging Face Agents Course. An open-source AI framework/SDK by huggingface, hosted on GitHub.

By langfuse

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform. An open-source AI framework/SDK by langfuse, hosted on GitHub.

By chatchat-space

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain. An open-source AI framework/SDK by chatchat-space, hosted on GitHub.

By langchain-ai

Build resilient agents. An open-source AI framework/SDK by langchain-ai, hosted on GitHub.

By BerriAI

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]. An open-source AI framework/SDK by BerriAI, hosted on GitHub.

By FlowiseAI

Build AI Agents, Visually. An open-source AI framework/SDK by FlowiseAI, hosted on GitHub.

By headroomlabs-ai

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server. An open-source AI framework/SDK by headroomlabs-ai, hosted on GitHub.

By microsoft

Python tool for converting files and office documents to Markdown. An open-source AI framework/SDK by microsoft, hosted on GitHub.

By artas728

AI-to-AI Testing | Simulation framework for LLM-based applications. An open-source AI framework/SDK by artas728, hosted on GitHub.

By wladpaiva

Multi-Agent Conversation Framework in TypeScript. An open-source AI framework/SDK by wladpaiva, hosted on GitHub.

By axar-ai

Minimal typescript agent framework that keeps it simple and gives you control - no BS. An open-source AI framework/SDK by axar-ai, hosted on GitHub.

By hassancs91

Python library for building with LLMs. One interface across 11 providers (OpenAI, Anthropic, Gemini, DeepSeek, Ollama and more), automatic failover, Pydantic-validated structured output, embeddings with vector search, and an AI-powered router. pip install simplerllm. An open-source AI framework/SDK by hassancs91, hosted on GitHub.

By promptslab

FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text). An open-source AI framework/SDK by promptslab, hosted on GitHub.

By craftgen

Integrating AI into every workflow with our open-source, no-code platform, powered by the actor model for dynamic, graph-based solutions. An open-source AI framework/SDK by craftgen, hosted on GitHub.

By palico-ai

Build, Improve Performance, and Productionize your AI Application. An open-source AI framework/SDK by palico-ai, hosted on GitHub.

By RyanAlberts

🏆 Ranked list of 167 AI agent harnesses, plus templates, playbooks, MCP, and learning resources. Rescored weekly. An open-source AI framework/SDK by RyanAlberts, hosted on GitHub.

By InternLM

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies. An open-source AI framework/SDK by InternLM, hosted on GitHub.

By expectedparrot

Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs. An open-source AI framework/SDK by expectedparrot, hosted on GitHub.

By yinizhilian

历年ICLR论文和开源项目合集，包含ICLR2021、ICLR2022、ICLR2023、ICLR2024、ICLR2025. An open-source AI framework/SDK by yinizhilian, hosted on GitHub.

By Maximilian-Winter

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls. An open-source AI framework/SDK by Maximilian-Winter, hosted on GitHub.

By promptise-com

The foundation layer for agentic intelligence. An open-source AI framework/SDK by promptise-com, hosted on GitHub.

By StreetLamb

Low code tool to rapidly build and coordinate multi-agent teams. An open-source AI framework/SDK by StreetLamb, hosted on GitHub.

By ovg-project

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond. An open-source AI framework/SDK by ovg-project, hosted on GitHub.

By Scale3-Labs

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊. An open-source AI framework/SDK by Scale3-Labs, hosted on GitHub.

By AgentEra

[GenAI Application Development Framework] 🚀 Build GenAI application quick and easy 💬 Easy to interact with GenAI agent in code using structure data and chained-calls syntax 🧩 Use Event-Driven Flow *TriggerFlow* to manage complex GenAI working logic 🔀 Switch to any model without rewrite application code. An open-source AI framework/SDK by AgentEra, hosted on GitHub.

By xingyaoww

Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji. An open-source AI framework/SDK by xingyaoww, hosted on GitHub.

By shcherbak-ai

ContextGem: Effortless LLM extraction from documents. An open-source AI framework/SDK by shcherbak-ai, hosted on GitHub.

By microsoft

AICI: Prompts as (Wasm) Programs. An open-source AI framework/SDK by microsoft, hosted on GitHub.

By SqueezeAILab

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling. An open-source AI framework/SDK by SqueezeAILab, hosted on GitHub.

By trypromptly

No-code multi-agent framework to build LLM Agents, workflows and applications with your data. An open-source AI framework/SDK by trypromptly, hosted on GitHub.

By HolmesGPT

SRE Agent - CNCF Sandbox Project. An open-source AI framework/SDK by HolmesGPT, hosted on GitHub.

By langroid

Harness LLMs with Multi-Agent Programming. An open-source AI framework/SDK by langroid, hosted on GitHub.

By The-Pocket

Pocket Flow: Codebase to Tutorial. An open-source AI framework/SDK by The-Pocket, hosted on GitHub.

By The-Pocket

Pocket Flow: 100-line LLM framework. Let Agents build Agents!. An open-source AI framework/SDK by The-Pocket, hosted on GitHub.

By microsoft

A programming framework for agentic AI. An open-source AI framework/SDK by microsoft, hosted on GitHub.

By msoedov

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪. An open-source AI framework/SDK by msoedov, hosted on GitHub.

By langfengQ

verl-agent is an extension of veRL, designed for training LLM/VLM agents via RL. verl-agent is also the official code for paper "Group-in-Group Policy Optimization for LLM Agent Training". An open-source AI framework/SDK by langfengQ, hosted on GitHub.

By GammaLabTechnologies

Portable AI agent orchestration with mechanical protocol enforcement. 186 agents, zero runtime dependencies. An open-source AI framework/SDK by GammaLabTechnologies, hosted on GitHub.

By lioensky

VCP 部署在 AI 模型 API 与前端应用之间，是面向AGI OS开发和探索的工业级基建示范项目。通过统一指令协议、多层级持久化记忆、分布式插件引擎及多 Agent 协作框架，将原本“无状态、无记忆、无工具调用能力”的大语言模型，彻底改造成拥有永久自我意识、物理世界操作权及群体协作智能的完整智能体系统。. An open-source AI framework/SDK by lioensky, hosted on GitHub.

By foryourhealth111-pixel

Intelligent Skill routing and workflow orchestration for AI agents — +21.12 pp reward, −29.6% tokens on SkillsBench with DeepSeekV4Flash-VE. An open-source AI framework/SDK by foryourhealth111-pixel, hosted on GitHub.

By open-gitagent

A framework-agnostic, git-native standard for defining AI agents. An open-source AI framework/SDK by open-gitagent, hosted on GitHub.