Popular repositories Loading

1. ai-evaluation-tools ai-evaluation-tools Public

   The comprehensive list of AI evaluation tools: 300+ open-source and commercial LLM evaluation frameworks, platforms, benchmarks, observability, red teaming, and guardrails — for LLMs, RAG, and AI a…

   Python 16 17

2. ai-agent-frameworks ai-agent-frameworks Public

   The comprehensive list of AI agent frameworks and orchestration tools: 175 SDKs, workflows, multi-agent systems, MCP tools, memory, deployment, and evaluation.

   Python 6 3

3. context-engineering-tools context-engineering-tools Public

   The comprehensive list of context engineering tools: 160+ tools for LLM memory, prompts, context management, compression, caching, MCP, retrieval, and evaluation.

   Python 4 4

4. ai-red-teaming-tools ai-red-teaming-tools Public

   The comprehensive list of AI red teaming tools: open-source and commercial frameworks, scanners, jailbreak tests, guardrails, benchmarks, and security resources.

   Python 4 6

5. llm-observability-tools llm-observability-tools Public

   The comprehensive list of LLM observability tools: 120 open-source and commercial platforms for AI tracing, monitoring, evaluation, analytics, cost, and security.

   Python 3 8

6. rag-retrieval-tools rag-retrieval-tools Public

   The comprehensive list of RAG and retrieval tools: 200+ vector databases, search frameworks, embeddings, rerankers, parsers, pipelines, benchmarks, and evaluation tools.

   Python 3 4