eval-engineering

Here are 3 public repositories matching this topic...

TurabiOzturk / before-you-agree

Deterministic-first Chrome agreement analyzer showcasing eval engineering with JEV and pluggable System One classifiers.

chrome-extension classifier terms-and-conditions privacy-tech ai-evaluation agreement-analysis deterministic-ai eval-engineering jev system-one

Updated Sep 28, 2026
JavaScript

Ed-Marcavage / awesome-eval-engineering

Star

Awesome list for eval engineering (evals engineering): tools that automate LLM evals and agent evals, turn traces into test cases, and calibrate LLM-as-a-judge.

awesome awesome-list ai-agents ai-evaluation ai-testing llm-eval evals llm-evaluation llm-as-judge llm-as-a-judge llm-testing llm-evals agent-evals agent-evaluation ai-evals evaluation-engineering evals-engineering eval-engineering

Updated Sep 15, 2026

tylerbcrawford / llm-eval-harness

Star

LLM-as-judge evaluation harness — define rubric cases, score model outputs, gate CI. Runs fully offline in replay mode (no API key); EVAL_LIVE=1 hits the real Anthropic API.

ci evaluation pytest llm anthropic llm-evaluation llm-as-judge eval-engineering

Updated Sep 10, 2026
Python

Add this topic to your repo

To associate your repository with the eval-engineering topic, visit your repo's landing page and select "manage topics."

Learn more