ai-evaluation

github.com

Open-source LLM and agent evaluation framework with 50+ metrics, LLM-as-Judge augmentation, and guardrail scanners (jailbreak, PII, prompt-injection). Useful for scoring RAG outputs, agent trajectories, and function-calling behavior in data-science workflows.

Description

Specs

Type	Repository
Section	GitHub projects
Pricing	open source
Platform	Self-hosted
Systems	исходный код
Site language	en
GitHub	future-agi/ai-evaluation

Source code

future-agi/ai-evaluation

Found in sources

Similar in «GitHub projects»

anthropics/claude-code

Claude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflows - all through natural language commands.

comfyanonymous/ComfyUI

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface. - Comfy-Org/ComfyUI

ossu/computer-science

🎓 Path to a free self-taught education in Computer Science!

Robust Speech Recognition via Large-Scale Weak Supervision

A deep learning library containing thousands of pre-trained models on different tasks. The goto place for anything related to Large Language Models.

hiyouga/LLaMA-Factory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024) - hiyouga/LlamaFactory