Skip to main content
Vibgrate Graph: over 24% fewer tokens, same results
Back to Tags

LLM As Judge

4 items tagged with "llm-as-judge"

Filter by type:

Best Practices1

Best Practice

LLM Evaluation and Evals

LLM evaluation measures model and application quality with repeatable tests, scoring accuracy, faithfulness, safety, and cost so teams can ship and improve with evidence.

Benchmarks3

Benchmark

MT-Bench

A multi-turn conversational benchmark where a strong LLM judge scores model responses across categories on a 1-10 quality scale.

Benchmark

AlpacaEval

An automated LLM-as-judge benchmark that estimates a model's win rate against a reference model on open-ended instructions, with a length-controlled variant to reduce verbosity bias.

Benchmark

Arena-Hard

An automatic benchmark of challenging, real-user-derived prompts graded by an LLM judge, built to align closely with human preference rankings and separate strong models.