Favur Evals
favur.dev

Agent role · weight 9/100 · rubric v15

📋 Sprint Review

Evaluates sprint deliverables via delegated review/build/test and issues an APPROVE / REJECT / ESCALATE verdict.

What it's scored on

Output quality
Sprint verdict, review completeness and test quality (verdict-derived terms stay unavailable until favur emits structured verdict telemetry).
Efficiency
Token volume, output per request, cost, request-error and hallucination rates.

Full scoring definition in the methodology → · Sample transcript

Model leaderboard

Every model ranked by Sprint Review score
#ModelScore / 10CoveragenLast seen
1Xiaomi Mimo v2.5 †8.5186%52026-07-26
2Meta Muse Spark 1.18.31100%32026-07-19
3Google Gemini Flash Lite 3.5 †8.29100%12026-07-21
4xAI Grok 4.5 †8.1383%42026-07-22
5Google Gemini Flash Lite 3.1 †8.1160%82026-07-19
6Google Gemini Flash 3.67.77100%52026-07-24
7Qwen Plus qwen3.7 †7.7783%42026-07-22
8Moonshot AI Kimi Code k2.7 †6.8630%22026-07-10
9OpenAI Gpt Luna 5.6 †6.3430%12026-07-14
10Xiaomi Mimo Pro v2.5 †6.3330%32026-07-05
11Z.ai Glm 5.2 †6.1953%32026-07-17
12Anthropic Claude Sonnet 5 †6.1872%52026-07-23
13DeepSeek Deepseek Pro v4 †6.0430%32026-07-05
14Stepfun Step Flash 3.7 †5.9865%22026-07-19
15Thinkingmachines Inkling5.8093%22026-07-22
16DeepSeek Deepseek Flash v4 †5.7442%62026-07-22
17Moonshot AI Kimi k2.6 †5.4153%32026-07-17
18Google Gemini Pro 3.1 (preview) †5.0930%22026-07-03
19Google Gemini Flash 3 (preview) †4.8830%62026-07-10
20Google Gemini Flash 3.5 †4.4530%22026-07-08
21Anthropic Claude Sonnet 4.6 †2.9130%22026-07-03

† low confidence — sparse role or low data coverage (renormalized, never zero-filled).

Per-run history (newest first)

Every appearance of the Sprint Review role, newest first
DateRunSoWModelScore / 10
2026-07-26solarSystem__multi-xiaomi-mimo-v2.5-7.26.2026solarSystemXiaomi Mimo v2.58.18
2026-07-24circles__google-gemini-3.6-flash-7.23.2026circlesGoogle Gemini Flash 3.67.45
2026-07-24circles__xiaomi-multi-model-2.5-2.5-pro-7.24.2026circlesXiaomi Mimo v2.59.03
2026-07-23solarSystem/multi-anthropic-sonnet-gemini-3.5-flash-lite-7.22.2026solarSystemAnthropic Claude Sonnet 57.38
2026-07-22circles__thinkingmachines-inkling-7.22.2026circlesThinkingmachines Inkling6.29
2026-07-22circles__x-ai-grok-4.5-7.22.2026circlesxAI Grok 4.58.34
2026-07-22circles__deepseek-deepseek-v4-flash-7.22.2026circlesDeepSeek Deepseek Flash v48.42
2026-07-22circles__anthropic-claude-sonnet-5-7.21.2026circlesAnthropic Claude Sonnet 58.16
2026-07-22the2048__gemini-multi-model-7-22-2026the2048Google Gemini Flash 3.68.34
2026-07-22circles__qwen-qwen3.7-plus-7.22.2026circlesQwen Plus qwen3.78.04
2026-07-22circles__xiaomi-mimo-v2.5-7.22.2026circlesXiaomi Mimo v2.59.26
2026-07-21solarSystem__google-multi-model-7.21.2026solarSystemGoogle Gemini Flash 3.67.85
2026-07-21circles__x-ai-grok-4.5-7.21.2026circlesGoogle Gemini Flash 3.67.36
2026-07-21circles__google-gemini-3.6-flash-7.21.2026circlesGoogle Gemini Flash 3.67.87
2026-07-21circles__google-gemini-3.5-flash-lite-7.21.2026circlesGoogle Gemini Flash Lite 3.58.29
2026-07-19solarSystem__stepfun-step-3.7-flash-7.19.2026solarSystemStepfun Step Flash 3.77.21
2026-07-19circles__x-ai-grok-4.5-7.18.2026circlesxAI Grok 4.58.71
2026-07-19solarSystem__qwen-qwen3.7-plus-7.18.2026solarSystemQwen Plus qwen3.77.66
2026-07-19the2048__meta-muse-spark-1.1-7.19.2026the2048Meta Muse Spark 1.17.41
2026-07-19circles__google-gemini-3.1-flash-lite-7.19.2026circlesGoogle Gemini Flash Lite 3.19.08
2026-07-18circles__thinkingmachines-inkling-7.18.2026circlesThinkingmachines Inkling5.32
2026-07-18solarSystem__xiaomi-mimo-v2.5-7.18.2026solarSystemXiaomi Mimo v2.58.80
2026-07-17circles__z-ai-glm-5.2-7.17.2026circlesZ.ai Glm 5.28.57
2026-07-17circles__moonshotai-kimi-k2.6-7.16.2026circlesMoonshot AI Kimi k2.68.17
2026-07-17circles__x-ai-grok-4.5-7.16.2026circlesxAI Grok 4.58.69
2026-07-17circles__anthropic-claude-sonnet-5-7.16.2026circlesAnthropic Claude Sonnet 58.17
2026-07-17circles__qwen-qwen3.7-plus-7.16.2026circlesQwen Plus qwen3.78.81
2026-07-17solarSystem__meta-muse-spark-1.1-7.17.2026solarSystemMeta Muse Spark 1.18.48
2026-07-17circles__meta-muse-spark-1.1-7.16.2026circlesMeta Muse Spark 1.19.04
2026-07-16circles__google-multi-model-7.18.2026circlesGoogle Gemini Flash Lite 3.18.95
2026-07-16circles__google-multi-model-7.17.2026circlesGoogle Gemini Flash Lite 3.19.00
2026-07-15solarSystem__google-multi-model-7.15.2026solarSystemGoogle Gemini Flash Lite 3.16.95
2026-07-15circles__google-gemini-3.1-flash-lite-7.14.2026circlesGoogle Gemini Flash Lite 3.17.67
2026-07-15circles__google-multi-model-7.15.2026circlesGoogle Gemini Flash Lite 3.18.54
2026-07-14circles__openai-gpt-5.6-luna-7.14.2026circlesOpenAI Gpt Luna 5.66.34
2026-07-13circles__stepfun-step-3.7-flash-7.13.2026circlesStepfun Step Flash 3.74.76
2026-07-13solarSystem__google-gemini-3.1-flash-lite-7.12.2026solarSystemGoogle Gemini Flash Lite 3.16.70
2026-07-12circles__anthropic-claude-sonnet-5-7.11.2026circlesAnthropic Claude Sonnet 52.82
2026-07-10circles__google-gemini-3-flash-preview-7.9.2026circlesGoogle Gemini Flash 3 (preview)4.95
2026-07-10circles__moonshotai-kimi-k2.7-code-7.9.2026circlesMoonshot AI Kimi Code k2.77.32
2026-07-10circles__x-ai-grok-4.5-7.10.2026circlesxAI Grok 4.56.79
2026-07-10circles__deepseek-deepseek-v4-flash-7.10.2026circlesDeepSeek Deepseek Flash v48.08
2026-07-10circles__xiaomi-mimo-v2.5-pro-7.10.2026circlesXiaomi Mimo v2.57.29
2026-07-09circles__google-gemini-3-flash-preview-7.8.2026circlesGoogle Gemini Flash 3 (preview)5.28
2026-07-09circles__qwen-qwen3.7-plus-7.9.2026circlesQwen Plus qwen3.76.58
2026-07-09circles__google-gemini-3.1-flash-lite-7.9.2026circlesGoogle Gemini Flash Lite 3.17.99
2026-07-08circles__google-gemini-3.5-flash-7.8.2026circlesGoogle Gemini Flash 3.55.26
2026-07-08circles__google-gemini-3-flash-preview-7.7.2026circlesGoogle Gemini Flash 3 (preview)4.71
2026-07-08circles__moonshotai-kimi-k2.7-code-7.8.2026circlesMoonshot AI Kimi Code k2.76.40
2026-07-08circles__anthropic-claude-sonnet-5-7.8.2026circlesAnthropic Claude Sonnet 54.37
2026-07-05circles__google-gemini-3.5-flash-7.5.2026circlesGoogle Gemini Flash 3.53.64
2026-07-05circles__deepseek-deepseek-v4-pro-7.5.2026circlesDeepSeek Deepseek Pro v46.35
2026-07-05circles__google-gemini-3-flash-preview-7.5.2026circlesGoogle Gemini Flash 3 (preview)4.42
2026-07-05circles__moonshotai-kimi-k2.6-7.5.2026circlesMoonshot AI Kimi k2.64.31
2026-07-05circles__xiaomi-mimo-v2.5-pro-7.5.2026circlesXiaomi Mimo Pro v2.57.70
2026-07-04circles__deepseek-deepseek-v4-flash-7.3.2026circlesDeepSeek Deepseek Flash v45.34
2026-07-04circles__deepseek-deepseek-v4-flash-7.4.2026circlesDeepSeek Deepseek Flash v44.94
2026-07-03circles__anthropic-claude-sonnet-4.6-7.3.2026circlesAnthropic Claude Sonnet 4.62.67
2026-07-03circles__google-gemini-3.1-pro-preview-7.3.2026circlesGoogle Gemini Pro 3.1 (preview)5.68
2026-07-03circles__deepseek-deepseek-v4-pro-7.3.2026circlesDeepSeek Deepseek Pro v44.98
2026-07-03circles__z-ai-glm-5.2-7.3.2026circlesZ.ai Glm 5.25.72
2026-06-29solarSystem__xiaomi-mimo-v2.5-pro-6.29.2026solarSystemXiaomi Mimo Pro v2.55.07
2026-06-28circles__anthropic-claude-sonnet-4.6-6.28.2026circlesAnthropic Claude Sonnet 4.63.15
2026-06-28circles__google-gemini-3.1-pro-preview-6.28.2026circlesGoogle Gemini Pro 3.1 (preview)4.51
2026-06-28solarSystem__google-gemini-3-flash-preview-6.27.2026solarSystemGoogle Gemini Flash 3 (preview)3.80
2026-06-28circles__z-ai-glm-5.2-6.27.2026circlesZ.ai Glm 5.24.29
2026-06-28circles__xiaomi-mimo-v2.5-pro-6.28.2026circlesXiaomi Mimo Pro v2.56.22
2026-06-27circles__deepseek-deepseek-v4-pro-6.27.2026circlesDeepSeek Deepseek Pro v46.78
2026-06-27circles__moonshotai-kimi-k2.6-6.27.2026circlesMoonshot AI Kimi k2.63.76
2026-06-27solarSystem__deepseek-deepseek-v4-flash-6.27.2026solarSystemDeepSeek Deepseek Flash v43.17
2026-06-26circles__google-gemini-3-flash-preview-6.26.2026circlesGoogle Gemini Flash 3 (preview)6.13
2026-06-26the2048__deepseek-deepseek-v4-flash-6.26.2026the2048DeepSeek Deepseek Flash v44.49

Every run on Favur Evals is scored by the same deterministic engine, on the same Statements of Work. The benchmark is self-funded — no vendor sponsorship, credits, or grants.