Favur Evals
favur.dev

Agent role · weight 9/100 · rubric v15

📅 Sprint Plan

Right-sizes tasks (≤ 8h), maps dependencies and runs a consolidation review with acceptance criteria per task.

What it's scored on

Output quality
Plan quality (task sizing, dependencies, acceptance criteria, sections) and deliverables.
Efficiency
Token volume, output per request, cost, context efficiency, request-error and hallucination rates.

Full scoring definition in the methodology → · Sample transcript

Model leaderboard

Every model ranked by Sprint Plan score
#ModelScore / 10CoveragenLast seen
1OpenAI Gpt Luna 5.6 †7.9976%12026-07-14
2Google Gemini Flash Lite 3.17.5687%102026-07-19
3Xiaomi Mimo Pro v2.57.5272%32026-07-05
4OpenAI Gpt Terra 5.6 †7.5176%12026-07-12
5DeepSeek Deepseek Pro v47.4073%32026-07-05
6DeepSeek Deepseek Flash v47.3278%62026-07-22
7Google Gemini Flash 3 (preview)7.1874%62026-07-10
8Moonshot AI Kimi Code k2.77.0776%22026-07-10
9Xiaomi Mimo v2.56.7494%52026-07-26
10xAI Grok 4.56.7391%42026-07-22
11Stepfun Step Flash 3.76.6988%22026-07-19
12Meta Muse Spark 1.16.6499%32026-07-19
13Google Gemini Pro 3.1 (preview)6.6072%22026-07-03
14Google Gemini Flash 3.56.5876%22026-07-08
15Moonshot AI Kimi k2.66.5380%32026-07-17
16Z.ai Glm 5.26.5180%32026-07-17
17Qwen Plus qwen3.76.4492%42026-07-22
18Anthropic Claude Sonnet 4.66.0872%22026-07-03
19Anthropic Claude Sonnet 55.7089%52026-07-23
20Google Gemini Flash 3.65.6898%52026-07-24
21Google Gemini Flash Lite 3.5 †5.5796%12026-07-21
22Thinkingmachines Inkling5.4296%22026-07-22

† low confidence — sparse role or low data coverage (renormalized, never zero-filled).

Per-run history (newest first)

Every appearance of the Sprint Plan role, newest first
DateRunSoWModelScore / 10
2026-07-26solarSystem__multi-xiaomi-mimo-v2.5-7.26.2026solarSystemXiaomi Mimo v2.56.46
2026-07-24circles__google-gemini-3.6-flash-7.23.2026circlesGoogle Gemini Flash 3.65.82
2026-07-24circles__xiaomi-multi-model-2.5-2.5-pro-7.24.2026circlesXiaomi Mimo v2.56.70
2026-07-23solarSystem/multi-anthropic-sonnet-gemini-3.5-flash-lite-7.22.2026solarSystemAnthropic Claude Sonnet 55.37
2026-07-22circles__thinkingmachines-inkling-7.22.2026circlesThinkingmachines Inkling5.17
2026-07-22circles__x-ai-grok-4.5-7.22.2026circlesxAI Grok 4.56.42
2026-07-22circles__deepseek-deepseek-v4-flash-7.22.2026circlesDeepSeek Deepseek Flash v46.17
2026-07-22circles__anthropic-claude-sonnet-5-7.21.2026circlesAnthropic Claude Sonnet 55.71
2026-07-22the2048__gemini-multi-model-7-22-2026the2048Google Gemini Flash 3.66.00
2026-07-22circles__qwen-qwen3.7-plus-7.22.2026circlesQwen Plus qwen3.75.97
2026-07-22circles__xiaomi-mimo-v2.5-7.22.2026circlesXiaomi Mimo v2.56.34
2026-07-21solarSystem__google-multi-model-7.21.2026solarSystemGoogle Gemini Flash 3.65.54
2026-07-21circles__x-ai-grok-4.5-7.21.2026circlesGoogle Gemini Flash 3.64.99
2026-07-21circles__google-gemini-3.6-flash-7.21.2026circlesGoogle Gemini Flash 3.66.05
2026-07-21circles__google-gemini-3.5-flash-lite-7.21.2026circlesGoogle Gemini Flash Lite 3.55.57
2026-07-19solarSystem__stepfun-step-3.7-flash-7.19.2026solarSystemStepfun Step Flash 3.76.21
2026-07-19circles__x-ai-grok-4.5-7.18.2026circlesxAI Grok 4.56.45
2026-07-19solarSystem__qwen-qwen3.7-plus-7.18.2026solarSystemQwen Plus qwen3.76.36
2026-07-19the2048__meta-muse-spark-1.1-7.19.2026the2048Meta Muse Spark 1.15.82
2026-07-19circles__google-gemini-3.1-flash-lite-7.19.2026circlesGoogle Gemini Flash Lite 3.16.81
2026-07-18circles__thinkingmachines-inkling-7.18.2026circlesThinkingmachines Inkling5.67
2026-07-18solarSystem__xiaomi-mimo-v2.5-7.18.2026solarSystemXiaomi Mimo v2.56.33
2026-07-17circles__z-ai-glm-5.2-7.17.2026circlesZ.ai Glm 5.25.92
2026-07-17circles__moonshotai-kimi-k2.6-7.16.2026circlesMoonshot AI Kimi k2.65.53
2026-07-17circles__x-ai-grok-4.5-7.16.2026circlesxAI Grok 4.56.46
2026-07-17circles__anthropic-claude-sonnet-5-7.16.2026circlesAnthropic Claude Sonnet 55.06
2026-07-17circles__qwen-qwen3.7-plus-7.16.2026circlesQwen Plus qwen3.75.78
2026-07-17solarSystem__meta-muse-spark-1.1-7.17.2026solarSystemMeta Muse Spark 1.17.12
2026-07-17circles__meta-muse-spark-1.1-7.16.2026circlesMeta Muse Spark 1.16.98
2026-07-16circles__google-multi-model-7.18.2026circlesGoogle Gemini Flash Lite 3.16.89
2026-07-16circles__google-multi-model-7.17.2026circlesGoogle Gemini Flash Lite 3.17.36
2026-07-15solarSystem__google-multi-model-7.15.2026solarSystemGoogle Gemini Flash Lite 3.17.53
2026-07-15circles__google-gemini-3.1-flash-lite-7.14.2026circlesGoogle Gemini Flash Lite 3.17.98
2026-07-15circles__google-multi-model-7.16.2026circlesGoogle Gemini Flash Lite 3.17.85
2026-07-15circles__google-multi-model-7.15.2026circlesGoogle Gemini Flash Lite 3.18.05
2026-07-14circles__openai-gpt-5.6-luna-7.14.2026circlesOpenAI Gpt Luna 5.67.99
2026-07-14solarSystem__google-multi-model-7.14.2026solarSystemGoogle Gemini Flash Lite 3.17.97
2026-07-13circles__stepfun-step-3.7-flash-7.13.2026circlesStepfun Step Flash 3.77.17
2026-07-13solarSystem__google-gemini-3.1-flash-lite-7.12.2026solarSystemGoogle Gemini Flash Lite 3.17.64
2026-07-12circles__openai-gpt-5.6-terra-7.11.2026circlesOpenAI Gpt Terra 5.67.51
2026-07-12circles__anthropic-claude-sonnet-5-7.11.2026circlesAnthropic Claude Sonnet 55.99
2026-07-10circles__google-gemini-3-flash-preview-7.9.2026circlesGoogle Gemini Flash 3 (preview)7.12
2026-07-10circles__moonshotai-kimi-k2.7-code-7.9.2026circlesMoonshot AI Kimi Code k2.77.55
2026-07-10circles__x-ai-grok-4.5-7.10.2026circlesxAI Grok 4.57.58
2026-07-10circles__deepseek-deepseek-v4-flash-7.10.2026circlesDeepSeek Deepseek Flash v48.17
2026-07-10circles__xiaomi-mimo-v2.5-pro-7.10.2026circlesXiaomi Mimo v2.57.88
2026-07-09circles__google-gemini-3-flash-preview-7.8.2026circlesGoogle Gemini Flash 3 (preview)7.48
2026-07-09circles__qwen-qwen3.7-plus-7.9.2026circlesQwen Plus qwen3.77.63
2026-07-09circles__google-gemini-3.1-flash-lite-7.9.2026circlesGoogle Gemini Flash Lite 3.17.48
2026-07-08circles__google-gemini-3.5-flash-7.8.2026circlesGoogle Gemini Flash 3.56.70
2026-07-08circles__google-gemini-3-flash-preview-7.7.2026circlesGoogle Gemini Flash 3 (preview)7.30
2026-07-08circles__moonshotai-kimi-k2.7-code-7.8.2026circlesMoonshot AI Kimi Code k2.76.60
2026-07-08circles__anthropic-claude-sonnet-5-7.8.2026circlesAnthropic Claude Sonnet 56.35
2026-07-05circles__google-gemini-3.5-flash-7.5.2026circlesGoogle Gemini Flash 3.56.46
2026-07-05circles__deepseek-deepseek-v4-pro-7.5.2026circlesDeepSeek Deepseek Pro v47.57
2026-07-05circles__google-gemini-3-flash-preview-7.5.2026circlesGoogle Gemini Flash 3 (preview)7.47
2026-07-05circles__moonshotai-kimi-k2.6-7.5.2026circlesMoonshot AI Kimi k2.67.03
2026-07-05circles__xiaomi-mimo-v2.5-pro-7.5.2026circlesXiaomi Mimo Pro v2.57.52
2026-07-04circles__deepseek-deepseek-v4-flash-7.3.2026circlesDeepSeek Deepseek Flash v47.51
2026-07-04circles__deepseek-deepseek-v4-flash-7.4.2026circlesDeepSeek Deepseek Flash v47.00
2026-07-03circles__anthropic-claude-sonnet-4.6-7.3.2026circlesAnthropic Claude Sonnet 4.66.17
2026-07-03circles__google-gemini-3.1-pro-preview-7.3.2026circlesGoogle Gemini Pro 3.1 (preview)6.40
2026-07-03circles__deepseek-deepseek-v4-pro-7.3.2026circlesDeepSeek Deepseek Pro v47.04
2026-07-03circles__z-ai-glm-5.2-7.3.2026circlesZ.ai Glm 5.26.65
2026-06-29solarSystem__xiaomi-mimo-v2.5-pro-6.29.2026solarSystemXiaomi Mimo Pro v2.56.95
2026-06-28circles__anthropic-claude-sonnet-4.6-6.28.2026circlesAnthropic Claude Sonnet 4.66.00
2026-06-28circles__google-gemini-3.1-pro-preview-6.28.2026circlesGoogle Gemini Pro 3.1 (preview)6.80
2026-06-28solarSystem__google-gemini-3-flash-preview-6.27.2026solarSystemGoogle Gemini Flash 3 (preview)6.55
2026-06-28circles__z-ai-glm-5.2-6.27.2026circlesZ.ai Glm 5.26.96
2026-06-28circles__xiaomi-mimo-v2.5-pro-6.28.2026circlesXiaomi Mimo Pro v2.58.09
2026-06-27circles__deepseek-deepseek-v4-pro-6.27.2026circlesDeepSeek Deepseek Pro v47.58
2026-06-27circles__moonshotai-kimi-k2.6-6.27.2026circlesMoonshot AI Kimi k2.67.03
2026-06-27solarSystem__deepseek-deepseek-v4-flash-6.27.2026solarSystemDeepSeek Deepseek Flash v47.49
2026-06-26circles__google-gemini-3-flash-preview-6.26.2026circlesGoogle Gemini Flash 3 (preview)7.16
2026-06-26the2048__deepseek-deepseek-v4-flash-6.26.2026the2048DeepSeek Deepseek Flash v47.55

Every run on Favur Evals is scored by the same deterministic engine, on the same Statements of Work. The benchmark is self-funded — no vendor sponsorship, credits, or grants.