Favur Evals
favur.dev

Agent role · weight 9/100 · rubric v15

📝 Pseudocode

Translates a sprint task into implementable pseudocode plus testing documentation (or an explicit testing boundary).

What it's scored on

Output quality
Quality of the pseudocode/plan it produced and deliverables.
Efficiency
Token volume, output per request, cost, context efficiency, request-error and hallucination rates.

Full scoring definition in the methodology → · Sample transcript

Model leaderboard

Every model ranked by Pseudocode score
#ModelScore / 10CoveragenLast seen
1Moonshot AI Kimi Code k2.76.8455%22026-07-10
2OpenAI Gpt Terra 5.6 †6.5655%12026-07-12
3Google Gemini Flash Lite 3.16.4173%102026-07-19
4OpenAI Gpt Luna 5.6 †6.2455%12026-07-14
5Xiaomi Mimo v2.56.1685%32026-07-22
6Qwen Plus qwen3.75.9088%42026-07-22
7Stepfun Step Flash 3.75.8878%22026-07-19
8Xiaomi Mimo Pro v2.5 †5.8870%52026-07-26
9Google Gemini Pro 3.1 (preview) †5.7551%22026-07-03
10Thinkingmachines Inkling5.66100%22026-07-22
11DeepSeek Deepseek Flash v4 †5.3260%62026-07-22
12Moonshot AI Kimi k2.6 †5.3167%32026-07-17
13Meta Muse Spark 1.15.29100%32026-07-19
14xAI Grok 4.55.1889%42026-07-22
15Google Gemini Flash Lite 3.55.13100%52026-07-23
16Google Gemini Flash 3 (preview) †5.1252%62026-07-10
17Z.ai Glm 5.2 †5.0967%32026-07-17
18DeepSeek Deepseek Pro v4 †5.0652%32026-07-05
19Anthropic Claude Sonnet 54.9278%42026-07-22
20Google Gemini Flash 3.64.87100%22026-07-24
21Google Gemini Flash 3.54.6655%22026-07-08
22Anthropic Claude Sonnet 4.6 †4.3651%22026-07-03

† low confidence — sparse role or low data coverage (renormalized, never zero-filled).

Per-run history (newest first)

Every appearance of the Pseudocode role, newest first
DateRunSoWModelScore / 10
2026-07-26solarSystem__multi-xiaomi-mimo-v2.5-7.26.2026solarSystemXiaomi Mimo Pro v2.55.30
2026-07-24circles__xiaomi-multi-model-2.5-2.5-pro-7.24.2026circlesXiaomi Mimo Pro v2.54.80
2026-07-24circles__google-gemini-3.6-flash-7.23.2026circlesGoogle Gemini Flash 3.64.90
2026-07-23solarSystem/multi-anthropic-sonnet-gemini-3.5-flash-lite-7.22.2026solarSystemGoogle Gemini Flash Lite 3.54.74
2026-07-22circles__thinkingmachines-inkling-7.22.2026circlesThinkingmachines Inkling5.61
2026-07-22circles__x-ai-grok-4.5-7.22.2026circlesxAI Grok 4.55.56
2026-07-22circles__deepseek-deepseek-v4-flash-7.22.2026circlesDeepSeek Deepseek Flash v45.28
2026-07-22circles__anthropic-claude-sonnet-5-7.21.2026circlesAnthropic Claude Sonnet 54.67
2026-07-22the2048__gemini-multi-model-7-22-2026the2048Google Gemini Flash Lite 3.54.99
2026-07-22circles__qwen-qwen3.7-plus-7.22.2026circlesQwen Plus qwen3.75.37
2026-07-22circles__xiaomi-mimo-v2.5-7.22.2026circlesXiaomi Mimo v2.56.06
2026-07-21circles__google-gemini-3.6-flash-7.21.2026circlesGoogle Gemini Flash 3.64.83
2026-07-21solarSystem__google-multi-model-7.21.2026solarSystemGoogle Gemini Flash Lite 3.55.72
2026-07-21circles__x-ai-grok-4.5-7.21.2026circlesGoogle Gemini Flash Lite 3.54.59
2026-07-21circles__google-gemini-3.5-flash-lite-7.21.2026circlesGoogle Gemini Flash Lite 3.55.59
2026-07-19solarSystem__stepfun-step-3.7-flash-7.19.2026solarSystemStepfun Step Flash 3.75.04
2026-07-19circles__x-ai-grok-4.5-7.18.2026circlesxAI Grok 4.55.05
2026-07-19solarSystem__qwen-qwen3.7-plus-7.18.2026solarSystemQwen Plus qwen3.75.03
2026-07-19the2048__meta-muse-spark-1.1-7.19.2026the2048Meta Muse Spark 1.14.66
2026-07-19circles__google-gemini-3.1-flash-lite-7.19.2026circlesGoogle Gemini Flash Lite 3.16.01
2026-07-18circles__thinkingmachines-inkling-7.18.2026circlesThinkingmachines Inkling5.71
2026-07-18solarSystem__xiaomi-mimo-v2.5-7.18.2026solarSystemXiaomi Mimo v2.55.70
2026-07-17circles__z-ai-glm-5.2-7.17.2026circlesZ.ai Glm 5.24.91
2026-07-17circles__moonshotai-kimi-k2.6-7.16.2026circlesMoonshot AI Kimi k2.65.19
2026-07-17circles__x-ai-grok-4.5-7.16.2026circlesxAI Grok 4.55.21
2026-07-17circles__anthropic-claude-sonnet-5-7.16.2026circlesAnthropic Claude Sonnet 54.58
2026-07-17circles__qwen-qwen3.7-plus-7.16.2026circlesQwen Plus qwen3.75.81
2026-07-17solarSystem__meta-muse-spark-1.1-7.17.2026solarSystemMeta Muse Spark 1.15.39
2026-07-17circles__meta-muse-spark-1.1-7.16.2026circlesMeta Muse Spark 1.15.82
2026-07-16circles__google-multi-model-7.18.2026circlesGoogle Gemini Flash Lite 3.16.00
2026-07-16circles__google-multi-model-7.17.2026circlesGoogle Gemini Flash Lite 3.16.74
2026-07-15solarSystem__google-multi-model-7.15.2026solarSystemGoogle Gemini Flash Lite 3.15.03
2026-07-15circles__google-gemini-3.1-flash-lite-7.14.2026circlesGoogle Gemini Flash Lite 3.16.94
2026-07-15circles__google-multi-model-7.16.2026circlesGoogle Gemini Flash Lite 3.16.31
2026-07-15circles__google-multi-model-7.15.2026circlesGoogle Gemini Flash Lite 3.16.54
2026-07-14circles__openai-gpt-5.6-luna-7.14.2026circlesOpenAI Gpt Luna 5.66.24
2026-07-14solarSystem__google-multi-model-7.14.2026solarSystemGoogle Gemini Flash Lite 3.16.43
2026-07-13circles__stepfun-step-3.7-flash-7.13.2026circlesStepfun Step Flash 3.76.71
2026-07-13solarSystem__google-gemini-3.1-flash-lite-7.12.2026solarSystemGoogle Gemini Flash Lite 3.16.83
2026-07-12circles__openai-gpt-5.6-terra-7.11.2026circlesOpenAI Gpt Terra 5.66.56
2026-07-12circles__anthropic-claude-sonnet-5-7.11.2026circlesAnthropic Claude Sonnet 54.99
2026-07-10circles__google-gemini-3-flash-preview-7.9.2026circlesGoogle Gemini Flash 3 (preview)4.88
2026-07-10circles__moonshotai-kimi-k2.7-code-7.9.2026circlesMoonshot AI Kimi Code k2.76.19
2026-07-10circles__x-ai-grok-4.5-7.10.2026circlesxAI Grok 4.54.91
2026-07-10circles__deepseek-deepseek-v4-flash-7.10.2026circlesDeepSeek Deepseek Flash v46.44
2026-07-10circles__xiaomi-mimo-v2.5-pro-7.10.2026circlesXiaomi Mimo v2.56.71
2026-07-09circles__google-gemini-3-flash-preview-7.8.2026circlesGoogle Gemini Flash 3 (preview)5.69
2026-07-09circles__qwen-qwen3.7-plus-7.9.2026circlesQwen Plus qwen3.77.38
2026-07-09circles__google-gemini-3.1-flash-lite-7.9.2026circlesGoogle Gemini Flash Lite 3.17.23
2026-07-08circles__google-gemini-3.5-flash-7.8.2026circlesGoogle Gemini Flash 3.54.92
2026-07-08circles__google-gemini-3-flash-preview-7.7.2026circlesGoogle Gemini Flash 3 (preview)5.44
2026-07-08circles__moonshotai-kimi-k2.7-code-7.8.2026circlesMoonshot AI Kimi Code k2.77.48
2026-07-08circles__anthropic-claude-sonnet-5-7.8.2026circlesAnthropic Claude Sonnet 55.45
2026-07-05circles__google-gemini-3.5-flash-7.5.2026circlesGoogle Gemini Flash 3.54.40
2026-07-05circles__deepseek-deepseek-v4-pro-7.5.2026circlesDeepSeek Deepseek Pro v45.12
2026-07-05circles__google-gemini-3-flash-preview-7.5.2026circlesGoogle Gemini Flash 3 (preview)5.13
2026-07-05circles__moonshotai-kimi-k2.6-7.5.2026circlesMoonshot AI Kimi k2.65.17
2026-07-05circles__xiaomi-mimo-v2.5-pro-7.5.2026circlesXiaomi Mimo Pro v2.56.92
2026-07-04circles__deepseek-deepseek-v4-flash-7.3.2026circlesDeepSeek Deepseek Flash v45.19
2026-07-04circles__deepseek-deepseek-v4-flash-7.4.2026circlesDeepSeek Deepseek Flash v45.94
2026-07-03circles__anthropic-claude-sonnet-4.6-7.3.2026circlesAnthropic Claude Sonnet 4.64.63
2026-07-03circles__google-gemini-3.1-pro-preview-7.3.2026circlesGoogle Gemini Pro 3.1 (preview)5.55
2026-07-03circles__deepseek-deepseek-v4-pro-7.3.2026circlesDeepSeek Deepseek Pro v45.25
2026-07-03circles__z-ai-glm-5.2-7.3.2026circlesZ.ai Glm 5.25.39
2026-06-29solarSystem__xiaomi-mimo-v2.5-pro-6.29.2026solarSystemXiaomi Mimo Pro v2.55.80
2026-06-28circles__anthropic-claude-sonnet-4.6-6.28.2026circlesAnthropic Claude Sonnet 4.64.09
2026-06-28circles__google-gemini-3.1-pro-preview-6.28.2026circlesGoogle Gemini Pro 3.1 (preview)5.96
2026-06-28solarSystem__google-gemini-3-flash-preview-6.27.2026solarSystemGoogle Gemini Flash 3 (preview)3.40
2026-06-28circles__z-ai-glm-5.2-6.27.2026circlesZ.ai Glm 5.24.96
2026-06-28circles__xiaomi-mimo-v2.5-pro-6.28.2026circlesXiaomi Mimo Pro v2.56.60
2026-06-27circles__deepseek-deepseek-v4-pro-6.27.2026circlesDeepSeek Deepseek Pro v44.81
2026-06-27circles__moonshotai-kimi-k2.6-6.27.2026circlesMoonshot AI Kimi k2.65.58
2026-06-27solarSystem__deepseek-deepseek-v4-flash-6.27.2026solarSystemDeepSeek Deepseek Flash v44.60
2026-06-26circles__google-gemini-3-flash-preview-6.26.2026circlesGoogle Gemini Flash 3 (preview)6.17
2026-06-26the2048__deepseek-deepseek-v4-flash-6.26.2026the2048DeepSeek Deepseek Flash v44.49

Every run on Favur Evals is scored by the same deterministic engine, on the same Statements of Work. The benchmark is self-funded — no vendor sponsorship, credits, or grants.