Head to head
vs ST For light moderate heavy
Verdict · measured basis
Gemma 4 31B costs $0.0001 per solved task against
Step 3.5 Flash at $0.0031 — ▼ 37x cheaper .
Over 200 tasks that is $0.60 a month.
On output token price alone Step 3.5 Flash looks 1.1x cheaper. The ranking reverses once you divide by pass rate — the cheaper tokens do not win the task.
Copy link Save scenario Export compare table Planned
Verified pricing, pass rate and cost per solved task for Gemma 4 31B and Step 3.5 Flash Figure Gemma 4 31B Step 3.5 Flash Input $/Mtok $0.09 $0.1 Output $/Mtok $0.34 $0.3 Cached input $/Mtok $0.05 $0.1 Pass rate 83% 50% Cost per solved task $0.0001 measured $0.0031 measured Cost per month $0.02 $0.62
Cost per month against tasks per month · drag the marker
Monthly cost against tasks per month Log-log lines for Gemma 4 31B (measured, $0.0001 per solved task), Step 3.5 Flash (measured, $0.0031 per solved task) from 10 to 100,000 tasks a month. Marker at 200 tasks. 10 100 1k 10k 100k $0.001 $0.01 $0.1 $1 $10 $100 TASKS / MONTH (log) → 200 tasks Gemma 4 31B · MEASURED · $0.0001 per solved task $0.02 Gemma 4 31B MEASURED Step 3.5 Flash · MEASURED · $0.0031 per solved task $0.62 Step 3.5 Flash MEASURED Monthly cost against tasks per month Log-log lines for Gemma 4 31B (measured, $0.0001 per solved task), Step 3.5 Flash (measured, $0.0031 per solved task) from 10 to 100,000 tasks a month. Marker at 200 tasks. 10 100 1k 10k 100k $0.001 $0.01 $0.1 $1 $10 $100 TASKS / MONTH (log) → 200 tasks Gemma 4 31B · MEASURED · $0.0001 per solved task $0.02 Step 3.5 Flash · MEASURED · $0.0031 per solved task $0.62 — Gemma 4 31B · MEASURED — Step 3.5 Flash · MEASURED Solid measured · dashed modeled · dotted stale. The gap is the verdict.
Solvency Bench (solvency.dev) — first-party measurement · verified 2026-08-26 · prices from each provider's pricing page; measured rows ignore the tier · Methodology · All models at these settings