GSM8K#1 of 28
exact_match
View run →97.0%±0.5%
Benchmark results loaded.
google/Gemma-4-31B-IT-NVFP4
- Weights
- 32.7 GB · safetensors
- Source
- huggingface page
- Commit
- e5ef03a
Evaluated across 13 benchmarks. Ranks in the top 3 on 9 of 13. Strongest showing on GSM8K (97.0% exact_match, #1 of 28). Weakest on MBPP(Instruct) (0.0% pass@1, #13 of 24).
Benchmark results
| Benchmark | Metric | Score | Rank | Actions |
|---|---|---|---|---|
| GSM8K | exact_match | 97.0%±0.5% | #1 of 28 | View run → |
| IFEval | prompt_level_strict_acc | 90.8%±1.2% | #2 of 28 | View run → |
| EQ-Bench | eqbench | 86.2±1.2 | #1 of 28 | View run → |
| MMLU-Pro | exact_match | 84.3%±0.3% | #2 of 28 | View run → |
| MMLU | acc | 82.1%±0.3% | #4 of 28 | View run → |
| BBH | exact_match | 79.7%±0.4% | #1 of 28 | View run → |
| MGSM | exact_match | 76.6%±0.7% | #4 of 28 | View run → |
| GPQA Diamond | acc | 52.5%±3.6% | #1 of 28 | View run → |
| GPQA Main | acc | 50.7%±2.4% | #1 of 28 | View run → |
| GPQA Extended | acc | 49.3%±2.1% | #2 of 28 | View run → |
| LongBench | score | 42.5%±0.5% | #2 of 10 | View run → |
| MBPP | pass@1 | 7.2%±1.2% | #19 of 28 | View run → |
| MBPP(Instruct) | pass@1 | 0.0%±0.0% | #13 of 24 | View run → |
- IFEval#2 of 28prompt_level_strict_accView run →90.8%±1.2%
- EQ-Bench#1 of 28eqbenchView run →86.2±1.2
- MMLU-Pro#2 of 28exact_matchView run →84.3%±0.3%
- MMLU#4 of 28accView run →82.1%±0.3%
- BBH#1 of 28exact_matchView run →79.7%±0.4%
- MGSM#4 of 28exact_matchView run →76.6%±0.7%
- GPQA Diamond#1 of 28accView run →52.5%±3.6%
- GPQA Main#1 of 28accView run →50.7%±2.4%
- GPQA Extended#2 of 28accView run →49.3%±2.1%
- LongBench#2 of 10scoreView run →42.5%±0.5%
- MBPP#19 of 28pass@1View run →7.2%±1.2%
- MBPP(Instruct)#13 of 24pass@1View run →0.0%±0.0%
last evaluated:3 weeks ago
How to cite
Citation
FrozeBench. "google/Gemma-4-31B-IT-NVFP4." https://frozebench.com/models/google-gemma-4-31b-it-nvfp4. Retrieved 2026-06-04.
BibTeX
@misc{frozebench_google_Gemma_4_31B_IT_NVFP4,
title = {google/Gemma-4-31B-IT-NVFP4},
howpublished = {\url{https://frozebench.com/models/google-gemma-4-31b-it-nvfp4}},
year = {2026},
note = {FrozeBench. Retrieved 2026-06-04.}
}URL
https://frozebench.com/models/google-gemma-4-31b-it-nvfp4