MBPP#1 of 28
pass@1
View run →94.0%±1.1%
Benchmark results loaded.
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4
- Weights
- 80.4 GB · safetensors
- Source
- huggingface page
- Commit
- 4f0cf9d
Evaluated across 13 benchmarks. Ranks in the top 3 on 2 of 13. Strongest showing on MBPP (94.0% pass@1, #1 of 28). Weakest on MBPP(Instruct) (0.0% pass@1, #20 of 24).
Benchmark results
| Benchmark | Metric | Score | Rank | Actions |
|---|---|---|---|---|
| MBPP | pass@1 | 94.0%±1.1% | #1 of 28 | View run → |
| IFEval | prompt_level_strict_acc | 88.4%±1.4% | #6 of 28 | View run → |
| GSM8K | exact_match | 86.1%±1.0% | #9 of 28 | View run → |
| MMLU-Pro | exact_match | 80.5%±0.3% | #5 of 28 | View run → |
| MGSM | exact_match | 79.4%±0.7% | #2 of 28 | View run → |
| EQ-Bench | eqbench | 78.3±1.8 | #12 of 28 | View run → |
| MMLU | acc | 36.2%±0.4% | #25 of 28 | View run → |
| LongBench | score | 35.2%±0.4% | #7 of 10 | View run → |
| GPQA Diamond | acc | 29.8%±3.3% | #11 of 28 | View run → |
| GPQA Main | acc | 29.5%±2.2% | #12 of 28 | View run → |
| GPQA Extended | acc | 26.6%±1.9% | #19 of 28 | View run → |
| BBH | exact_match | 18.1%±0.4% | #16 of 28 | View run → |
| MBPP(Instruct) | pass@1 | 0.0%±0.0% | #20 of 24 | View run → |
- IFEval#6 of 28prompt_level_strict_accView run →88.4%±1.4%
- GSM8K#9 of 28exact_matchView run →86.1%±1.0%
- MMLU-Pro#5 of 28exact_matchView run →80.5%±0.3%
- MGSM#2 of 28exact_matchView run →79.4%±0.7%
- EQ-Bench#12 of 28eqbenchView run →78.3±1.8
- MMLU#25 of 28accView run →36.2%±0.4%
- LongBench#7 of 10scoreView run →35.2%±0.4%
- GPQA Diamond#11 of 28accView run →29.8%±3.3%
- GPQA Main#12 of 28accView run →29.5%±2.2%
- GPQA Extended#19 of 28accView run →26.6%±1.9%
- BBH#16 of 28exact_matchView run →18.1%±0.4%
- MBPP(Instruct)#20 of 24pass@1View run →0.0%±0.0%
last evaluated:2 weeks ago
How to cite
Citation
FrozeBench. "nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4." https://frozebench.com/models/nvidia-nvidia-nemotron-3-super-120b-a12b-nvfp4. Retrieved 2026-06-04.
BibTeX
@misc{frozebench_nvidia_NVIDIA_Nemotron_3_Super_120B_A12B_NVFP4,
title = {nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4},
howpublished = {\url{https://frozebench.com/models/nvidia-nvidia-nemotron-3-super-120b-a12b-nvfp4}},
year = {2026},
note = {FrozeBench. Retrieved 2026-06-04.}
}URL
https://frozebench.com/models/nvidia-nvidia-nemotron-3-super-120b-a12b-nvfp4