GSM8K#13 of 28
exact_match
View run →80.0%±1.1%
Benchmark results loaded.
zai-org/GLM-4.5-Air-FP8
- Weights
- 112.6 GB · safetensors
- Source
- huggingface page
- Commit
- f9a9c5a
Evaluated across 13 benchmarks. Ranks in the top 3 on 0 of 13. Strongest showing on GSM8K (80.0% exact_match, #13 of 28). Weakest scores tied at 0.0% on BBH, MBPP, and MBPP(Instruct).
Benchmark results
| Benchmark | Metric | Score | Rank | Actions |
|---|---|---|---|---|
| GSM8K | exact_match | 80.0%±1.1% | #13 of 28 | View run → |
| EQ-Bench | eqbench | 77.9±1.9 | #13 of 28 | View run → |
| IFEval | prompt_level_strict_acc | 76.7%±1.8% | #19 of 28 | View run → |
| MGSM | exact_match | 60.8%±0.8% | #17 of 28 | View run → |
| MMLU | acc | 57.5%±0.4% | #19 of 28 | View run → |
| MMLU-Pro | exact_match | 56.8%±0.4% | #18 of 28 | View run → |
| GPQA Extended | acc | 26.7%±1.9% | #18 of 28 | View run → |
| GPQA Main | acc | 25.7%±2.1% | #22 of 28 | View run → |
| GPQA Diamond | acc | 24.2%±3.1% | #28 of 28 | View run → |
| LongBench | aggregate | 8.3%±0.1% | #15 of 17 | View run → |
| BBH | exact_match | 0.0%±0.0% | #27 of 28 | View run → |
| MBPP | pass@1 | 0.0%±0.0% | #26 of 28 | View run → |
| MBPP(Instruct) | pass@1 | 0.0%±0.0% | #12 of 24 | View run → |
- EQ-Bench#13 of 28eqbenchView run →77.9±1.9
- IFEval#19 of 28prompt_level_strict_accView run →76.7%±1.8%
- MGSM#17 of 28exact_matchView run →60.8%±0.8%
- MMLU#19 of 28accView run →57.5%±0.4%
- MMLU-Pro#18 of 28exact_matchView run →56.8%±0.4%
- GPQA Extended#18 of 28accView run →26.7%±1.9%
- GPQA Main#22 of 28accView run →25.7%±2.1%
- GPQA Diamond#28 of 28accView run →24.2%±3.1%
- LongBench#15 of 17aggregateView run →8.3%±0.1%
- BBH#27 of 28exact_matchView run →0.0%±0.0%
- MBPP#26 of 28pass@1View run →0.0%±0.0%
- MBPP(Instruct)#12 of 24pass@1View run →0.0%±0.0%
last evaluated:7 months ago
How to cite
Citation
FrozeBench. "zai-org/GLM-4.5-Air-FP8." https://frozebench.com/models/zai-org-glm-4-5-air-fp8. Retrieved 2026-06-04.
BibTeX
@misc{frozebench_zai_org_GLM_4_5_Air_FP8,
title = {zai-org/GLM-4.5-Air-FP8},
howpublished = {\url{https://frozebench.com/models/zai-org-glm-4-5-air-fp8}},
year = {2026},
note = {FrozeBench. Retrieved 2026-06-04.}
}URL
https://frozebench.com/models/zai-org-glm-4-5-air-fp8