Other languages
Answering math problems asked in a language other than English. The test here asks grade-school math word problems translated into about ten languages. Good means correct answers in each language you need, if that language is one of those tested.
Sources last checked 2026-10-23.
We can't show scores for this kind of work yet. Vals AI publishes results from one test. See who tests it
At a glance
Vendor claims have not been collected for any category yet.
ⓘ More about this category
- Reliability not yet measured
- 1 source, linked results only
- Sources last checked 2026-10-28
- Ring 4: needs rings 1 to 3 first
- MGSM = MGSM
Tested by
MGSM
Vals AI, checked 2026-10-28Grade-school math word problems translated by people into about ten languages, checking whether the model reaches the right whole-number answer in each language.
Vals AI reports that models score noticeably lower on these math problems in languages other than English.
Last updated 2026-01-09Covers 10 of the models we trackScores not shown: permission requested on 2026-10-24
See their resultsMore about this test: MGSM
Reliability not measured by this source.
Technical details for MGSM
Accuracy: Grade-school math word problems translated by people into about ten languages, checking whether the model reaches the right whole-number answer in each language.
License: Score reuse not stated. Checked 2026-10-28.
What this doesn't tell you
- The test scores each language separately. Check the languages you need, not an average.
- Translation itself is not tested here yet.
- Scores from different sources are not comparable, even when they share a unit.
- None of these tests were run on your own documents, code or data.
- No source for this task allows us to show its figures yet. Follow the links for their results.
Data version 2026-10-28+91ac3fc9d071 · Terms of use