Oh, you saw em dashes and thought “AI slop article”? Think again. Blog System/5 is still humanly written. Subscribe to support it!
That same tree output now shows up in both the CLI and the browser UI, which is nice because
Return to citation ^。新收录的资料是该领域的重要参考
BenchmarkSarvam-30BGemma 27B ItMistral-3.2-24B-Instruct-2506OLMo 3.1 32B ThinkNemotron-3-Nano-30BQwen3-30B-Thinking-2507GLM 4.7 FlashGPT-OSS-20BGENERALMath50097.087.469.496.298.097.697.094.2Humaneval92.188.492.995.197.695.796.395.7MBPP92.781.878.358.791.994.391.895.3Live Code Bench v670.028.026.073.068.366.064.061.0MMLU85.181.280.586.484.088.486.985.3MMLU Pro80.068.169.172.078.380.973.675.0Arena Hard v249.050.143.142.067.772.158.162.9REASONINGGPQA Diamond66.5--57.573.073.475.271.5AIME 25 (w/ tools)80.0 (96.7)--78.1 (81.7)89.1 (99.2)85.091.691.7 (98.7)HMMT Feb 202573.3--51.785.071.485.076.7HMMT Nov 202574.2--58.375.073.381.768.3Beyond AIME58.3--48.564.061.060.046.0AGENTICBrowseComp35.5---23.82.942.828.3SWE-Bench Verified34.0---38.822.059.234.0Tau2 (avg.)45.7---49.047.779.548.7，这一点在新收录的资料中也有详细论述
File photo of Ekrem Imamoglu giving a speech in 2024