AI-reports @Razumasu on X

Side by side

Compare models

Pick two or three models. Every figure comes from the test reports; nothing is recalculated here.

MeasureQwenHy4 FlashHy4 full
Build and settings
MakerAlibabaTencentTencent
BuildUnsloth UD-Q4_K_XL GGUF, revision f5d175dAngelSlim SPARK-4Bit-Fast GGUFAngelSlim IQ2 GGUF, about 3.5 bits per weight, revision c65d2c9
File size104 GB149 GB310 GB
MachineNVIDIA DGX Spark, 128 GBNVIDIA DGX Spark, 128 GBMac Studio M3 Ultra, 512 GB
Runtimellama.cpp 2cbca38 with the Hy4 Spark patchllama.cpp 2cbca38 with the Hy4 Spark patchllama.cpp PR #32517 at f8d4cc4, Metal
Samplingtemperature 1.0, top-p 0.95, top-k 20 (maker thinking-mode settings)temperature 0.9, top-p 1.0 (maker settings)temperature 0.9, top-p 1.0 (maker settings)
Thinkingon (default)on (default)on (default)
Speed
Writing speed, short prompt27.7 tok/s25.0 tok/s12.2 tok/s
Writing speed after a 32K prompt25.9 tok/s23.6 tok/s10.9 tok/s
Writing speed after a 127K prompt23.9 tok/s21.7 tok/s10.0 tok/s
Reading speed, 32K prompt970 tok/s675 tok/s79 tok/s
Reading speed, 127K prompt933 tok/s580 tok/s75 tok/s
Wait for first token, 32K prompt33 s47 s404 s
Wait for first token, 127K prompt136 s (2.3 min)219 s (3.6 min)1,680 s (28 min)
Load time97 s (1.6 min)160 s (2.7 min)13 s (warm)
Load time, coldno figureno figure123 s (2.0 min)
Least memory left free7 GiB26 GiB139 GiB
Time for all 27 attempts7.6 hours5.1 hours17.5 hours
Tokens generated, all attempts731,765 tokens447,477 tokens714,824 tokens
Test 01: Qwen3.8 Flash Next vs Hy4 Flash
Pelican on a bicycleThe drawingsA pelican riding a bicycle, drawn by Qwen3.8 Flash Next, attempt 1A pelican riding a bicycle, drawn by Qwen3.8 Flash Next, attempt 2A pelican riding a bicycle, drawn by Qwen3.8 Flash Next, attempt 3A pelican riding a bicycle, drawn by Hy4 Flash, attempt 1A pelican riding a bicycle, drawn by Hy4 Flash, attempt 2A pelican riding a bicycle, drawn by Hy4 Flash, attempt 3A pelican riding a bicycle, drawn by Hy4 (full), attempt 1A pelican riding a bicycle, drawn by Hy4 (full), attempt 2A pelican riding a bicycle, drawn by Hy4 (full), attempt 3
Octopus and penguin bandThe drawingsAn octopus conducting a brass band of penguins, drawn by Qwen3.8 Flash Next, attempt 1An octopus conducting a brass band of penguins, drawn by Qwen3.8 Flash Next, attempt 2An octopus conducting a brass band of penguins, drawn by Qwen3.8 Flash Next, attempt 3An octopus conducting a brass band of penguins, drawn by Hy4 Flash, attempt 1An octopus conducting a brass band of penguins, drawn by Hy4 Flash, attempt 2An octopus conducting a brass band of penguins, drawn by Hy4 Flash, attempt 3An octopus conducting a brass band of penguins, drawn by Hy4 (full), attempt 1An octopus conducting a brass band of penguins, drawn by Hy4 (full), attempt 2An octopus conducting a brass band of penguins, drawn by Hy4 (full), attempt 3
Pelican on a bicycleValid drawings, of 3 attemptsOpinion333
Octopus and penguin bandValid drawings, of 3 attemptsOpinion333
Playable browser gameComplete gamesAutomatic load test; the rest is opinion2 of 3 (1 cut off at the answer limit)3 of 32 of 3 (1 cut off at the answer limit)
RoastMy ranking (opinion)OpinionPlace 3 of 3Place 2 of 3Place 1 of 3
Text adventureComplete gamesRules check plus opinion3 of 33 of 3 (2 without an ending)0 of 3: empty answer on turn 2, probably a runtime fault, unconfirmed
Bug fixBugs fixed of 3, per attemptHidden tests, automatic3, 3, 33, 3, 33, 3, 3
Bug fixMinutes per attempt26 to 336 to 9over 60
Contract questionsScore of 5, per attemptAnswer key4, 5, 54, 5, 55, 5, 5
Contract questionsSlipAttempt 1 read the wrong row of the service credit table: DKK 248 where the answer is DKK 496.Attempt 1 found the 120-day special term but missed the leap day and gave 31 October 2027.None
12 steps with a contradictionFlagged the contradictionAnswer key1 of 32 of 3, plus one partial2 of 3
12 steps with a contradictionArithmetic right3 of 33 of 33 of 3
Network designWords per planOpinionabout 5,0001,600 to 2,3003,200 to 3,800
Network designAccess points proposed4 to 124 to 66 to 11