Back to blog
Forking paths, more examples
A collection of heuristically selected token ranges that looked like they might contain interesting forking behavior — most of them don't! In some examples you'll see a long mono-color section at the start; this is the initial frozen path, included so you can see the probability of success with that full section held fixed.
MMLU Pro Question 1065MMLU Pro Question 1709MMLU Pro Question 2045MMLU Pro Question 3127MMLU Pro Question 4131MMLU Pro Question 4707MMLU Pro Question 4716MMLU Pro Question 5425MMLU Pro Question 5706MMLU Pro Question 5909MMLU Pro Question 6355MMLU Pro Question 7335MMLU Pro Question 7759MMLU Pro Question 11247