STILL CAN'T DO IT

Things that are easy for people and still hard for AI. Each one has a dated source, or comes from our own test, where all five models in the blind test get the same prompt, again whenever a model is updated and at least once a month. When AI gets the hang of one, it moves to "Solved since".

Prediction market: Manifold traders give a 63% chance that, at the end of 2026, there will still be a simple text task most people can solve but top AI can't (37 traders, play money). What traders believe, not a test result. Market · as of Sun 22 Nov

SOLVED SINCE…

Nothing has come off the wall yet.