There's also the "horse riding astronaut" challenge in image generation: https://garymarcus.substack.com/p/horse-rides-astronaut-redu...

Gary Marcus is not the man to be looking to on this topic

Gary Marcus successfully predicted all ten of the one AI Winters.

He also claimed that LLMs were a failure because of prompts that GPT 3.5 couldn't parse, after the launch of GPT-4,which handled them with aplomb.

Gary Marcus successfully wrote an article about getting image generation models to show a horse riding an astronaut, which is all I needed him to do. (Actually he wrote two, but this one felt more concise.) Take it as an existence proof, not an endorsement.

Just like a basilisk, if you never refer to him again, he fades away and doesn't bug people anymore. Let him fight through whatever he needs to if he ever bothers coming up with anything the rest of the world needs to hear; until then, we can enjoy the peace and quiet.

[dead]