It's a strange experiment. Claude and GPT aren't generating the video. They're directing and editing it, and they request video from a generative video model using mainly text-to-video. Neither Claude nor GPT can actually watch video content, and the video model generates shoddy quality clips with artifacts, lack of consistency, and where actions aren't synced to the music.

It would be very hard for anyone to make a good music video with the tools Fable and Sol had available to them. They don't have precise control over the clips that get generated, and they can't see or hear the result, other than screenshots. So I'm not sure what the experimenters expected.