Not a fan really. There are certainly uses for AI, but this is lacking something. Personally I think it works best as a filter or applying a style or effect that is difficult otherwise, or generating fancy ambient or abstract textures etc.
People constantly think the music video I created for Zingara's Unlock Your Keys [1] is AI, but it really is just real footage all around, except for a handful of lines / pulse textures that were created in TouchDesigner.
I am really excited for the possibilities that AI can give us in the future but often I find trying to use it generatively I run into the paradox of choice and end up paralyzed!
1: https://xfeeefeee.net/unlock-your-keys/ tribal dance fusion music video, sfw but does show some skin. Uses lots of slow motion ink in water footage for texture as well.
It's a strange experiment. Claude and GPT aren't generating the video. They're directing and editing it, and they request video from a generative video model using mainly text-to-video. Neither Claude nor GPT can actually watch video content, and the video model generates shoddy quality clips with artifacts, lack of consistency, and where actions aren't synced to the music.
It would be very hard for anyone to make a good music video with the tools Fable and Sol had available to them. They don't have precise control over the clips that get generated, and they can't see or hear the result, other than screenshots. So I'm not sure what the experimenters expected.
Agree. It's pretty clear the purpose was not to take even a small step in the direction of musicality for llms or video models. More of a typical "agentic engineering setup" blog geared to a different type of professional