A Director with an AI Film Crew

(For the TLDR crowd: ComfyUI, LTX 2.3 are good, Fanxiang SSDs are less good, and Claude can sync lipsync clips to a song and color-grade more easily than a human can. You will however end up sending it a lot of memos to refine its editing.)

From Wizard’s Car Chase to Pride & Planetoids

Just about a year ago, I made my first music video, Wizard’s Car Chase. It started with a Midjourney image of a modern Wizard’s Battle in the style of the Hildebrandt Brothers. Then I generated a bunch of random videos in Midjourney out of curiosity. Then I saw a writer acquaintance doing music videos for one of her worlds (human lyrics, Suno songs, Midjourney footage) and I wanted to try something similar. A few attempts in Suno later, I had a song, and about six-seven hours worth of editing across two days got me a video.

Continue reading “Making the Phantom Queen Trailer with ComfyUI, LTX and Claude” →