Stable Diffusion makes videos now?
(twitter.com)
You're viewing a single comment thread. View all comments, or full comment thread.
Comments (14)
sorted by:
I think Stable Diffusion is just the name for the algorithm that makes the output incrementally more like the inputs - it can apply to any inputs or outputs.
Normally people run a prompt on a random noise image and it 'hallucinates' the final image from it like watching old style tv noise, but it's way cooler if you start with an actual image then it'll re-imagine it as something similar. Like I took a little 2d clipart and it changed the style into photorealistic with the same shape. Pretty sure what this guy did was start with his video zooming in on a donut and make it generate a new image for each frame, one by one.
Unfortunately the dist I found that lets you start with an image only had nvidia support so each small image took 10 minutes so I deleted it... but it was really awesome.
Yeah there's a shit-ton of these videos linked on reddit and 4chan, where they use prompts and the previous image as input for the next frame. At the very least I expect the tools to be heavily used for surreal pseudo-futuristic advertising campaigns, perhaps at the next Super Bowl even.