This is an interesting curiosity but I think full generation is a short term dead end. Might be possible with future techniques but it's not there yet.
What is a possibility with current tech is advanced tweening. There are models now where you can provide a start and end frame and get 5 seconds of animation that hit your targets (sort of). The models aren't specifically trained on this task so it's not perfect but the potential is there. A model that is specifically trained on tweening and following motion guides could be amazing.
In the future an artist will be able to draw one or two frames for every shot and a computer will tween the rest instead of a sweatshop. Making a feature length cartoon will be about as difficult as a graphic novel, easily achieved by a small team or even one person. You can sort of do this now with Wan2.1, but it's going to hit mainstream commercial use in just a few more iterations.
This is an interesting curiosity but I think full generation is a short term dead end. Might be possible with future techniques but it's not there yet.
What is a possibility with current tech is advanced tweening. There are models now where you can provide a start and end frame and get 5 seconds of animation that hit your targets (sort of). The models aren't specifically trained on this task so it's not perfect but the potential is there. A model that is specifically trained on tweening and following motion guides could be amazing.
In the future an artist will be able to draw one or two frames for every shot and a computer will tween the rest instead of a sweatshop. Making a feature length cartoon will be about as difficult as a graphic novel, easily achieved by a small team or even one person. You can sort of do this now with Wan2.1, but it's going to hit mainstream commercial use in just a few more iterations.