house
2024-10-25 12:37:42 Source: Qubits
Marvel plans to turn more superhero IPs into AI
“Venom” AI short film creative team
Qubits | Public account QbitAI
Domestic AI video model joins hands with top international IP!
The ink-style promotional video for Marvel’s “Venom 3“, which recently topped the box office in a single day, was actually made with AI. This is the official release from Sony Pictures below.
For 30 seconds, there was an ink version of the Venom celebrity show——
Sometimes it transforms into a fish, sometimes it turns into a venomous horse galloping on the shore; sometimes it flies over the eaves and walls, and transforms into a flying crane with spread wings, overlooking the city from the highest point of the ancient building.
There was also Venom’s signature evil smile on his face.
Director Yang Sheng(Creator of the movie “囧” and the game “I’m Surrounded by Beautiful Women”) andKaren(Participated in the production of the movie “The Evil One” and the game “Star Rail”) said:
This promotional video is completely generated based on domestic AI video tools.
The overall production time efficiency has been improved by at least 3 times, saving nearly 90% of post-production investment.
Behind it is Shengshu Technology, an AI video startup company from Tsinghua University, which uses its Vidu.
Qubits specificallyContact the creative team to share the behind-the-scenes production process. Friends who are interested in AI videos can refer to the top practices in the industry.
Director Yang Sheng revealed that the entire short film was based on the Vidu platform, mainly using Vidu’stusheng videoandFirst and last frame controlfunction, of which the latter accounts for a higher proportion of use.
The whole process is as follows:
The main creative team first hand-painted storyboards in the early stage to draw the first and last frames to be fed to Vidu.
Then sit back and wait for Vidu to automatically understand and supplement the video content in the process while maintaining the theme, style, and temporal and spatial coherence of the changing scenes.
Take the example of “ink spreads and evolves into venom”.
Here is the first frame in an ink painting style:
This is a final frame in the style of an ink painting:
The scene in the middle that is “brain-filled” by AI can be either one shot to the end or a montage operation of camera switching.
Director Yang Sheng said:
This short film is not long, but it involves a lot of lens changes. Even for traditional special effects companies, it requires professional manpower and a lot of effort to complete.
The traditional animation production process requires first going through scripts, storyboards (key frame production), three-dimensional modeling, animation post-production and other links.
Generally speaking, it takes Disney 4-5 years to produce an animation.
The team in the middle stage of animation is particularly large, with thousands of people often working together. The process is quite long, and there are many uncontrollable factors in human execution.
The creative team revealed that at that time, Sony issued a prompt to the creative team:
In one month, a creative short film was produced around the theme of “Everything Can Be Venomous”.
The short film promotes “Venom: The Last Dance” as the final chapter of the “Venom Trilogy”. Previously, Venom’s IP image has left a deep impression on the audience.
Therefore, the production of promotional short films has extremely high requirements for the stability and consistency of the image.
Initially, the team’s idea was to use real-life photographyfor example, using non-Newtonian fluids to realize the ever-changing characteristics of venom; even considering using a 500ml strong magnet to simulate real venom.
But things went counterproductive, and the actual shooting results were completely below expectations. What’s even worse is that the production cycle of this operation was too long.
As a result, the team began to consider trying AI video generation, which is very popular this year.
In order to use AI to produce this short film, the creative team had previously tried many domestic and foreign AI video generation tools, “but problems such as inconsistent styles of front and rear shots and high crash rates often occurred.”
Yang Sheng explained that on the one hand, he chose Vidu because of its aesthetic uniqueness and consistency in the ink style; on the other hand, the video generated by Vidu does not have a sense of fragmentation due to lens transitions, and the content of the picture also conforms to the requirements of ink rendering. Characteristics and physical laws of water flow.
Basically, it can be used right out of the box.
After Vidu was added to the workflow, the original animation production process was simplified.
The creative team provides the key frame original paintings, directly uses AI to generate video materials, and then edits, packages, and dubbs the film to complete the film.
It is worth mentioning that it only took AI 2 days to generate all the materials, which in the past accounted for 80%-90% of the workload.
Moreover, the creative team stated that AI video generation breaks through the limitations of funds and time. Creators no longer need to compromise on content quality within a limited range of choices. After all, it only takes half a day for AI to generate nearly 2,000 video materials, which is fully supported. Creators make content selections.
Therefore, the production of the short film went smoothly——
Under the traditional process, a 30-second animated short film takes 1-2 months to produce; based on Vidu, the creative team took 10 days to complete the entire production, which is much earlier than the DDL provided by Sony Pictures.
Obviously, the entire process has been greatly simplified after Vidu’s participation.
Director Karen said,Using AI video, working from 9 to 5 is possible（doge）。
In fact, this is not the first commercialization attempt in the field of AI video.
Sora, the most powerful futures company in 2024, OpenAI, has already cooperated with Toys R Us in the AI commercial film “The Origin of Toys R Us” in June this year.
However, OpenAI has not released specific details on the behind-the-scenes production aspects such as the proportion of post-production packaging and special effects production, as well as the actual role of AI in the creation process.
It is understood that in the future, Marvel plans to present more superhero IPs to the public through AI.
Even personal IP enthusiasts can use Vidu to create Marvel’s second creation——
Who says Spider-Man can’t also become AI?
All rights reserved. Any reproduction or use in any form without authorization is prohibited. Violators will be prosecuted.
