Meta's Movie Gen Points Towards a Future of Advanced AI Video Clips
Meta recently introduced its AI model, Movie Gen, exclusively designed to create highly-realistic video and audio clips. This move comes in the wake of their earlier Meta Connect event, where they revealed a series of new hardware and their updated version of their large language model, titled Llama 3.2.
Moving Beyond Simple Text-to-Video Transformations
Movie Gen presents an advanced level of video generation and editing. Rather than simply creating direct text-to-video clips, it forms targeted adjustments to existing footage. This can range from inserting a new object into a scene to altering the look of a surface. For instance, in one of its demonstration videos, a woman with a VR headset on was made to appear as if she was donning a pair of steampunk goggles.
Above: An AI-generated video example showcasing the creation of a DJ from a given prompt.
Creating Harmony with Visual and Auditory Experiences
Alongside creating visual content, Movie Gen is also capable of producing corresponding audio for its clips. For example, a roaring engine or screeching tires of a sports car can be heard as it speeds around a track, or the suspenseful sound of horns playing as a snake slithers across a jungle floor.
Details on Movie Gen
According to a research paper Meta unveiled, Movie Gen Video consists of 30 billion parameters, and Movie Gen Audio is of 13 billion parameters. When it comes to the generation of high-definition videos, Movie Gen can produce up to 16 seconds long clips, boasting higher video quality compared to other models.
Unlocking Potential with Movie Gen
Earlier this year, CEO Mark Zuckerberg touted the capabilities of Meta AI's 'Imagine Me' feature, which allows users to superimpose their facial image into different simulated scenarios. With the advent of Movie Gen, users could potentially have a more advanced application, taking 'ElfYourself' to the next level.
The Basis for Movie Gen's Training
While the details are vague, Meta mentions that the training datasets for Movie Gen combine licensed and publicly accessible data sets. The contentious issue surrounding the use and source of training data remains a point of contention for generative AI tools.
Movie Gen's Availability in the Future
While Meta has not yet announced a specific launch date for Movie Gen, it does hint on a potential future release. Meta’s future as a social media company could mean that tools powered by Movie Gen may be integrated into Facebook, Instagram, or WhatsApp someday.
Increasing Trend Towards AI Video Tools
While large tech firms are still holding off on making video models fully available to the public, tools such as AI video editors are emerging from up-and-coming startups like Runway and Pika. These tools offer users the opportunity to digitally manipulate video footage in intriguing and entertaining ways.