Meta's Movie Gen Points Towards a Future of Advanced AI Video Clips

Meta recently introduced its AI model, Movie Gen, exclusively designed to create highly-realistic video and audio clips. This move comes in the wake of their earlier Meta Connect event, where they revealed a series of new hardware and their updated version of their large language model, titled Llama 3.2.

Moving Beyond Simple Text-to-Video Transformations

Movie Gen presents an advanced level of video generation and editing. Rather than simply creating direct text-to-video clips, it forms targeted adjustments to existing footage. This can range from inserting a new object into a scene to altering the look of a surface. For instance, in one of its demonstration videos, a woman with a VR headset on was made to appear as if she was donning a pair of steampunk goggles.

Above: An AI-generated video example showcasing the creation of a DJ from a given prompt.

Creating Harmony with Visual and Auditory Experiences

Alongside creating visual content, Movie Gen is also capable of producing corresponding audio for its clips. For example, a roaring engine or screeching tires of a sports car can be heard as it speeds around a track, or the suspenseful sound of horns playing as a snake slithers across a jungle floor.

Details on Movie Gen

According to a research paper Meta unveiled, Movie Gen Video consists of 30 billion parameters, and Movie Gen Audio is of 13 billion parameters. When it comes to the generation of high-definition videos, Movie Gen can produce up to 16 seconds long clips, boasting higher video quality compared to other models.

Unlocking Potential with Movie Gen

Earlier this year, CEO Mark Zuckerberg touted the capabilities of Meta AI's 'Imagine Me' feature, which allows users to superimpose their facial image into different simulated scenarios. With the advent of Movie Gen, users could potentially have a more advanced application, taking 'ElfYourself' to the next level.

The Basis for Movie Gen's Training

While the details are vague, Meta mentions that the training datasets for Movie Gen combine licensed and publicly accessible data sets. The contentious issue surrounding the use and source of training data remains a point of contention for generative AI tools.

Movie Gen's Availability in the Future

While Meta has not yet announced a specific launch date for Movie Gen, it does hint on a potential future release. Meta’s future as a social media company could mean that tools powered by Movie Gen may be integrated into Facebook, Instagram, or WhatsApp someday.

Increasing Trend Towards AI Video Tools

While large tech firms are still holding off on making video models fully available to the public, tools such as AI video editors are emerging from up-and-coming startups like Runway and Pika. These tools offer users the opportunity to digitally manipulate video footage in intriguing and entertaining ways.

Great! Next, complete checkout for full access to Phluxr.
Welcome back! You've successfully signed in.
You've successfully subscribed to Phluxr.
Success! Your account is fully activated, you now have access to all content.
Success! Your billing info has been updated.
Your billing was not updated.