Meta introduces new AI model ‘Movie Gen’ that can create realistic videos with sound

0

Movie Zen can create video clips of up to 16 seconds and audio clips of up to 45 seconds, generating both visual and sound effects that sync seamlessly with the content.

670135792b8be-meta-movie-gen-054751969-16x9

Meta Movie Gen

WhatsApp Channel Join Now
Telegram Group Join Now
Instagram Join Now

Meta has introduced Movie Zen, a cutting-edge AI model designed to generate highly realistic video and audio clips in response to user prompts. The tool, which Meta claims rivals industry leaders such as OpenAI and ElevenLabs, represents a significant evolution in AI-generated media.

According to Meta, Movie Zen can create video clips of up to 16 seconds and audio clips of up to 45 seconds, generating both visual and sound effects that sync seamlessly with the content. In a blog post, the company showed examples of the tool’s capabilities, including videos of animals swimming and people performing creative tasks such as painting on canvas. In one demonstration, the AI ​​even added pom-poms to the hands of a man running in the desert, while another transformed a dry parking lot into a puddle-filled scene with a skateboarder.

Movie Gen is not limited to just creating new content; it can also be used to edit existing videos, expanding the creative possibilities for content creators. The AI ​​tool also generates background music and sound effects, further improving the production quality of clips.

Meta highlighted data from blind tests that show Movie Gen outperforms offerings from competitors like Runway, OpenAI, ElevenLabs, and Kling. However, unlike its Llama big-language model, Meta has no plans to release Movie Gen for open developer use, citing the need to evaluate risks for each model individually.

Instead, Meta plans to collaborate directly with the entertainment industry and content creators, incorporating the tool into its products sometime next year. Meta said the model was built using a mix of licensed and publicly available datasets.

The announcement comes at a time when generative AI video technology is sparking both excitement and concern in Hollywood. Filmmakers are eager to explore how tools like Movie Gen can streamline production and bring innovative ideas to life. However, many are wary of AI systems trained on potentially copyrighted works, raising ethical and legal questions. Similar controversies have already surrounded OpenAI’s Sora model, especially after actress Scarlett Johansson’s allegations that her voice was copied without permission.

While OpenAI has been in talks with Hollywood studios about potential partnerships, no deals have been finalized yet. Meanwhile, Lions Gate Entertainment, known for “The Hunger Games” and “Twilight,” has already partnered with AI startup Runway, offering access to its film library in exchange for the ability to use the trained model in future productions.

Beyond its applications in entertainment, AI-generated fakes, or deepfakes, have raised concerns globally, particularly over their use in political campaigns. Lawmakers in countries such as the US, India, Pakistan, and Indonesia have expressed concern over how AI could influence elections through the creation of misleading content.

Meta did not provide specific details about how it plans to address such concerns with Movie Gen, but it did confirm that the use of the tool would be carefully monitored, particularly in entertainment contexts.

Kumud Sharma

https://diarytimes.com/

Continuing the achievement of the journey of effectiveness and credibility of more than 10 years in the career of journalism, as a woman journalist, I am Serving as the founder, promoter and editor of DiaryTimes with the trust and support of all. My credible coverage may not have given a big shape to the numbers, but my journey presents articles that make you aware of the exact and meaningful situations of Himachal’s politics, ground issues related to the public, business, tourism and the difficult geographical conditions of the state and financial awareness. DiaryTimes, full of the experience of my precise editorial expertise, is awakening the flame of credible journalism among all of you, so that the eternal flame of meaningful change can be lit in the life of the people of the state and the atrocities being committed against the people can be brought to the fore, I am motivated for that. If even a small change comes with the power of my journalism and the whole world becomes a witness to that issues, then I will consider myself fortunate.

Leave a Reply

Your email address will not be published. Required fields are marked *

Google News Titles