Meta, the owner of Facebook, claimed on Friday that it has developed a new AI model named Movie Gen that can generate realistic-looking video and audio snippets in response to user instructions. Meta said the model can compete with solutions from prominent media generation firms such as OpenAI and ElevenLabs.
Meta gave samples of Movie Gen's productions, which included movies of animals swimming and surfing and videos depicting people executing acts like painting on a canvas. Movie Gen is the best video creation tool for performing actions in videos.
How Does Movie Gen Create Video
According to Meta, Movie Gen's audio production model can produce "high-quality and high-fidelity audio" for up to 45 seconds, including classical background music, sound effects, and quiet sound timed to the video content, given a video and additional text signals.
Movie Gen employs text inputs to create new videos and alter old footage or still photos. According to the New York Times, the audio in videos is likewise generated by AI, which matches the visuals with ambient noise, sound effects, and background music. The videos can be created in many aspect ratios.
According to Meta, Movie Gen may generate new clips and build unique videos from photographs or modify an existing video. Movie Gen can also generate background music and sound effects synced to the movie content, according to Meta in a blog post, and it can be used to alter existing videos.
Movie Gen AI in Social Media
Gen AI components contribute to the overall experience of social media platforms. They are indeed fascinating, and as a novelty, they will undoubtedly attract attention. As a technical achievement, what you can now do with these tools is incredible. Still, these experiences do not bridge the gap between technological innovation and practical utility.
Meta's also experimented with AI chatbots in Messenger, which no one cared about, and AI chatbots centered on celebrities, which it cancelled in July. Because no one used them, they're not engaging, and who cares if a chatbot responds in the way of Kendall Jenner when it's not Kendall Jenner.
That is not social, and it does not meet the standards of social apps, but Meta appears to be confident that if consumers give these designed experiences a chance, they will enjoy them.
Meta Claimed Movie Gen Tools in the Film Industry
As stated in the tool's blog post and research paper, Movie Gen was constructed by the company using a combination of licensed and publicly available datasets.
This year, OpenAI has been meeting with representatives and executives from the film industry to explore potential collaborations, including Sora; however, agreements have yet to be reached. Actress Scarlett Johansson's accusation in May that the ChatGPT creator was using her voice for its chatbot without approval heightened concerns about the company's strategy.
The Hunger Games and Twilight producer Lions Gate Entertainment said in September that it would provide AI startup Runway with access to its collection of films and television shows so that the startup could train an AI model. It stated that the studio and its filmmakers can use the model to enhance their work in exchange.