Some of the most important meetings in Hollywood history will take place in the coming week, as OpenAI hits Hollywood to show the potential of its “Sora” software to studios, talent agencies, and media executives.
Bloomberg is reporting that OpenAI wants more filmmakers to become familiar with Sora, the text-to-video generator that potentially could upend the way movies are made.
Producer Tyler Perry has already seen it in action, and was so impressed that he put on hold plans for an $800 million studio expansion in his Atlanta base. — Read More
Tag Archives: VFX
Introducing Stable Video 3D: Quality Novel View Synthesis and 3D Generation from Single Images
Today we are releasing Stable Video 3D (SV3D), a generative model based on Stable Video Diffusion, advancing the field of 3D technology and delivering greatly improved quality and view-consistency.
This release features two variants: SV3D_u and SV3D_p. SV3D_u generates orbital videos based on single image inputs without camera conditioning. SV3D_p extends the capability by accommodating both single images and orbital views, allowing for the creation of 3D video along specified camera paths.
Stable Video 3D can be used now for commercial purposes with a Stability AI Membership. For non-commercial use, you can download the model weights on Hugging Face and view our research paper here. — Read More
OpenAI’s Sora Made Me Crazy AI Videos—Then the CTO Answered (Most of) My Questions
Pika 1.0 AI video generator is free to try right now — here is why you should give it a go
Pika Labs has finally taken its Pika 1.0 artificial intelligence generative video model out of the waitlist. It is currently free for anyone to sign up and try out.
The AI video model announced earlier this month has been slowly rolling out, with the company using feedback from early users to improve the service before making it widely available. — Read More
And now adds sound!
I used generative AI to turn my story into a comic—and you can too
Thirteen years ago, as an assignment for a journalism class, I wrote a stupid short story about a man who eats luxury cat food. This morning, I sat and watched as a generative AI platform called Lore Machine brought my weird words to life.
I fed my story into a text box and got this message: “We are identifying scenes, locations, and characters as well as vibes. This process can take up to 2 minutes.” Lore Machine analyzed the text, extracted descriptions of the characters and locations mentioned, and then handed those bits of information off to an image-generation model. An illustrated storyboard popped up on the screen. As I clicked through vivid comic-book renderings of my half-forgotten characters, my heart was pounding. — Read More
Google DeepMind’s new generative model makes Super Mario–like games from scratch
OpenAI’s recent reveal of its stunning generative model Sora pushed the envelope of what’s possible with text-to-video. Now Google DeepMind brings us text-to-video games.
The new model, called Genie, can take a short description, a hand-drawn sketch, or a photo and turn it into a playable video game in the style of classic 2D platformers like Super Mario Bros. But don’t expect anything fast-paced. The games run at one frame per second, versus the typical 30 to 60 frames per second of most modern games. — Read More
The Creative Advantage: Why Sora Won’t Replace You
Welcome to the latest edition of my “AHHH!!! This new, scary AI tools was just released!!! Is everything coming to come to an end!?!?” newsletter. It’s my semi-regular update where I dive into the latest buzz from my social media universe and tell you that everything is going to be ok.
As someone who curates my social media feeds to highlight the joy and creativity in the world, my interests range from traditional and 3D art, to virtual/augmented reality, film, distance running, ceramics, and the Chicago Bears. This approach ensures my online experience is filled with inspiring artwork, fascinating insights, and the occasional homage to Walter Payton, inarguably the greatest running back of all time.
However, the digital tranquility of my social media landscape was recently disrupted by a major development: the release of OpenAI’s Sora, a groundbreaking text-to-video tool. Discussions around Sora spiraled into fears of it potentially overturning the entire film and creative industries. — Read More
AI’s New Job? All-Purpose Hollywood Crewmember
Picture this: In a future not too far away, HBO is mulling whether to greenlight a new Game of Thrones spinoff but is on the fence about the project. So instead of dumping tens of millions of dollars to shoot a pilot it might wind up passing on, it uses a generative artificial intelligence system trained on its library of shows to create a rough cut in the style of the original. It ultimately decides not to move forward with the title. That process sans AI cost HBO troves of cash and time when it was mulling a potential successor to Thrones in 2018. A cast headed by Naomi Watts was assembled and massive new sets were built. All in all, HBO spent roughly $35 million to shoot a pilot that never saw the light of day. The cost of doing it with AI? A fraction of that figure.
The role of AI in the entertainment industry was a sticking point in talks during dual strikes by actors and writers last year, with the unions eventually negotiating guardrails on use, but the kind of tech capable of overhauling traditional production processes and outright replacing skilled workers was still thought to be years away.
Enter OpenAI’s Sora, which was unveiled Feb. 15 and marks the Sam Altman-led startup’s first major encroachment into Hollywood. — Read More
Sora, Groq, and Virtual Reality
Matthew Ball wrote a fun essay earlier this month entitled On Spatial Computing, Metaverse, the Terms Left Behind and Ideas Renewed, tracing the various terms that have been used to describe, well, that’s what the essay is about: virtual reality, augmented reality, mixed reality, Metaverse, are words that have been floating around for decades now, both in science fiction and in products, to describe what Apple is calling spatial computing.
Personally, I agree with Ball that “Metaverse” is the best of the lot, particularly given Ball’s succinct description of the concept in his conclusion:
I liked the term Metaverse because it worked like the Internet, but for 3D. It wasn’t about a device or even computing at large, just as the Internet was not about PC nor the client-server model. The Metaverse is a vast and interconnected network of real-time 3D experiences. For passthrough or optical MR to scale, a “3D Internet” is required – which means overhauls to networking infrastructure and protocols, advances in computing infrastructure, and more. This is, perhaps the one final challenge with the term – it describes more of an end state than a transition. — Read More
If you thought Sora was impressive now watch it with AI generated sound from ElevenLabs
Artificial intelligence speech startup ElevenLabs offered an insight into what its planning to release in the future, adding sound effects to AI generated video for the first time.
Best known for its near human-like text-to-speech and synthetic voice services, ElevenLabs added artificially generated sound effects to videos produced using OpenAI’s Sora.
OpenAI unveiled its impressive Sora text-to-video artificial intelligence model last week, showcasing some of the most realistic, consistent and longest AI generated video to date. — Read More
Rick's Cafe AI 