This AI can turn your mundane video into a special effects spectacular
Your Walk in the Park film becomes a living statue in Rome or an ape in a forest in minutres
When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
Runway’s AI video creation and editing service has added the promised video-to-video revamp feature to itsGen-3 Alpha modelplatform. The video-to-video tool lets you submit a video and a text prompt to alter it. The changes can adjust the setting, performers, or other elements of the video to match the text prompt or any of a handful of preset style suggestions.
Video-to-video is the last major addition to Runway’s video creation options. Runway already allows users to start with either text or images to define the look and motion of the video. Now, by starting with a real-world video, users can define the motion upfront and then use AI to alter the design and aesthetics. Runway trained the feature on a large set of videos and images captioned with details to teach the AI model how to understand uploaded films and the prompts for changing them. It’s like seeing a new video from another universe entirely. You can see how it works below.
“Video to Video represents a new control mechanism for precise movement, expressiveness, and intent within generations,” Runway explained on social media. “To use Video to Video, simply upload your input video, prompt in any aesthetic direction you like, or, choose from a collection of preset styles.”
A post shared by Runway (@runwayapp)
A photo posted by on
Film Multiverse
When combined with Gen-3 Alpha’s existing ability to handle complex transitions and expressive human faces and emotions, the results can be pretty spectacular. Runway has been quick to augment Gen-3 Alpha with new options. Most recently, the company showed off theGen-3 Alpha Turboversion of its model, which sacrifices some functionality for speed. Along with the video-to-video makeover option, the tool also works with Motion Brush, Advanced Camera Controls, Director Mode, and other, more granular video editing features.
Gen-3 Alpha comes off as far more versatile and user-friendly than the Gen-2 model. That said, it does have limitations despite its impressive output. Currently, it can generate video clips up to 10 seconds long, hardly a feature length film. Speed and quality may make up for that until it can go longer. There’s ever more competition for Runway to have to outdo, though.
The best-known isOpenAI’sSora model, but it’s far from the only one.Stability AI, Pika, Luma Labs’Dream Machine, and more are all racing to bring AI video models to the public. Even TikTok’s parent company, Bytedance, has an AI video makercalled Jimeng.
If you want to try out Runway’s video-to-video tool, Gen-3 Alpha is accessible to users on paid plans starting at $12 per month.
Get the best Black Friday deals direct to your inbox, plus news, reviews, and more.
Sign up to be the first to know about unmissable Black Friday deals on top tech, plus get all your favorite TechRadar content.
You might also like…
Eric Hal Schwartz is a freelance writer for TechRadar with more than 15 years of experience covering the intersection of the world and technology. For the last five years, he served as head writer for Voicebot.ai and was on the leading edge of reporting on generative AI and large language models. He’s since become an expert on the products of generative AI models, such as OpenAI’s ChatGPT, Anthropic’s Claude, Google Gemini, and every other synthetic media tool. His experience runs the gamut of media, including print, digital, broadcast, and live events. Now, he’s continuing to tell the stories people want and need to hear about the rapidly evolving AI space and its impact on their lives. Eric is based in New York City.
ChatGPT o1 model briefly escapes preview mode
Gemini will yada yada your Google Chat into a neat summary
Rockstar is still on track to release GTA 6 next year
