Revolutionizing Real-Time Video Editing With AI
Dean Leitersdorf greets me over Zoom and types a prompt into a new artificial intelligence tool from his startup, Decart: “wild west, cosmic, Roman Empire, golden, underwater.” Within seconds, his image morphs into a surreal, shimmering version of Julius Caesar, complete with a poncho and aquatic hues. This transformation is powered by Mirage, a cutting-edge AI model capable of manipulating live video in real time.
Leitersdorf, with long hair and a restless pen twirling through his fingers, demonstrates the capabilities of Mirage. As we speak, his on-screen appearance shifts continuously—feminine features appear, the pen changes colors and shapes, and the video interface evolves in unpredictable ways. With each new prompt, the visual style shifts drastically, creating psychedelic, otherworldly effects.
Introducing Mirage: Real-Time Video-to-Video Generation
Mirage is Decart’s flagship innovation, capable of transforming live video feeds with remarkable speed and visual complexity. Unlike AI models that generate pre-rendered video from text prompts—such as OpenAI’s Sora—Mirage enables real-time manipulation of video input, opening up new possibilities for livestreaming, content creation, and gaming.
On Thursday, Decart is launching both a website and an app to make Mirage accessible to the public. Users will be able to upload or stream their own videos—or even modify YouTube clips—using preset visual themes like “anime,” “Dubai skyline,” “cyberpunk,” and “Versailles Palace.”
During our interview, Leitersdorf uploads a Fortnite gameplay video. Instantly, the familiar battlefield transforms into an underwater realm, showcasing Mirage’s ability to overhaul entire visual environments on the fly.
Game-Changing Potential for the Gaming Industry
Decart’s technology is poised to make significant waves in the gaming world. In late 2024, the company showcased a demo game called Oasis, which used Mirage-like techniques to generate a dynamic, Minecraft-inspired world. Players could zoom into textures and generate new, explorable scenes in real time, an experience that could redefine open-world game design.
However, real-time video manipulation is computationally demanding. To make Mirage viable, Decart engineers wrote low-level software optimized for Nvidia GPUs, allowing the system to generate 20 frames per second at a resolution of 768×432 pixels with a latency of just 100 milliseconds per frame. This makes it suitable for platforms like TikTok, where quick, visually engaging content thrives.
A Technical Feat—and a Creative Playground
Training an AI model like Mirage posed unique challenges. Real-time video generation can easily veer into incoherence or surrealism. To address this, Decart developed proprietary training techniques to ensure greater visual consistency and a system for rapid error correction. Leitersdorf notes that the company is currently working toward full HD and 4K capabilities, along with more detailed editing controls for users.
“We have a bunch more releases coming up soon that will allow you to do more specific edits,” says Leitersdorf. The team envisions a future where users can sculpt their video environments with precision, blending creativity and technology in real time.
Social Media and Ethical Considerations
Mirage could quickly become a hit on platforms like TikTok and Instagram. Leitersdorf and his team had fun experimenting with the tool, generating cyberpunk avatars and surreal landscapes with friends. However, the unpredictability of the model raises ethical questions. In some instances, Mirage has altered users’ racial features unintentionally—a controversial issue that could provoke debate over algorithmic bias and user control.
Despite these concerns, Mirage represents a significant leap in AI video technology. Leitersdorf believes only a handful of tech giants—OpenAI, Anthropic, xAI, Google, and Meta—have the resources to create something comparable. Still, he has no interest in selling Decart.
“We’ve got five years and try to build a kilo-unicorn,” he says with a grin. “That’s 1,000 billion dollars, or a trillion users.”
The Future of AI and Live Video
With Mirage, Decart is pioneering a new era of video content creation. By allowing users to transform live video in real time, the company is setting the stage for a more immersive and creatively unconstrained digital world. Whether it’s for gaming, social media, or artistic expression, Mirage could redefine how we interact with video and with each other.
As the technology continues to evolve, questions about control, accuracy, and ethics will remain at the forefront. But for now, Mirage offers a tantalizing glimpse into a future where any scene, any style, and any imagination can come to life—instantly.
This article is inspired by content from Original Source. It has been rephrased for originality. Images are credited to the original source.