Real-Time AI Video is Finally Here (And It’s Insane!)

Real-time video generation has arrived. Today, we are diving deep into PixVerse’s new R1 model—a narrative-controlled "world model" that lets you influence the video as it streams. From peaceful hikes to sudden avalanches and chaotic tornadoes, we push this real-time model to its absolute limits (and yes, it gets a little janky, but it is incredibly fun). We also break down the release of Black Forest Labs' Flux 2 Klein, a smaller, faster version of their massive image model designed for consumer hardware. Plus, we look at Runway's new "Story Panels" feature, updates to Google Veo, and a fascinating open-source project called Wonder Zoom. If you are interested in the future of generative media, world models, and open-source AI, you won't want to miss this one. My Newsletter: https://theoreticallymedia.beehiiv.com/ 🔗 Links Mentioned: PixVerse R1 Beta: https://x.com/PixVerse_ Black Forest Labs (Flux 2 Klein): https://bfl.ai/ Runway Story Panels: https://runwayml.com/ Google Veo Updates: https://blog.google/innovation-and-ai/technology/ai/veo-3-1-ingredients-to-video/?utm_source=futuretools.io&utm_medium=newspage Wonder Zoom Project: https://wonderzoom.github.io/ 00:00 - Intro: Real-Time World Models Are Here 00:36 - The Current State of World Models 01:20 - Explaining PixVerse R1: Interactive Video Generation 02:09 - R1 Technical Specs: 1080p & Infinite Streaming 02:44 - Testing the Snow Peak Vlog Preset 03:35 - Triggering an Avalanche (Or Giant Snowball?) 04:17 - Ambient Mode: Waking Up the Sleeping Guy 05:00 - Dramatic Mode: Business Suits & Hot Dogs 05:50 - Chaos Unfolds: Tornadoes, Hitmen & Godzilla 06:32 - Cozy Cabin Test: Fireplaces & Bears 07:14 - Janky and Weird is Just for Now 08:07 - Is This the Future of AI Entertainment? 08:36 - Flux 2 Klein Released: Smaller & Faster 08:53 - It's Fast! 09:23 - Why Flux Matters 09:33 - Testing Image Gen 10:12 - Handling Text & Fantasy Art in Flux 2 10:56 - The Toast Test & Realism Checks 11:07 - Image Editing Test 11:30 - Comparison: Flux 2 Dev vs. Klein 12:05 - Runway Update: Story Panels Feature 12:26 - Testing the Detective Prompt (Cinematic Stacks) 12:43 - Comparing Stacks to Previous Method 13:06 - Cropping 13:25 -Creative Examples: 3-Up Video Generation 13:36 Other Runway Updates 13:55 - Google Veo 3.1: Vertical Video Update 14:18 - "Ingredients" for Social Media Shorts 14:37 - Character Consistency 15:08 - Is the Flow Platform Worth the Price? 15:37 - Wonder Zoom: The Infinite Zoom Tool 16:00 - Parallax Effects & Legacy AI Comparisons 16:27 - Code Availability & Outro