Gemini Diffusion Is CRAZY Fast—But Not What You Think

Google’s experimental Gemini Diffusion model—the first diffusion-based text generation model from a major frontier lab. In this video, we break down how it works, why it's blazing fast (800 tokens/sec!), and what it means for the future of LLMs. Is this the beginning of a new generation of language models? LINKS: https://deepmind.google/models/gemini-diffusion/ https://www.inceptionlabs.ai/ https://www.leewayhertz.com/how-to-train-a-diffusion-model/ https://www.seangoedecke.com/limitations-of-text-diffusion-models/?utm_source=chatgpt.com https://x.com/karpathy/status/1894923254864978091?lang=en Website: https://engineerprompt.ai/ RAG Beyond Basics Course: https://prompt-s-site.thinkific.com/courses/rag Let's Connect: 🦾 Discord: https://discord.com/invite/t4eYQRUcXB ☕ Buy me a Coffee: https://ko-fi.com/promptengineering |🔴 Patreon: https://www.patreon.com/PromptEngineering 💼Consulting: https://calendly.com/engineerprompt/consulting-call 📧 Business Contact: engineerprompt@gmail.com Become Member: http://tinyurl.com/y5h28s6h 💻 Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off). Signup for Newsletter, localgpt: https://tally.so/r/3y9bb0 00:00 Introduction to Gemini Diffusion 00:23 Real-Time Speed Demonstration 00:39 Comparison with Other Models 01:15 Google's Experimental Release 02:20 Understanding Diffusion LLMs 03:18 Diffusion vs. Auto-Regressive Models 05:20 Examples and Applications 06:33 Future Possibilities and Limitations 07:23 Conclusion and Final Thoughts