How to Use LLM Vision to Analyze Camera Images and Video in Home Assistant

How to setup and use LLM Vision in Home Assistant. This can analyze images, videos, live camera feeds, and Frigate events for providing useful (and hilarious) information about your smart home. 🍿 WATCH NEXT https://youtu.be/sOom-eK8vlw https://youtu.be/7DIGXdrVNis 🔗 LINKS Video article: https://www.michaelsleen.com/llm-vision/ Doorbell Notification YAML code: https://shop.michaelsleen.com/products/notification-doorbell-motion-llm-yaml-code LLM Vision GitHub: https://github.com/valentinfrlch/ha-llmvision Google Gemini API key: https://aistudio.google.com/app/apikey 🛒 SHOP MERCH & DIGITAL DOWNLOADS Visit my shop to can grab sleek merch, plus the home automation blueprints and code I show in my tech videos. This saves you the time and hassle of figuring it out, and takes your smart home to the next level faster. https://shop.michaelsleen.com/ 💻 BROWSE TECH GEAR Browse the tech I use everyday, from smart home gadgets, to productivity desk setups, to mobile devices, and more. https://www.michaelsleen.com/tech/ 👏 BECOME A MEMBER If you enjoy high quality, honest tech reviews and tutorials, become a member today and get special perks. Become a YouTube Channel Member: https://www.youtube.com/channel/UCPW1UJ2F7Ch7XHfzhYqyX-A/join Become a Fourthwall Member: https://shop.michaelsleen.com/supporters/sign_in Become a Patreon Member: https://patreon.com/michaelsleen Support Me on Ko-Fi: https://ko-fi.com/michaelsleen 🎬 FILMING GEAR Camera - iPhone 15 Pro Max: https://amzn.to/3tAyAbZ Mic (Wired) - Rode VideoMic GO II: https://amzn.to/3vnpgc1 Mic (Wireless) - Hollyland Lark M2: https://amzn.to/3wlbmYF Desk Mount - Elgato Master Mount L: https://amzn.to/3wbGKZH Desk Mount for Top-Down Camera - Elgato Flex Arm L: https://amzn.to/4a7pG4I Desk Mount for Prompter and Talking Head Camera - Elgato Solid Arm: https://amzn.to/3UqrQ9N Desk Mount for Light - ULANZI Camera Desk Mount Stand: https://amzn.to/41LmM3l Light - RALENO LED Soft Light: https://amzn.to/48v3Ho6 Tripod - Peak Design Travel Tripod (Carbon Fiber): https://amzn.to/3vExGfi Mini Tripod - Peak Design Mobile Tripod: https://amzn.to/48zoIOI Gimbal - Hohem iSteady M6 Gimbal for Smartphone - https://amzn.to/3Wqi0r6 Gimbal - Hohem AI Tracking Sensor - https://amzn.to/3y85bYv Headphone Hanger Mount - EURPMASK: https://amzn.to/3Swl4i4 Headphones - Sony WH-1000XM5: https://amzn.to/3I8Hm4z Laptop - 2023 14" MacBook Pro, M3 Pro, 18GB Memory, 1TB SSD: https://amzn.to/48sKBzi Video Editing - DaVinci Resolve (Free Version): http://tinyurl.com/3hksxnxx 👤 ABOUT ME Hi, I'm Michael Leen. I'm a tech product manager and a YouTube creator. I have worked in big tech and smart home, and am a lifelong tech enthusiast. I produce YouTube content showing how tech can make you more productive – saving you time and money, and making your home more comfortable and secure. 🎵 MUSIC CREDIT Song: Up Above by Pyrosion https://soundcloud.com/pyrosion Creative Commons — Attribution-ShareAlike 3.0 Unported — CC BY-SA 3.0 Music promoted by Audio Library https://youtu.be/mikXltmStnc 📘 CHAPTERS 00:00 - Introduction 00:49 - LLM Vision 01:47 - Setup 07:23 - Use cases 10:22 - Home automation 10:47 - Final thoughts 11:45 - Outtakes ℹ️ AFFILIATE LINKS When you make a purchase using the links I provide, I may earn a small commission at no additional cost to you.