Real Gemini demo? Rebuild with GPT4V + Whisper + TTS

How to build a Jarvis like super interactive AI that can listen, watch and talk back? We rebuilt the Gemini demo with GPT4V + Whisper + TTS, here is how it really performed… Build AI powered ad assets at scale with Hubspot campaign assistant for free: https://www.hubspot.com/campaign-assistant?utm_source=youtube&utm_medium=social&utm_campaign=CR00163Dec2023_AIJason%2Fpartner_youtube 🔗 Links - Follow me on twitter: https://twitter.com/jasonzhou1993 - Join my AI email list: https://crafters.ai/ - My discord: https://discord.gg/eZXprSaCDE - Github - Gemini demo with GPT4V: https://www.crafters.ai/aitools/rebuild-gemini-demo-with-gpt-4-vision ⏱️ Timestamps 0:00 Quick demo 1:41 Project plan & challenges 3:11 Open source Gemini demo & overview 9:37 Project setup 11:22 Setup video recorder 14:37 Setup silence aware audio recorder 16:36 Create img grid 19:44 Whisper 24:31 Connect to GPT4V 27:36 Streaming result & TTS 29:19 Demo 👋🏻 About Me My name is Jason Zhou, a product designer who shares interesting AI experiments & products. Email me if you need help building AI apps! ask@ai-jason.com #gpt4v #gemini #autogen #gpt4 #autogpt #ai #artificialintelligence #tutorial #stepbystep #openai #llm #chatgpt #largelanguagemodels #largelanguagemodel #bestaiagent #chatgpt #agentgpt #agent #babyagi