Vigyata.AI
Is this your channel?

Every Way To Run Open Source AI Models

67.0K views· 2,845 likes· 17:32· Mar 24, 2026

🛍️ Products Mentioned (11)

Try Flow Pro free for 14 days: https://ref.wisprflow.ai/tinahuang 👉 AND get an extra month free with my code TINAHUANG In this video I explain every way to run open source AI models! 🤖 Want to get ahead in your career using AI? Join the waitlist for my AI Agent Bootcamp: https://www.lonelyoctopus.com/ai-agent-bootcamp 🤝 Business Inquiries: https://tally.so/r/mRDV99 🖱️Links mentioned in video ======================== 🔗Affiliates ======================== My SQL for data science interviews course (10 full interviews): https://365datascience.com/learn-sql-for-data-science-interviews/ 365 Data Science: https://365datascience.pxf.io/WD0za3 (link for 57% discount for their complete data science training) Check out StrataScratch for data science interview prep: https://stratascratch.com/?via=tina 🎥 My filming setup ======================== 📷 camera: https://amzn.to/3LHbi7N 🎤 mic: https://amzn.to/3LqoFJb 🔭 tripod: https://amzn.to/3DkjGHe 💡 lights: https://amzn.to/3LmOhqk ⏰Timestamps ======================== 00:00 Intro 01:40 Run Open Source Models Locally 07:47 Browser/Hosted Playgrounds 10:44 Managed Inference API 11:57 VPS (Virtual Private Server) 15:20 Managed Cloud 16:01 On-device/Edge 📲Socials ======================== instagram: https://www.instagram.com/hellotinah/ linkedin: https://www.linkedin.com/in/tinaw-h/ tiktok: https://www.tiktok.com/@hellotinahuang discord: https://discord.gg/5mMAtprshX 🎥Other videos you might be interested in ======================== How I consistently study with a full time job: https://www.youtube.com/watch?v=INymz5VwLmk How I would learn to code (if I could start over): https://www.youtube.com/watch?v=MHPGeQD8TvI&t=84s 🐈‍⬛🐈‍⬛About me ======================== Hi, my name is Tina and I'm an ex-Meta data scientist turned internet person! 📧Contact ======================== youtube: youtube comments are by far the best way to get a response from me! linkedin: https://www.linkedin.com/in/tinaw-h/ email for business inquiries only: tina@smoothmedia.co ======================== Some links are affiliate links and I may receive a small portion of sales price at no cost to you. I really appreciate your support in helping improve this channel! :)

About This Video

In this video I break down every major way to run open source AI models, because there’s still this common misconception that you need fancy hardware, deep infra knowledge, or a bunch of code to make any of it work. That might’ve been true a few months ago, but not anymore. Open source is where the industry is headed, and the models are now genuinely competitive with closed source—plus you get full control over where they run (local, edge, private cloud), they’re customizable (fine-tuning, guardrails, architecture tweaks), and they’re way cheaper long-term, especially at scale. I walk through four main categories and rank them from easiest to hardest: (1) running models locally (like using Ollama in literally a couple minutes, or calling it from your own code via localhost:11434, or running 24/7 on something like a Mac Mini), (2) browser/hosted playgrounds for quick experimentation (Arena, Groq, Hugging Face Spaces), (3) managed inference APIs for building apps fast without touching infrastructure (Together, Fireworks, Groq), and (4) VPS setups where you want more control and privacy (SSH in, run models, use Docker, optionally rent GPUs hourly via RunPod/Vast.ai). Then I add two bonus advanced categories—managed cloud for real scaling/compliance, and on-device/edge for shipping models inside apps—because I think edge is going to get big soon. My goal is that after this, you can pick the workflow that matches your constraints and ship.

Frequently Asked Questions

🎬 More from Tina Huang