A NEW Way to Run LLMs Locally - Docker Model Runner

Docker is quietly making some major moves in the AI space. In this video, I explore Docker Model Runner, a powerful new feature that lets you work with open-source language models right from your Mac, with GPU acceleration and full local control. No API keys, no cloud latency — just fast, private inference built into the Docker CLI. I’ll also show you Docker’s growing ecosystem of AI tools, from their new MCP Toolkit (Model Context Protocol) to Gordon, a context-aware AI assistant built into Docker Desktop. Thank you, Docker, for sponsoring this video! ⏱️ TIMESTAMPS ⏱️ 00:00 Intro 01:28 What is Docker Model Runner? 01:04 Pulling and running models 02:49 The big picture 04:42 How to use in local development 06:11 What is Docker MCP? 06:56 Docker MCP Toolkit Walkthrough 08:02 GitHub MCP demo 08:28 YouTube Transcript to Blog demo 09:16 Gordon - A new AI Agent 10:51 - Conclusion Video Links Docker Model Runner - https://docs.docker.com/ai/model-runner/ Docker MCP catalog - https://hub.docker.com/mcp 🎥 Watch These Next 🎥 https://youtu.be/64TECXZiFb0 https://youtu.be/Msdslr5m3B8 https://youtu.be/uDcb12CqoR4 FOLLOW ME ON Twitter - https://x.com/travisdotmedia LinkedIn - https://linkedin.com/in/travisdotmedia FAVORITE TOOLS AND APPS: Udemy deals, updated regularly - https://travis.media/udemy ZeroToMastery - https://geni.us/AbMxjrX Camera - https://amzn.to/3LOUFZV Lens - https://amzn.to/4fyadP0 Microphone - https://amzn.to/3sAwyrH ** My Coding Blueprints ** Learn to Code Web Developer Blueprint - https://geni.us/HoswN2 AWS/Python Blueprint - https://geni.us/yGlFaRe - FREE Both FREE in the Travis Media Community - https://imposterdevs.com FREE EBOOKS 📘 https://travis.media/ebooks #docker #dockermodelrunner #mcpserver