Coredump #007: AI, Open Source, & the Future of Embedded Development

00:00 Episode Teasers & Welcome 01:10 Meet the Panel: Memfault x Golioth 02:56 Why AI at the Edge Isn’t Actually New 05:33 The Real Use Cases for AI in Embedded Devices 08:07 How Much Chaos Are You Willing to Introduce? 11:19 Edge AI vs. Cloud AI: Where It’s Working Today 13:50 LLMs in Embedded: Promise vs. Reality 17:16 Why Hardware Can’t Keep Up with AI’s Pace 20:15 Building Unique Models When Public Datasets Fail 36:14 Open Source’s Big Moment (and What Comes Next) 42:49 Will AI Kill Open Source Contributions? 49:30 How AI Could Change Software Supply Chains 52:24 How to Stay Relevant as an Engineer in the AI Era Coredump Sessions started at Memfault, now part of Nordic Semiconductor. We're continuing the series here with the same hosts, guests, and deep dives into embedded systems. In today's Coredump Session, we dive into a wide-ranging conversation about the intersection of AI, open source, and embedded systems with the teams from Memfault and Goliath. From the evolution of AI at the edge to the emerging role of large language models (LLMs) in firmware development, the panel explores where innovation is happening today — and where expectations still outpace reality. Listen in as they untangle the practical, the possible, and the hype shaping the future of IoT devices. Speakers: - François Baldassari: CEO & Founder, Memfault - Thomas Sarlandie: Field CTO, Memfault - Jonathan Beri: CEO & Founder, Golioth - Dan Mangum: CTO, Golioth Key Takeaways: - AI has been quietly powering embedded devices for years, especially in edge applications like voice recognition and computer vision. - The biggest gains in IoT today often come from cloud-based AI analytics, not necessarily from AI models running directly on devices. - LLMs are reshaping firmware development workflows but are not yet widely adopted for production-grade embedded codebases. - Use cases like audio and video processing have seen the fastest real-world adoption of AI at the edge. - Caution is warranted when integrating AI into safety-critical systems, where determinism is crucial. - Cloud-to-device AI models are becoming the go-to for fleet operations, anomaly detection, and predictive maintenance. - Many promising LLM-based consumer products struggle because hardware constraints and cloud dependence create friction. - The future of embedded AI may lie in hybrid architectures that balance on-device intelligence with cloud support. Listen to the episode: https://memfault.com/resources/coredump-007-ai-open-source-and-the-future-of-embedded-development/ Join the Interrupt Slack: https://interrupt-slack.herokuapp.com Suggest a Guest: https://docs.google.com/forms/d/e/1FAIpQLSf76qnsUDznyIJfC2OXCC_dIwR8v9z1yvE3PPlOhfsNCR_sug/viewform?usp=header Follow Nordic Semiconductor: - LinkedIn: https://www.linkedin.com/company/nordic-semiconductor/ - Instagram: https://www.instagram.com/nordicsemi - Facebook: https://www.facebook.com/nordicsemiconductor - TikTok: https://www.tiktok.com/@nordic_semiconductor - Twitter (X): https://twitter.com/NordicTweets Follow Memfault: - LinkedIn⁠⁠: https://www.linkedin.com/company/memfault/ - Bluesky⁠⁠:https://bsky.app/profile/memfault.com - ⁠⁠Twitter⁠⁠:https://twitter.com/memfault Other ways to listen: Apple Podcasts: https://podcasts.apple.com/us/podcast/coredump-sessions/id1804647817 iHeartRadio: https://www.iheart.com/podcast/269-coredump-sessions-271043539 Amazon Music:https://music.amazon.com/podcasts/a5a780d4-7f14-4ed8-bda6-dd1aa4e98479/coredump-sessions) GoodPods:https://goodpods.com/podcasts/coredump-sessions-668730) Castbox: https://castbox.fm/channel/Coredump-Sessions-id6534689?country=us Visit our website: https://www.nordicsemi.com/