AI Gateway: The Platform Behind Smarter, Safer AI (with Thet Ko)

AI might look simple on the surface — just send a prompt, get a response — but behind the scenes, there’s a whole platform challenge to solve. In this episode of SEEK Bytes – we’re joined by Thet Ko, Senior Staff Engineer in SEEK’s AI Platform Services team, to unpack how SEEK is building an AI Gateway to centralise AI calls, improve governance and make it easier for teams to build with AI without reinventing the foundations every time. From cost visibility and PII protection to guardrails, resilience and shared memory across agents, this episode lifts the lid on the platform work that makes enterprise AI actually usable at scale. This episode's special guest: Thet Ko (Senior Staff Engineer) In this episode you’ll learn: • Why an AI Gateway matters – how centralising AI usage helps teams get better governance, clearer cost visibility and shared protection against risks like PII leakage and prompt injection. • What platform teams need to solve for AI at scale – from giving agents the right tools and memory to helping teams focus on the use case while the platform handles the foundations. • Why reliability and economics matter more than the hype – including model outages, fallback across regions, evaluation with golden datasets and LangFuse, and the reality that AI only scales if the value outweighs the cost. 🔔 Follow the SEEK Bytes podcast so you never miss a new episode