Aller au contenu

99% Correct Is Still Failure: The Last Mile for Mission-Critical AI

9 juin 2026 · 43 min

Notes de l’épisode

AI can now write code faster than any human alive, and most of the time it's more than good enough. That's the magic powering the entire vibe coding wave. But there's a category of software where "most of the time" just doesn't cut it: the code running a fighter jet, a power grid, an autonomous vehicle, a piece of medical hardware. When that code is wrong, the consequences aren't a bug. They're a recall, an accident, a national security incident.

In this episode of Talking AI, Matt Paige sits down with Ryan Aytay, the former CEO of Tableau and now President and COO of CodeMetal, which just raised $125 million to close that gap. Ryan explains what he calls "the last mile" for mission-critical industries: the verification, validation, and provability layer that sits between AI-generated code and the systems where failure is catastrophic.

The conversation covers why 99% correct is still failure in defense and autonomous systems, how CodeMetal translated a million lines of legacy C++ to Rust in weeks (like rewiring a city without the power going out), and why the real problem isn't code generation, it's behavioral assurance at scale. Ryan also shares how he's using AI to run a sub-100-person startup, why the biggest risk for any company right now is doing nothing, and what an operator who lived through 19 years of per-seat SaaS at Salesforce thinks about outcomes-based pricing in the age of AI.

In this episode, you'll hear about:

Why every AI coding tool says "almost, but not quite" when asked about production-ready guarantees. The difference between code generation and behavioral assurance at scale. How CodeMetal translates legacy C++ to Rust with provable correctness in weeks, not years. The concept of V&V (verification and validation) and why it's the missing layer in AI code gen. Real use cases in defense, autonomous vehicles, and simulation environments. Why hardware in the loop matters as much as human in the loop. How a sub-100-person company uses AI across M&A, recruiting, marketing, and operations. Ryan's take on token economics, outcomes-based pricing, and the SaaS evolution. Why the biggest risk is inaction, not AI errors. What attracted Ryan to CodeMetal after 19 years at Salesforce and leading Tableau.

Key Moments

  • 02:47 — From Tableau fanboy to the trust gap in AI
  • 03:52 — Why Ryan left Salesforce/Tableau for CodeMetal
  • 05:55 — "Is it safe for the things I depend on every day?"
  • 06:45 — 99% correct is still failure for mission-critical systems
  • 08:20 — The sycophantic nature of AI: "Heck yeah, I can do that"
  • 09:22 — It's not a coding problem, it's a behavioral problem at scale
  • 11:22 — Human in the loop isn't enough: hardware in the loop
  • 14:30 — What is fuzzing? Formal methods explained in plain English
  • 16:02 — How a sub-100-person company leverages AI across every function
  • 18:19 — The Shopify mandate: using AI reflexively
  • 21:33 — Rewiring the city without the power going out: the million-line translation
  • 24:38 — Defense use cases: drones, autonomous vehicles, and simulation
  • 26:28 — "Prove is even a stronger word than guarantee"
  • 28:32 — Accountability and the coming wave of AI insurance
  • 32:54 — Token usage, the Uber CTO's blown budget, and outcomes-based pricing
  • 36:26 — SaaS isn't dead, it's evolving: Ryan's Salesforce/Tableau perspective
  • 40:08 — The biggest risk is doing nothing
  • 42:07 — Where to find CodeMetal (and they're hiring)

Key Links


Mentioned in this episode:

AI Opportunity Finder

Feeling overwhelmed by all the AI noise out there? The AI Opportunity Finder from HatchWorks cuts through the hype and gives you a clear starting point. In less than 5 minutes, you’ll get tailored, high-impact AI use cases specific to your business—scored by ROI so you know exactly where to start. Whether you're looking to cut costs, automate tasks, or grow faster, this free tool gives you a personalized roadmap built for action. 👉 Try it now at https://hatchworks.com/ai-opportunity-finder/

GenROI by HatchWorks AI

Most companies don't have an AI problem. They have a prioritization problem. There are hundreds of places you could use AI, and the hard part is knowing which ones are worth the investment, which ones you're ready for, and what should come first. GenROI uses AI-guided discovery to gather insights from across your whole organization, not just the few people who make it into a workshop. Our strategists then work with your leadership team to turn those insights into a prioritized AI roadmap weighted by business value, feasibility, and readiness. Learn more at https://hatchworks.com/genroi

Tous les épisodes de Talking AI

Paramètres

Affichage

Langue

Détermine les stations affichées en premier sur la page d’accueil.

Historique

Les stations et épisodes écoutés récemment et tes dernières recherches sont seulement enregistrés dans ce navigateur.

Notifications

Un court message quand un podcast que tu suis publie un nouvel épisode. Désactive un podcast précis avec la cloche sur sa page.

Compte

Enregistrez vos favoris – dans l’app et sur le site.

Raccourcis clavier

/
Ouvrir la recherche
Espace
Lecture ou pause
← →
Dans le lecteur : 15 s en arrière, 30 s en avant (épisodes) · dans une rangée : tuile suivante
↑ ↓
Dans une rangée : cible dans la tuile
Début / Fin
Dans une rangée : première ou dernière tuile
Esc
Fermer la fenêtre ou le menu
?
Cet aperçu
En cours de lecture

Voir la station

À suivre

    Ajoutez des épisodes avec « À suivre » – ils seront lus après l'épisode en cours.