Zum Inhalt springen

#379 The Secrets of Deploying AI in Production | Sumti Jairath, Chief Architect at SambaNova

28.09.2026 · 48 Min.

Shownotes

AI agents are moving from demos into production, but many teams run into the same wall: responses that take too long and cost too much. As models grow bigger and reason through more steps before answering, every chained agent adds delay, and that adds up fast at scale. For data and AI professionals, this raises a practical question: how do you pick a model and an inference platform that keeps a multi-agent workflow fast without blowing the budget? And underneath that choice sits a bigger one — how much of the AI stack, from chips to software, should a company actually control?

Sumti Jairath is Chief Architect at SambaNova Systems, where he's focused on machine learning, big data analytics, and software-defined hardware since 2017. Before that, he spent close to eight years as a Senior Hardware Architect at Oracle working on hardware acceleration for machine learning and data analytics, and earlier held processor and server design roles at Hewlett Packard and Sun Microsystems. He holds a B.Tech in Electronics and Communication Engineering from the National Institute of Technology, Kurukshetra.

In the episode, Richie and Sumti explore why AI agents are slow and expensive, the architecture behind faster inference, choosing the right model and platform for a task, open-source models and sovereign AI, the full AI infrastructure stack, power efficiency, the AI data center debate, career paths in AI infrastructure, and much more.

Links Mentioned in the Show:

• NVIDIA's Groq acquisition, announced around GTC

• Chris Olah, Anthropic

• Anthropic and OpenAI's coding-agent-driven revenue growth

• Ollama

• Apple Mac mini

• SambaNova careers

• Connect with Sumti

• AI-Native Course: Intro to AI for Work

• Related Episode: From City Sewers to Sovereign AI with Russ Wilcox, CEO at ArtifexAI

New to DataCamp? Learn on the go using the DataCamp mobile app

Empower your business with world-class data and AI skills with DataCamp for business

Alle Folgen von DataFramed

Einstellungen

Darstellung

Sprache

Bestimmt, welche Sender dir auf der Startseite zuerst gezeigt werden.

Verlauf

Zuletzt gehörte Sender und Folgen und deine letzten Suchen liegen nur in diesem Browser.

Hinweise

Ein kurzer Hinweis, wenn ein Podcast, dem du folgst, eine neue Folge hat. Einzelne Podcasts stellst du über die Glocke auf ihrer Seite ab.

Konto

Favoriten speichern – in der App und auf der Website.

Tastenkürzel

/
Suche öffnen
Leertaste
Abspielen oder anhalten
← →
Im Player: 15 s zurück, 30 s vor (Folgen) · im Regal: nächste Kachel
↑ ↓
Im Regal: Ziel innerhalb der Kachel
Pos1 / Ende
Im Regal: erste bzw. letzte Kachel
Esc
Fenster oder Menü schließen
?
Diese Übersicht
Läuft gerade

Zur Senderseite

Als Nächstes

    Folgen mit „Als Nächstes“ vormerken – sie laufen nach der aktuellen Folge.