Skip to content

#379 The Secrets of Deploying AI in Production | Sumti Jairath, Chief Architect at SambaNova

September 28, 2026 · 48 min

Show notes

AI agents are moving from demos into production, but many teams run into the same wall: responses that take too long and cost too much. As models grow bigger and reason through more steps before answering, every chained agent adds delay, and that adds up fast at scale. For data and AI professionals, this raises a practical question: how do you pick a model and an inference platform that keeps a multi-agent workflow fast without blowing the budget? And underneath that choice sits a bigger one — how much of the AI stack, from chips to software, should a company actually control?

Sumti Jairath is Chief Architect at SambaNova Systems, where he's focused on machine learning, big data analytics, and software-defined hardware since 2017. Before that, he spent close to eight years as a Senior Hardware Architect at Oracle working on hardware acceleration for machine learning and data analytics, and earlier held processor and server design roles at Hewlett Packard and Sun Microsystems. He holds a B.Tech in Electronics and Communication Engineering from the National Institute of Technology, Kurukshetra.

In the episode, Richie and Sumti explore why AI agents are slow and expensive, the architecture behind faster inference, choosing the right model and platform for a task, open-source models and sovereign AI, the full AI infrastructure stack, power efficiency, the AI data center debate, career paths in AI infrastructure, and much more.

Links Mentioned in the Show:

• NVIDIA's Groq acquisition, announced around GTC

• Chris Olah, Anthropic

• Anthropic and OpenAI's coding-agent-driven revenue growth

• Ollama

• Apple Mac mini

• SambaNova careers

• Connect with Sumti

• AI-Native Course: Intro to AI for Work

• Related Episode: From City Sewers to Sovereign AI with Russ Wilcox, CEO at ArtifexAI

New to DataCamp? Learn on the go using the DataCamp mobile app

Empower your business with world-class data and AI skills with DataCamp for business

All episodes of DataFramed

Settings

Display

Language

Decides which stations you see first on the home page.

History

Recently played stations and episodes and your latest searches are only stored in this browser.

Notifications

A short notice when a podcast you follow has a new episode. Turn off single podcasts with the bell on their page.

Account

Save favorites – in the app and on the website.

Keyboard shortcuts

/
Open search
Space
Play or pause
← →
In the player: back 15 s, forward 30 s (episodes) · in a row: next tile
↑ ↓
In a row: target within the tile
Home / End
In a row: first or last tile
Esc
Close window or menu
?
This overview
Now playing

Go to station page

Play next

    Add episodes with “Play next” – they play after the current episode.