Skip to content

#124 - The Path to AGI: Inside poolside’s AI Model Factory for Code with Eiso Kant

June 27, 2025 · 1 h 4 min

Show notes

Building Human-Level AI for Code: Model Factories, RL at Scale, and Distributed Teams

Technical Deep Dives:

  • Poolside’s model factory: end-to-end automation from raw data to production models
  • Scaling RL from code execution: 800,000+ containerized repos, millions of agent tasks
  • Immutable versioning with Apache Iceberg for full traceability
  • Distributed team structure: 120+ engineers across US/EU, monthly in-person sprints
  • Hardware orchestration: 10,000+ H200s, hot swap failover, dynamic allocation
  • Leadership: dividing responsibilities, low-ego culture, and the MIT principle
  • Future of software: managing agent workforces, context window strategies, continual learning

"Our model factory runs thousands of experiments before a single production model is trained. It’s an empirical science—every component, from data ingestion to evals, is versioned and traceable." – Eiso Kant

Chapters: [00:04:28] Poolside’s unique approach to foundation models [00:13:02] Scaling hardware: 10,000+ H200s and orchestration [00:17:42] RL, agents, and the future of developer tools [00:24:56] Immutable versioning and evaluation frameworks [00:36:04] Distributed team structure and monthly sprints [00:40:26] Leadership, decision-making, and low-ego culture [00:45:54] Lessons for CTOs: breaking process dogma, preparing for agent-driven orgs [00:50:54] The next 3 years: AGI, agent workforces, and the end of manual coding [00:53:44] Context window, continual learning, and model memory [00:56:20] Everything collapses into the model: product, research, and daily life [00:59:46] Advice to a younger self: scale compute, trust RL+LM, and the four-minute mile

All episodes of alphalist.CTO Podcast – For CTOs and Technical Leaders

Settings

Display

Language

Decides which stations you see first on the home page.

History

Recently played stations and episodes and your latest searches are only stored in this browser.

Notifications

A short notice when a podcast you follow has a new episode. Turn off single podcasts with the bell on their page.

Account

Save favorites – in the app and on the website.

Keyboard shortcuts

/
Open search
Space
Play or pause
← →
In the player: back 15 s, forward 30 s (episodes) · in a row: next tile
↑ ↓
In a row: target within the tile
Home / End
In a row: first or last tile
Esc
Close window or menu
?
This overview
Now playing

Go to station page

Play next

    Add episodes with “Play next” – they play after the current episode.