Skip to content

How the Best Engineers Build a World Model (Google Earth Creator & Niantic Spatial CTO)

September 2, 2026 · 37 min

Show notes

Niantic Spatial CTO Brian McClendon on how the best engineers solve problems most give up on — from a 4D model of the world to shipping research in months. He built Google Earth and ran Google Maps for over a decade, and he's been there, done that. What he's building now is harder, and it's already live for customers. Along the way: who makes it on his team and who doesn't, and the one piece of advice he'd give every engineer using AI.


In this video, we cover:

- The 4D model of the world: visual positioning, change detection, and treating a pile of photos like a database

- Gaussian splats and real-to-sim: capturing a room and loading it into Nvidia Isaac to train robots

- Turning a research idea into a production service in six months

- What Google Maps taught him about building for robots instead of humans

- Designing problems AI can self-check, and why token maxing is a waste


For engineers and engineering leaders who want to work on problems that don't have a known answer yet — and who want to know what a CTO who's built the definitive product in his field looks for in the people he hires.

Recorded at the AI4 conference 2026.


Timestamps:

00:00:00 - Google Earth? Been There, Done That
00:00:46 - Turning a Research Idea Into Production in 6 Months
00:02:37 - How Any Photo Gets Located Within Half a Meter
00:06:37 - The Long-Term Goal: A 4D Model of the World
00:08:37 - Treating a Pile of Photos Like a Database
00:11:58 - What Google Maps Taught Him About Training Robots
00:15:22 - Gaussian Splats Explained in Plain Terms
00:17:42 - The Unsolved Problem: Scale and Semantic Change
00:20:34 - Why Google Earth Is Good Enough
00:22:09 - Who Makes It on His Team and Who Doesn't
00:23:38 - Designing Problems AI Can Self-Check
00:26:03 - The Insights Hidden in the Physical World
00:28:18 - Digital Twins, Cities, and Ready Player One
00:31:35 - Visual Positioning When GPS Gets Spoofed
00:33:24 - Token Maxing Is Bullshit: Advice for Engineers


Guest: Brian McClendon, CTO at Niantic Spatial. The engineer behind Google Earth; ran Google Maps for over a decade.

https://www.linkedin.com/in/brianmcclendon


#NianticSpatial #GoogleEarth #SoftwareEngineering

All episodes of Beyond Coding

Settings

Display

Language

Decides which stations you see first on the home page.

History

Recently played stations and episodes and your latest searches are only stored in this browser.

Notifications

A short notice when a podcast you follow has a new episode. Turn off single podcasts with the bell on their page.

Account

Save favorites – in the app and on the website.

Keyboard shortcuts

/
Open search
Space
Play or pause
← →
In the player: back 15 s, forward 30 s (episodes) · in a row: next tile
↑ ↓
In a row: target within the tile
Home / End
In a row: first or last tile
Esc
Close window or menu
?
This overview
Now playing

Go to station page

Play next

    Add episodes with “Play next” – they play after the current episode.