117. Multi-Terabyte GPUs the Only Answer for AI Scaling
Show notes
Are multi-terabyte GPUs and massive frontier models really the answer to enterprise AI, or are we hitting a hard wall of soaring memory costs and power constraints?
In this episode of the Tech Field Day Podcast, host Alastair Cooke sits down with technical experts Ron Pagani Jr., Andy Banta, and Brian Martin to examine whether brute-force hardware scaling remains sustainable.
The panel debates scale-up vs. scale-out architectures, emphasizing how smart software optimizations—such as persistent KV caching (MinIO MemKV, Solidigm) and intelligent data layers (CTERA)—can eliminate redundant GPU computation and lower costs.
They also explore agentic microservices, power and cooling bottlenecks, and why right-sizing AI models for production is critical for achieving real-world enterprise ROI.
Panelists:
Andy Banta, Consultant
Brian Martin, AI and Data Center Lead at Signal65
Ron Pagani Jr., Founder of Open Technology Partners
Hosts:
Tom Hollingsworth, Event Lead for Tech Field Day
Alastair Cooke, Event Lead at Tech Field Day
Stephen Foskett, President and Organizer of Tech Field Day
Follow the Tech Field Day Podcast on X/Twitter or on Bluesky and use the Hashtag #TFDPodcast to join the discussion. Listen to more episodes on the podcast page of the website.
Follow Tech Field Day for more information on upcoming and current event coverage on X/Twitter, on Bluesky, and on LinkedIn, or visit our website.