Why speed is the AI feature no one asks for but everyone needs | Fireworks AI VP of Technology and Strategy
Show notes
Rob Ferguson is the VP of Technology and Strategy at Fireworks AI, a company that makes frontier AI infrastructure accessible to any organization that wants to own its own models rather than depend on someone else's. He started studying machine learning before it was called AI, worked on Pro Tools and AI systems for a music streaming service, helped design Amazon Go's grab-and-go technology, and built startup programs at AWS and Microsoft. Now he is at what he calls the front row of AI, sitting between applied research and go-to-market and translating what the technology can actually do into things companies can actually buy and build on. In this episode of Product Talk, iDonate VP of Product and Engineering Nacho Andrade sits down with Rob to talk about why speed is the AI feature no one asks for but everyone needs once they see it, how AI training went from lab-only to cheap as a cup of coffee, and his hot take that we are at the end of SaaS and entering an era he calls workwear.
In this episode, we cover:
(0:48) Rob's background from music and machine learning to Pro Tools, Artio, Amazon Go, and Fireworks (3:43) What it means to sit at the intersection of applied research and go-to-market (11:41) What Fireworks AI actually does: inference infrastructure and model training in one place (14:11) Who Fireworks serves and how the customer has changed as training costs have dropped (16:52) Speed as a hidden AI feature: why nobody asks for it and everyone needs it once they see it (20:18) The shift from AI as talkers to AI as doers, and what that means for product (21:24) AI independence vs AI dependence: why owning your model changes what you can build (23:27) The most common problem Rob sees: agents that work but cost thousands of dollars to run (26:25) Drawing the line in the sand: why doing less deeply beats promising everything (27:41) Hot take: we're at the end of SaaS and entering the era of workwear (31:55) Why domain experts and liberal arts thinkers become more valuable as surface-level software commoditizes (33:04) What the AI industry gets wrong about itself and the case for openness and independent scrutiny (38:24) The voice tech stack Rob is obsessed with and uses every day
Blog and detailed workflow walkthroughs from this episode: https://productsthatcount.com/why-speed-is-the-ai-feature-no-one-asks-for-but-everyone-needs/