RubyGems Security, AI Benchmarking, and Impatient Programming
Show notes
Rarely does a single episode pack in so much ground-level Ruby community insight, but this one covers everything from security team announcements to the ethics of AI voter targeting.
Valentino Stoll has just joined the RubyGems security on-call team, a move he describes as choosing active contribution over passive observation. Joe Leo praises the infrastructure built by Colby Swandale and the Ruby Central team, noting their runbooks and impressively low downtime history. The hosts dig into the Rails team's new benchmark, exploring how models like Opus and GPT-4 handle sequential tasks where generated files carry forward between runs. Can a benchmark truly validate success without addressing production readiness and team expertise? That question hangs over their discussion of DHH's suggestion to rewrite Rails in Rust, which Ernesto Tagwerker argues simply doesn't justify the maintenance burden of supporting a second language.
The conversation also covers Ruby LLM's new judging feature using measured probabilities to grade outputs before deployment, and Anthropic's updated usage policy on voter targeting (which both hosts view as marketing more than meaningful change). It's a wide-ranging, honest conversation that covers a lot of territory.