Aller au contenu

Why Elixir Beat Go and Rust for BlueSky's Data Plane | Chris Beck

19 juin 2026 · 41 min

Notes de l’épisode

There's a gap between BlueSky's open reference implementation (handles a few hundred thousand users) and BlueSky's own production system (handles millions, but runs on infrastructure most teams can't replicate). Chris Beck and his team at Bitcrowd set out to close it -and ended up somewhere they didn't expect.

In this episode, Allen Wyma and Francesco Cesarini talk to Chris Beck, founder of Bitcrowd in Berlin, about building an open source alternative to BlueSky's data plane -the component that turns the AT Protocol firehose into the timeline you actually scroll through.

This is the third episode in our "right tool for the job" series, following Rust and Zig.

Topics include:

  • what the AT Protocol actually is, and why it's closer to an "operating system for social apps" than a single product

  • why BlueSky's own production solution (similar to Discord's MongoDB → Cassandra → ScyllaDB journey) is out of reach for smaller communities

  • the real numbers: 200-500 messages/second on a normal day, 6 million active users during the November 2024 US election

  • the hot path vs. cold path split that shaped the entire architecture

  • why Go, Rust, and Node were all evaluated and rejected -including why Node's single-threaded event loop was already a dead end for the BlueSky team themselves

  • why Elixir wasn't the expected choice, and what ETS gave them for free that they'd have had to hand-build everywhere else

  • using a Rust NIF via Rustler for roaring bitmaps to solve the "social proof" (mutual follows) feature -and what that NIF actually costs in terms of crash isolation

  • why losing almost every microbenchmark didn't matter once they asked "do we actually need to go there?"

  • the fan-out architecture that pushes messages directly into user mailboxes, and why that made backpressure a non-issue

  • what's left to build, and the one sentence Chris wants every team picking a stack to remember

Recorded June 15, 2026.

Tous les épisodes de BEAM There, Done That

Paramètres

Affichage

Langue

Détermine les stations affichées en premier sur la page d’accueil.

Historique

Les stations et épisodes écoutés récemment et tes dernières recherches sont seulement enregistrés dans ce navigateur.

Notifications

Un court message quand un podcast que tu suis publie un nouvel épisode. Désactive un podcast précis avec la cloche sur sa page.

Compte

Enregistrez vos favoris – dans l’app et sur le site.

Raccourcis clavier

/
Ouvrir la recherche
Espace
Lecture ou pause
← →
Dans le lecteur : 15 s en arrière, 30 s en avant (épisodes) · dans une rangée : tuile suivante
↑ ↓
Dans une rangée : cible dans la tuile
Début / Fin
Dans une rangée : première ou dernière tuile
Esc
Fermer la fenêtre ou le menu
?
Cet aperçu
En cours de lecture

Voir la station

À suivre

    Ajoutez des épisodes avec « À suivre » – ils seront lus après l'épisode en cours.