Data Goes Real-Time with Apache Kafka | Ep. 12

Keyboard and Quill

May 1 2024 • 42 mins

In this penultimate episode of Season 1 of "Keyboard and Quill," hosts Tim Berglund and Rachel Pedreschi delve into the world of Apache Kafka, the invisible data powerhouse behind many of the apps we use daily like LinkedIn, Uber, and DoorDash. They take us back to 2010, a pivotal year when the internet became more than just a convenience—it became a staple of daily life, with more and more homes connected to broadband and smartphones becoming increasingly prevalent. This technological surge set the stage for innovations like ride-sharing and meal delivery services, which rely on constant data streams to function smoothly. Our hosts discuss how Kafka, initially developed within the walls of LinkedIn, has grown to be central to the operations of numerous companies large and small, managing the flow of data with unprecedented efficiency. This episode not only highlights the technical breakthroughs but also contextualizes them within the broader narrative of digital acceleration, making us ponder how such innovations continue to reshape our interactions and expectations in a world that moves faster by the day.

Keyboard and Quill is created and made possible by StarTree, hosts of the Real-Time Analytics Summit for data professionals. Get 30% off registration.

SPECIAL THANKS TO:

Rachel Pedreschi and Claritype
Link: https://www.claritype.com

Jay Kreps
Link: https://confluent.io

Gwen Shapira
Link: https://www.thenile.dev

Coastal Kites for the music you heard in our interlude.

--
Story by Tim Berglund and Rachel Pedreschi
Produced by Peter Furia, Noelle Gallagher, and Tim Berglund
Edited by Noelle Gallagher and Peter Furia
Original music and sound by Jeff Kite, keyboardist for The Voidz

You Might Like

Acquired
Acquired
Ben Gilbert and David Rosenthal
Hard Fork
Hard Fork
The New York Times
Darknet Diaries
Darknet Diaries
Jack Rhysider
Marketplace Tech
Marketplace Tech
Marketplace
Search Engine
Search Engine
PJ Vogt, Audacy, Jigsaw
WSJ’s The Future of Everything
WSJ’s The Future of Everything
The Wall Street Journal
Rich On Tech
Rich On Tech
Rich DeMuro
TechStuff
TechStuff
iHeartPodcasts
The Vergecast
The Vergecast
The Verge
Waveform: The MKBHD Podcast
Waveform: The MKBHD Podcast
Vox Media Podcast Network