Distributed Systems Engineering with Apache Kafka ft. Roger Hoover
Streaming Audio: Apache Kafka® & Real-Time Data
English - November 18, 2020 14:00 - 50 minutes - 69.3 MB - ★★★★★ - 33 ratingsTechnology Education How To apache kafka confluent event stream processing cloud real-time data event driven architecture open source data in motion kafka cloud native Homepage Download Apple Podcasts Google Podcasts Overcast Castro Pocket Casts RSS feed
Roger Hoover, one of the first engineers to work on Confluent Cloud, joins Tim Berglund (Senior Director of Developer Experience, Confluent) to chat about the evolution of Confluent Cloud, all the stages that it’s been through, and the lessons he’s learned on the way. He talks through the days before Confluent Platform was created, and how he contributed to Apache Kafka® to run it on OpenStack (the feature used to separate advertised hostnames from the internal hostnames).
The Confluent Cloud control plane is now run in over 40 regions. Under the covers, Roger and his team are managing tens of thousands of resources at the cloud provider layer. This means creating VPCs, VMs, volumes, and DNS records, to manage software artifacts, like what version of Kafka is running and user management. Confluent Cloud is a complex application and distributed system spread across the entire world, but Roger reveals how it's done.
EPISODE LINKS
Building Confluent Cloud – Here’s What We’ve Learned Join the Confluent Community SlackLearn more with Kafka tutorials, resources, and guides at Confluent DeveloperLive demo: Kafka streaming in 10 minutes on Confluent CloudUse 60PDCAST to get an additional $60 of free Confluent Cloud usage (details)