Latest Event stream processing Podcast Episodes
Intro to Kafka Connect: Core Components and Architecture ft. Robin Moffatt
Streaming Audio: Apache Kafka® & Real-Time Data - September 28, 2021 07:00 - 31 minutes ★★★★★ - 33 ratingsKafka Connect is a streaming integration framework between Apache Kafka® and external systems, such as databases and cloud services. With expertise in ksqlDB and Kafka Connect, Robin Moffatt (Staff Developer Advocate, Confluent) helps and supports the developer community in understanding Kafka a...
Designing a Cluster Rollout Management System for Apache Kafka ft. Twesha Modi
Streaming Audio: Apache Kafka® & Real-Time Data - September 23, 2021 07:00 - 30 minutes ★★★★★ - 33 ratingsAs one of the top coders of her Java coding class in high school, Twesha Modi is continuing to follow her passion for computer science as a senior at Cornell University, where she has proven to be one of the top programmers. During Twesha's summer internship at Confluent, she contributed to desi...
Designing a Cluster Rollout Management System for Apache Kafka ft. Twesha Modi
Streaming Audio: Apache Kafka® & Real-Time Data - September 23, 2021 07:00 - 30 minutes ★★★★★ - 33 ratingsAs one of the top coders of her Java coding class in high school, Twesha Modi is continuing to follow her passion for computer science as a senior at Cornell University, where she has proven to be one of the top programmers. During Twesha's summer internship at Confluent, she contributed to desi...
Apache Kafka 3.0 - Improving KRaft and an Overview of New Features
Streaming Audio: Apache Kafka® & Real-Time Data - September 21, 2021 15:00 - 15 minutes ★★★★★ - 33 ratingsApache Kafka® 3.0 is out! To spotlight major enhancements in this release, Tim Berglund (Apache Kafka Developer Advocate) provides a summary of what’s new in the Kafka 3.0 release from Krakow, Poland, including API changes and improvements to the early-access Kafka Raft (KRaft). KRaft is a bui...
How to Build a Strong Developer Community with Global Engagement ft. Robin Moffatt and Ale Murray
Streaming Audio: Apache Kafka® & Real-Time Data - September 14, 2021 07:00 - 35 minutes ★★★★★ - 33 ratingsA developer community brings people with shared interests and purpose together. The fundamental elements of a community are to gather, learn, support, and create opportunities for collaboration. A developer community is also an effective and efficient instrument for exploring and solving problem...
What Is Data Mesh, and How Does it Work? ft. Zhamak Dehghani
Streaming Audio: Apache Kafka® & Real-Time Data - September 09, 2021 07:00 - 34 minutes ★★★★★ - 33 ratingsThe data mesh architectural paradigm shift is all about moving analytical data away from a monolithic data warehouse or data lake into a distributed architecture—allowing data to be shared for analytical purposes in real time, right at the point of origin. The idea of data mesh was introduced by...
What Is Data Mesh, and How Does it Work? ft. Zhamak Dehghani
Streaming Audio: Apache Kafka® & Real-Time Data - September 09, 2021 07:00 - 34 minutes ★★★★★ - 33 ratingsThe data mesh architectural paradigm shift is all about moving analytical data away from a monolithic data warehouse or data lake into a distributed architecture—allowing data to be shared for analytical purposes in real time, right at the point of origin. The idea of data mesh was introduced by...
Multi-Cluster Apache Kafka with Cluster Linking ft. Nikhil Bhatia
Streaming Audio: Apache Kafka® & Real-Time Data - August 31, 2021 07:00 - 31 minutes ★★★★★ - 33 ratingsNote: This episode was recorded when Cluster Linking was in preview mode. It’s now generally available as part of the Confluent Q3 ‘21 release on August 17, 2021. Infrastructure needs to react in real time to support globally distributed events, such as cloud migration, IoT, edge data collecti...
Multi-Cluster Apache Kafka with Cluster Linking ft. Nikhil Bhatia
Streaming Audio: Apache Kafka® & Real-Time Data - August 31, 2021 07:00 - 31 minutes ★★★★★ - 33 ratingsNote: This episode was recorded when Cluster Linking was in preview mode. It’s now generally available as part of the Confluent Q3 ‘21 release on August 17, 2021. Infrastructure needs to react in real time to support globally distributed events, such as cloud migration, IoT, edge data collecti...
Using Apache Kafka and ksqlDB for Data Replication at Bolt
Streaming Audio: Apache Kafka® & Real-Time Data - August 26, 2021 07:00 - 29 minutes ★★★★★ - 33 ratingsWhat does a ride-hailing app that offers micromobility and food delivery services have to do with data in motion? In this episode, Ruslan Gibaiev (Data Architect, Bolt) shares about Bolt’s road to adopting Apache Kafka® and ksqlDB for stream processing to replicate data from transactional databa...
Placing Apache Kafka at the Heart of a Data Revolution at Saxo Bank
Streaming Audio: Apache Kafka® & Real-Time Data - August 19, 2021 07:00 - 28 minutes ★★★★★ - 33 ratingsMonolithic applications present challenges for organizations like Saxo Bank, including difficulties when it comes to transitioning to cloud, data efficiency, and performing data management in a regulated environment. Graham Stirling, the head of data platforms at Saxo Bank and also a self-procla...
Advanced Stream Processing with ksqlDB ft. Michael Drogalis
Streaming Audio: Apache Kafka® & Real-Time Data - August 11, 2021 07:00 - 28 minutes ★★★★★ - 33 ratingsksqlDB makes it easy to read, write, process, and transform data on Apache Kafka®, the de facto event streaming platform. With simple SQL syntax, pre-built connectors, and materialized views, ksqlDB’s powerful stream processing capabilities enable you to quickly start processing real-time data a...
Minimizing Software Speciation with ksqlDB and Kafka Streams ft. Mitch Seymour
Streaming Audio: Apache Kafka® & Real-Time Data - August 05, 2021 07:00 - 31 minutes ★★★★★ - 33 ratingsBuilding a large, stateful Kafka Streams application that tracks the state of each outgoing email is crucial to marketing automation tools like Mailchimp. Joining us today in this episode, Mitch Seymour, staff engineer at Mailchimp, shares how ksqlDB and Kafka Streams handle the company’s larges...
Collecting Data with a Custom SIEM System Built on Apache Kafka and Kafka Connect ft. Vitalii Rudenskyi
Streaming Audio: Apache Kafka® & Real-Time Data - July 27, 2021 07:00 - 25 minutes ★★★★★ - 33 ratingsThe best-informed business insights that support better decision-making begin with data collection, ahead of data processing and analytics. Enterprises nowadays are engulfed by data floods, with data sources ranging from cloud services, applications, to thousands of internal servers. The massive...
Collecting Data with a Custom SIEM System Built on Apache Kafka and Kafka Connect ft. Vitalii Rudenskyi
Streaming Audio: Apache Kafka® & Real-Time Data - July 27, 2021 07:00 - 25 minutes ★★★★★ - 33 ratingsThe best-informed business insights that support better decision-making begin with data collection, ahead of data processing and analytics. Enterprises nowadays are engulfed by data floods, with data sources ranging from cloud services, applications, to thousands of internal servers. The massive...
Consistent, Complete Distributed Stream Processing ft. Guozhang Wang
Streaming Audio: Apache Kafka® & Real-Time Data - July 22, 2021 07:00 - 29 minutes ★★★★★ - 33 ratingsStream processing has become an important part of the big data landscape as a new programming paradigm to implement real-time data-driven applications. One of the biggest challenges for streaming systems is to provide correctness guarantees for data processing in a distributed environment. Guozh...
Powering Real-Time Analytics with Apache Kafka and Rockset
Streaming Audio: Apache Kafka® & Real-Time Data - July 15, 2021 07:00 - 25 minutes ★★★★★ - 33 ratingsUsing large amounts of streaming data increasingly requires interactive, real-time analytics and dashboards—and this applies to any industry, including tech. CTO and Co-Founder of Rockset Dhruba Borthakur shares how his company uses Apache Kafka® to perform complex joins, search, and aggregation...
Automated Event-Driven Architectures and Microservices with Apache Kafka and SmartBear
Streaming Audio: Apache Kafka® & Real-Time Data - July 08, 2021 07:00 - 29 minutes ★★★★★ - 33 ratingsIs it possible to have automated adoption of your event-driven architectures and microservices? The answer is yes! Alianna Inzana, product leader for API testing and virtualization at SmartBear, uses this evolutionary model to make event services reusable, functional, and strategic for both in-h...
Data-Driven Digitalization with Apache Kafka in the Food Industry at BAADER
Streaming Audio: Apache Kafka® & Real-Time Data - June 29, 2021 07:00 - 27 minutes ★★★★★ - 33 ratingsComing out of university, Patrick Neff (Data Scientist, BAADER) was used to “perfect” examples of datasets. However, he soon realized that in the real world, data is often either unavailable or unstructured. This compelled him to learn more about collecting data, analyzing it in a smart and au...
Chaos Engineering with Apache Kafka and Gremlin
Streaming Audio: Apache Kafka® & Real-Time Data - June 22, 2021 07:00 - 35 minutes ★★★★★ - 33 ratingsThe most secure clusters aren’t built on the hopes that they’ll never break. They are the clusters that are broken on purpose and with a specific goal. When organizations want to avoid systematic weaknesses, chaos engineering with Apache Kafka® is the route to go. Your system is only as reliab...
Boosting Security for Apache Kafka with Confluent Cloud Private Link ft. Dan LaMotte
Streaming Audio: Apache Kafka® & Real-Time Data - June 15, 2021 07:00 - 25 minutes ★★★★★ - 33 ratingsConfluent Cloud isn’t just for public access anymore. As the requirement for security across sectors increases, so does the need for virtual private cloud (VPC) connections. It is becoming more common today to come across Apache Kafka® implementations with the latest private link connectivity op...
Confluent Platform 6.2 | What’s New in This Release + Updates
Streaming Audio: Apache Kafka® & Real-Time Data - June 10, 2021 14:00 - 9 minutes ★★★★★ - 33 ratingsBased on Apache Kafka® 2.8, Confluent Platform 6.2 introduces Health+, which offers intelligent alerting, cloud-based monitoring tools, and accelerated support so that you can get notified of potential issues before they manifest as critical problems that lead to downtime and business disruption...
Adopting OpenTelemetry in Confluent and Beyond ft. Xavier Léauté
Streaming Audio: Apache Kafka® & Real-Time Data - June 08, 2021 07:00 - 32 minutes ★★★★★ - 33 ratingsCollecting internal, operational telemetry from Confluent Cloud services and thousands of clusters is no small feat. Stakeholders need to rely on the same data to make operational decisions. Whether it be metrics from clusters in Confluent Cloud or traces from our internal service, they all prov...
Running Apache Kafka Efficiently on the Cloud ft. Adithya Chandra
Streaming Audio: Apache Kafka® & Real-Time Data - May 25, 2021 09:00 - 38 minutes ★★★★★ - 33 ratingsFocused on optimizing Apache Kafka® performance with maximized efficiency, Confluent’s Product Infrastructure team has been actively exploring opportunities for scaling out Kafka clusters. They are able to run Kafka workloads with half the typical memory usage while saving infrastructure costs, ...
Engaging Database Partials with Apache Kafka for Distributed System Consistency ft. Pat Helland
Streaming Audio: Apache Kafka® & Real-Time Data - May 20, 2021 13:00 - 42 minutes ★★★★★ - 33 ratingsWhen compiling database reports using a variety of data from different systems, obtaining the right data when you need it in real time can be difficult. With cloud connectivity and distributed data pipelines, Pat Helland (Principal Architect, Salesforce) explains how to make educated partial ans...
The Truth About ZooKeeper Removal and the KIP-500 Release in Apache Kafka ft. Jason Gustafson and Colin McCabe
Streaming Audio: Apache Kafka® & Real-Time Data - May 13, 2021 13:00 - 31 minutes ★★★★★ - 33 ratingsJason Gustafson and Colin McCabe, Apache Kafka® developers, discuss the project to remove ZooKeeper—now known as the KRaft (Kafka on Raft) project. A previous episode of Streaming Audio featured both developers on the podcast before the release of Apache Kafka 2.8. Now they’re back to share thei...
Resilient Edge Infrastructure for IoT Using Apache Kafka ft. Kai Waehner
Streaming Audio: Apache Kafka® & Real-Time Data - May 04, 2021 13:00 - 27 minutes ★★★★★ - 33 ratingsWhat is the internet of things (IoT), and how does it relate to event streaming and Apache Kafka®? The deployment of Kafka outside the datacenter creates many new possibilities for processing data in motion and building new business cases. In this episode, Kai Waehner, field CTO and global tech...
Data Management and Digital Transformation with Apache Kafka at Van Oord
Streaming Audio: Apache Kafka® & Real-Time Data - April 29, 2021 13:00 - 28 minutes ★★★★★ - 33 ratingsImagine if you could create a better world for future generations simply by delivering marine ingenuity. Van Oord is a Dutch family-owned company that has served as an international marine contractor for over 150 years, focusing on dredging, land infrastructure in the Netherlands, and offshore...
Powering Microservices Using Apache Kafka on Node.js with KafkaJS at Klarna ft. Tommy Brunn
Streaming Audio: Apache Kafka® & Real-Time Data - April 22, 2021 13:00 - 31 minutes ★★★★★ - 33 ratingsAt Klarna, Lead Engineer Tommy Brunn is building a runtime platform for developers. But outside of his professional role, he is also one of the authors of the JavaScript client for Apache Kafka® called KafkaJS, which has grown from being a niche open source project to the most downloaded Kafka c...
Apache Kafka 2.8 - ZooKeeper Removal Update (KIP-500) and Overview of Latest Features
Streaming Audio: Apache Kafka® & Real-Time Data - April 19, 2021 15:00 - 10 minutes ★★★★★ - 33 ratingsApache Kafka 2.8 is out! This release includes early access to the long-anticipated ZooKeeper removal encapsulated in KIP-500, as well as other key updates, including the addition of a Describe Cluster API, support for mutual TLS authentication on SASL_SSL listeners, exposed task configurations ...
Related Event stream processing Topics