Taking Apache Kafka® to the Edge
K R Avinash Upadhyaya, Platformatory Labs
Thu, Nov 5, 10:30–11:15 AMMeet-Up Hub
AI-powered devices are generating more data at the edge, but sending everything to the cloud is expensive and difficult when connectivity is unreliable. This session explores how Apache Kafka® can run closer to these devices, either as a gateway or an embedded server.
We’ll look at single-node setups designed for unreliable networks, support for protocols like MQTT and HTTP, and ways to process and reduce data locally before sending it upstream. The approach is simple: stream, buffer, aggregate, and forward. We’ll also cover how to connect multiple edge locations to a central system.
Speaker
-
K R Avinash Upadhyaya
Senior Data Platform Engineer, Platformatory Labs
Avinash is a platform engineer and an experienced consultant helping business deploy, scale and architect data platforms using open source technologies such as Apache Kafka, Apache Flink, Kubernetes, etc. He is an avid technical evangelist, advocating for open source technologies in local communities through meetups and conferences. He helps run multiple local communities around data streaming, including Apache Kafka, Apache Flink, and Apache Druid/Pinot, among others. Apart from consulting, Avinash is an open source contributor with contributions to various projects in the CNCF ecosystem.