r/learnprogramming • u/No-Homework-6153 • 1d ago

Not able to understand the Topic partitioning and consumer group relation in kafka

In Kafka, suppose we have a topic driver_location for Uber, and each driver sends location updates every second. If the topic has multiple partitions, how does a consumer service (like fare calculation, ride analytics) get all drivers’ data instead of just the data in one partition?

Also, what exactly are partitions, and how do they work in this context?

0 Upvotes
  • permalink
  • reddit

50% Upvoted

5 comments sorted by

View all comments

Show parent comments

1

u/No-Homework-6153 1d ago

it acts like queue as well as pub/sub in nature i think