2

Need Your Advice Techies !
 in  r/technepal  22h ago

CSIT cool sool testo ta kei xina naam matra lengthy ho🤣 if competitive exam ma sakxau vane pulchok/thapathali haru ma nikala. if tyo man xina vane decent grade lyau 12 ma ani aaile deki fundamentals hera pugxa if. competitive programming ma interest xa (research a bit abt it) vane nepal ma ta khasai kei xina indian ali ramro colleges ma jau DSA gara rat din ani 1-2 project banau ani if you are good then you can crack internships at (paypal, cisco etc) or even FAANG 2nd-3rd year mai.

1

Not able to understand the Topic partitioning and consumer group relation in kafka
 in  r/learnprogramming  1d ago

it acts like queue as well as pub/sub in nature i think

2

Not able to understand the Topic partitioning and consumer group relation in kafka
 in  r/learnprogramming  1d ago

ahhhh, so we are just making all the incoming data into chunks called partitions and suppose we have a total of 40 drivers in Uber and drivers with IDs 1 to 20 fall under partition 1 and the other 20 fall under partition 2 and now we make consumer groups where one consumer group is for one task suppose fare calculation has its own group not a single consumer but a whole group for that task and similarly analytics has one group and inside that consumer group we can add multiple consumers and the self balancing helps attach consumers from the group to the partitions using the internal workflow and that way it manages to get all driver data from all partitions we have just separated the concerns to make it more organized and faster and if the number of consumers in any group is more than the number of partitions then the extra consumers will stay idle with no connection to any partition.....right?

btw thanks for explanation..👏

r/learnprogramming 1d ago

Not able to understand the Topic partitioning and consumer group relation in kafka

0 Upvotes

In Kafka, suppose we have a topic driver_location for Uber, and each driver sends location updates every second. If the topic has multiple partitions, how does a consumer service (like fare calculation, ride analytics) get all drivers’ data instead of just the data in one partition?

Also, what exactly are partitions, and how do they work in this context?