Interactive visualization of how Apache Kafka works
Topic = A named feed/channel. Like a database table name. Producers write to it, consumers read from it.
Partition = A topic is split into partitions for parallelism. Each partition is an ordered, immutable log. Messages within a partition keep their order.
Consumer Group = A team of consumers that share the work. Each partition is assigned to exactly ONE consumer in the group. This means each message is processed only once per group.
Without a Group (Standalone) = Each consumer reads ALL partitions independently. Every consumer sees EVERY message. Like a broadcast.
๐ก Key insight: With consumer groups, adding more consumers (up to partition count) increases throughput. Beyond that, extra consumers sit idle. Without groups, adding consumers just duplicates processing.