...
Kafka Consumer and Offset
The offset is the critical value that enables consumer to operate independently by representing the last read position the consumer has read from a partition within a topic.
3 categories of offsets:
last committed offset : last record that consumer has confirmed to have processed.
current position : consumer tracks its current position.
log-end offset : this position advances as consumer advances in the log towards the last record in the partition which is know as the log end offset.