consumer_auto_offset_reset="latest" doesn't work
Author: Azrrael-exeCreated Oct 22, 2020Updated Sep 22, 2023
Checklist
- I have included information about relevant versions
- I have verified that the issue persists when using the
masterbranch of Faust.
Steps to reproduce
I am trying to develop a stream processor that doesn't require the previous messages using the offset.
app = faust.App(
id=settings.APP,
autodiscover=True,
origin="app",
broker="kafka://localhost:9092",
value_serializer="raw",
enable_sensors=True,
enable_web=True,
consumer_auto_offset_reset="latest"
)Expected behavior
Ignore the previous unprocessed messages.
Actual behavior
Proccess the whole history of the topic
Full traceback
N/A
Versions
- Python version: 3.8
- Faust version: 1.10.3
- Operating system: MacOs
- Kafka version: https://hub.docker.com/r/wurstmeister/kafka/dockerfile
- RocksDB version (if applicable)
Source: robinhood/faust