How to start reading from a specified offset

[chidavearch]

How can I start reading topic messages from a certain point using the Azure trigger? I've seen an explanation of how to do this using the --offset flag, but the trigger doesn't expose that. Also, how can I access the current offset value at all? I had expected to see it in the event json.
I'm building a new integration for an existing topic and definitely do not want to get all previous messages (for whatever this client's retention period is). This is my first effort working with Kafka.

Thanks

[chidavearch]

Update: my understanding is that this needs to be done at the broker.

[smitty-codes]

@chidavearch According to this project's wiki, the offset is stored on the broker as you discovered - https://github.com/Azure/azure-functions-kafka-extension/wiki#q2-where-is-kafkas-offset-stored.

I was coming at this problem with experience with Azure Event Hubs (AEH). In AEH, the offset is automatically check-pointed to Azure Blob storage. To override it, you delete this file and then use an override method during AF startup - see this SO post https://stackoverflow.com/a/61319901/194872.

Both approaches have pros/cons but it would be nice if this library offered both options (i.e. the consumer can set its own offset position instead of having to set it on the broker).