Kinesis enhanced fanout latency issue.

[sohaib-rasool]

I am using AWS SDK for C++ to develop a consumer for Kinesis Data Streams with enhanced fanout enabled. I'm utilizing SubscribeToShard() to receive data, and I've set an event handler using SetEventStreamHandler(). Additionally, I've built a custom record producer.

What I’ve noticed is that records are delivered to the event handler in batches. It appears the SDK waits until either a certain number of records have been received or a specific time threshold has passed before pushing the batch to the handler. For instance, when the producer sends a single record (a simple JSON with two string fields), it takes about 150 seconds to be processed by the event stream handler on the consumer side.

Furthermore, reviewing the AWS logs, I see that the SubscribeToShard request is being sent over HTTP/1.1, even though the documentation indicates it should be using HTTP/2.

SDK Version: 1.11.389
CURL: 7.81 with HTTP/2 enabled.

[bhavya2109sharma]

Hello @sohaib-rasool

This is the duplicate of the this issue.
Please follow there for updates.

Thanks
Bhavya

[github-actions[bot]]

Hello! Reopening this discussion to make it searchable.