feat(streaming): add SQS data adapters and FIFO support
Merged
JA
2mo ago+1542+1542+0123456789012345678901234567890123456789-218-218-012345678901234567890123456789
The EventHub StreamProvider has a concept of a DataAdapter, where the user can inject their own implemention to parse messages for the queue, specifically for the purpose of picking up messages from sources that are not Orleans, and have not already passed through the StreamProvider.
I am attempting to implement this in the SQS provider, as I need similar functionality.
Request for comments / code review on this PR, I need to pull some more data out to configuration still.
The first commit was required to get the SQS tests passing, before I moved on to the commit with the Data Adapter change.
Contract changes:
- SQSBatchContainer changed from
internaltopublic(as the DataAdapter needs to construct one, this is crux of the change). - SQSBatchContainer.ctor changed from
internaltopublicas it is the only method of passing a SequenceToken to the object.
Alternative approach, would be to have the consumer implement an IBatchContainer but it would be nice to have a default one.