feat(streaming): add AWS Kinesis streaming provider - #8967
Conversation
|
this is what I've been waiting for. thanks :) |
30ea2c9 to
be54597
Compare
|
CI build failing due to missing package even though the package can be selected from that feed locally.
|
@ReubenBond |
|
Just wanted to check in and see if there’s been any progress on this. It’s something I’ve been hoping to have for a while. |
be54597 to
60e3a69
Compare
|
I can see some recent activity on this PR, I'm currently using SQS, and a custom PR for SQS FIFO. If someone is able to provide a list of outstanding tasks on this PR, I can provide resource to get this over the line. |
|
Has this been parked? For my project Kinesis integration would be very useful |
9987089 to
7450710
Compare
ReubenBond
changed the title
8363494 to
2c62e19
Compare
ebff2fd to
4f85407
Compare
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 3f5060d4-b229-476c-bdf3-9923ad459bb2
Add optimistic DynamoDB checkpoint persistence and flow cancellation through persistent stream initialization, reads, and checkpoint operations. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 3f5060d4-b229-476c-bdf3-9923ad459bb2
Add provider guidance and an AWS sample using DynamoDB for clustering, grain storage, reminders, pub-sub storage, and stream checkpointing. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 3f5060d4-b229-476c-bdf3-9923ad459bb2
4f85407 to
e4e73b8
Compare
6 participants
Relates to #8966
Adds a persistent stream provider for AWS Kinesis using the AWS .NET SDK directly, without requiring the JVM-based Kinesis Client Library. The provider includes client and silo configuration, shard discovery and topology monitoring, durable iterator recovery, DynamoDB-backed checkpointing, provider-specific tests and CI coverage, documentation, and an AWS sample.
The cross-cutting persistent-stream cancellation APIs and Event Hubs adoption were merged separately in #10383. This PR now contains only the AWS provider and its supporting tests, CI, documentation, and sample changes.