Skip to content

fix: Date filter not persisting when there are multiple pages to fetch - #77

Open
pedroceriotti wants to merge 6 commits into
MeltanoLabs:mainfrom
nektcom:main
Open

fix: Date filter not persisting when there are multiple pages to fetch#77
pedroceriotti wants to merge 6 commits into
MeltanoLabs:mainfrom
nektcom:main

Conversation

@pedroceriotti

Copy link
Copy Markdown

Bugfix

Timestamp filter for DynamicIncrementalHubspotStream was not being persisted across multiple requests. The side effect of that is an infinite loop while fetching records, since the timestamp filter was only being updated on the first call after hitting 10k records and then coming back to the initial state from the second page onwards.

@edgarrmondragon
edgarrmondragon self-requested a review September 18, 2024 01:56
@edgarrmondragon

Copy link
Copy Markdown
Member

@pedroceriotti let me know when this is ready for review

cc @pnadolny13

@ReubenFrankel

Copy link
Copy Markdown
Contributor

Think this is covered by #164 now. Would be good to add the limit change in a separate PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants