meltano/sdk

feat: Make `Stream.get_starting_*()` methods return `None` for full-table replication streams

Closed this issue · 0 comments

Feature scope

Taps (catalog, state, stream maps, tests, etc.)

Description

If a user leverages the Singer catalog to change the default replication method of a stream from incremental to full-table, the hard-coded calls to get_starting_*() remain, and a bookmark is retrieved if it's available in the state and may cause results to be filtered, which goes against the intent of forcing full-table replication.

Workarounds

Users can manually edit the state to remove the bookmark of the stream in question.

Refs