crates/models: resolve capture interval from the connector tag - #3333
crates/models: resolve capture interval from the connector tag#3333nicolaslazo wants to merge 1 commit into
Conversation
`connector_tags.default_capture_interval` has existed for a long time but nothing ever applied it. `interval` becomes `Option<Duration>`, with unset meaning "resolve at build time". If the model does not provide its own `interval`, then the connector tag's takes precedence over the global fallback. Build-time resolution costs propagation latency: a changed tag default reaches an existing capture only when that capture is next built. That happens automatically within twenty days via the periodic touch publication, and sooner if anything else republishes the task.
|
馃殌 Preview deployed to https://docs.estuary.dev/pr-preview/pr-3333/ 馃搫 Changed pages: |
|
What about resolving this from the Spec response, Open response, or an image label? For example we change validation semantics so that "unset" propagates down into the built spec, and then have the reactor choose the restart interval through a negotiation with the started connector. It seems circuitous to have |
|
Docs have moved, and this PR straddles the split. The code belongs here; the
Suggested split:
Flagging it because the doc half would otherwise merge into a tree nobody Context: migration announcement. |
Description:
connector_tags.default_capture_intervalhas existed for a long time but nothing ever applied it.intervalbecomesOption<Duration>, with unset meaning "resolve at build time". If the model does not provide its owninterval, then the connector tag's takes precedence over the global fallback.Build-time resolution costs propagation latency: a changed tag default reaches an existing capture only when that capture is next built. That happens automatically within twenty days via the periodic touch publication, and sooner if anything else republishes the task.
Workflow steps:
(How does one use this feature, and how has it changed)
Documentation links affected:
(list any documentation links that you created, or existing ones that you've identified as needing updates, along with a brief description)
Notes for reviewers:
Tested locally using unit tests.