Skip to content

Measure exhaustive ranking and filtered top-k completion - #37

Merged
bweis merged 4 commits into
mainfrom
research/filter-candidate-selection
Sep 19, 2026
Merged

bweis merged 4 commits into
mainfrom
research/filter-candidate-selection

Conversation

@bweis

@bweis bweis commented Sep 19, 2026

Copy link
Copy Markdown
Contributor

Ranked scans score candidates before residual SQL filters; when a filter rejects the pruned prefix, the scan completes the exhaustive ordering. Expose cumulative Exhaustive Score Calls and Top-K Completions in EXPLAIN ANALYZE so benchmarks can distinguish that work from successful pruning. This adds no execution strategy or on-disk change.

Adds a regression covering ordinary top-k (zero exhaustive calls), a filter rejecting the initial prefix (1,000 exhaustive calls and one completion), and unprunable phrase scoring (1,000 calls without completion). Includes a scoped filter-before-scoring design with HOT/MVCC/security constraints and paired benchmark gates.

Validation: native rustfmt check, git diff --check, and 113 Python harness tests passed after rebasing onto PR #36 at 076a05f. PostgreSQL integration test awaits CI; no local Rust builds or timings ran while the paired benchmark uses the machine.

Stack: PR #31#32#36#37. This PR is based on the runtime-bound work in #36; its diff contains only the design and counters/tests.

@bweis
bweis force-pushed the research/filter-candidate-selection branch from 660b138 to dbea73e Compare September 19, 2026 22:43
@bweis
bweis changed the base branch from perf/generic-ranked-plans to perf/runtime-ranked-bounds September 19, 2026 22:43
@bweis
bweis added this pull request to stack #33 September 19, 2026 22:44
@bweis
bweis force-pushed the research/filter-candidate-selection branch from 7785cd6 to 274859d Compare September 19, 2026 22:50
@bweis
bweis marked this pull request as ready for review September 19, 2026 22:57
@bweis
bweis force-pushed the research/filter-candidate-selection branch from d42e9dc to 10269ca Compare September 19, 2026 23:03
Base automatically changed from perf/runtime-ranked-bounds to main September 19, 2026 23:12
@bweis
bweis force-pushed the research/filter-candidate-selection branch from 298805c to 661d238 Compare September 19, 2026 23:12
@bweis
bweis merged commit 68a0cb0 into main Sep 19, 2026
18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant