Skip to content

Marketplace: scheduled topic discovery and hourly refresh #917

Closed

Description

@DoodleBears

Parent

#913 · #18

What to build

Authors no longer need to paste a URL: a repository that adds the botharness-bot topic appears in the Bot Marketplace after the next daily discovery, and listed entries stay current. Discovery runs a full GitHub topic search sliced by repository creation date so each slice stays under the 1,000-result cap (subdividing a slice that hits the cap). Refresh runs hourly through authenticated GraphQL nodes batches of 100 for stars, pushed_at, topics, description, visibility, archived state and head commit, refetching README only when pushed_at changed. Losing the topic, going private, archived or deleted hides an entry (row kept); a rename or transfer keeps the same entry; a failed batch keeps the last good data.

Acceptance criteria

  • Daily scheduled discovery adds new topic repositories and marks no-longer-matching ones hidden_missing.
  • Date slicing keeps every search below 1,000 results and subdivides a full slice.
  • Hourly refresh updates stars/pushed_at/topics/description/head commit in batches of 100 and refetches README only after a push change.
  • Topic removal, private, archived or deleted hides the entry; restoring the condition lists it again.
  • A renamed or transferred repository keeps its entry (node ID identity) with the new owner/name/URL.
  • A GitHub failure during a batch leaves existing rows untouched.
  • Worker boundary tests with a fake GitHub cover slicing, batching, hiding/restoring, rename and failure.

Blocked by

Activity

  1. added this to the v1.1 milestone on Oct 5, 2026
  2. added
    ready-for-agentFully specified, ready for an AFK agent
    area:fullstackEnd-to-end Host and Client implementation
    feature:registrySoulSnapshot registry and marketplace
    scope:tracerHuman-testable implementation slice
    on Oct 5, 2026
  3. DoodleBears commented on Oct 5, 2026

    @DoodleBears
    ContributorAuthor

    Agent work claim


    Generated by Claude Code

  4. added
    agent:activeOne or more coding-agent tasks currently claim this issue; see claim comments for task IDs
    on Oct 5, 2026
  5. DoodleBears commented on Oct 5, 2026

    @DoodleBears
    ContributorAuthor

    Outcome: shipped in #931 (squash cd9d749): a daily topic discovery sliced by creation date and an hourly GraphQL refresh. Vain approved merging on local checks, because CI never got a runner on either attempt. Next slices: #918 search and #919 README detail.


    Generated by Claude Code

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    agent:activeOne or more coding-agent tasks currently claim this issue; see claim comments for task IDsarea:fullstackEnd-to-end Host and Client implementationfeature:registrySoulSnapshot registry and marketplaceready-for-agentFully specified, ready for an AFK agentscope:tracerHuman-testable implementation slice

    Type

    No type

    Projects

    • Status
      Done

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions