Skip to content

Instrument the auth path: time to first login, deliverability, drop-off, device class #154

Description

@Bccorb

seamless-idea-api/AGENTS.md makes an argument this repository is the only
place that can act on:

Every generated application is also a live Seamless Auth deployment, which is
the strategic point. Personal software is better traffic than validation apps
were: twelve family members signing in for three years exercises
deliverability, cross-device magic links, expired links and password managers
far harder than five reviewers touching an app once.

Instrument this from day one. That telemetry, not the generated apps
themselves, is what converts skeptical technical buyers to Seamless Auth.

None of it can be backfilled. Every sign in that happens before the
instrumentation exists is a reading thrown away, and the Seamless Idea fleet is
about to start producing them.

The four measurements

Measurement Why it is the one that matters
Time to first login The whole passwordless claim, in one number
Deliverability by mail provider The failure mode buyers actually fear, and the one no competitor publishes
Drop off per step Where a real person gives up, as opposed to where we assume they do
Failure rate by device class Where passkeys and magic links genuinely differ, rather than in theory

Two audiences, one dataset

Internally this is the input to the north star for Seamless Idea, which is
whether somebody other than the owner signed in during week four. That query
needs per deployment sign in events with an owner flag, so the shape of what is
recorded here decides whether that question is answerable at all.

Externally it is a sales asset. Published operational telemetry across a fleet
of real deployments is something nobody else in this market can produce, and it
is aimed at exactly the sceptical technical buyer who does not believe managed
auth marketing. seamless-idea-api/AGENTS.md is explicit that this is what to
publish, rather than a gallery of generated applications.

Constraints

Whatever is recorded has to survive being published, which argues for
aggregates and provider names rather than addresses, and for a deliberate
decision about retention before the first row exists rather than after.

Done when

One query answers "how many logins, across how many deployments, at what
success rate", broken down by mail provider and device class, and the first
shared idea application produces rows in it.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    P4Features and enhancementsenhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions