Skip to content
View moudrkat's full-sized avatar

Block or report moudrkat

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please donโ€™t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this userโ€™s behavior. Learn more about reporting abuse.

Report abuse
moudrkat/README.md

Hey, I'm Kate ๐Ÿ‘‹

AI Engineer โ€ข Former Particle Physicist โš›๏ธ โ€ข Former Risk Modeler ๐Ÿ“ˆ

I've spent my whole career looking inside systems that would rather stay opaque โ€” first particle collisions, then risk models, now neural networks.

The models talk to us all day. I want to be able to affect them back.

So I build tools that make neural networks less mysterious โ€” because interpretability shouldn't stay in research papers, it belongs in production. (And in zombie games. And in mushroom generators. You'll see.)

The house rules, in every repo: each experiment ships with a placebo control, its negative results stay published, and when a finding turns out to be about my own instrument instead of the model, that page says so. Half the fun is the honest notes.

Naming things is 10% of the work and 90% of the joy

the-paper-that-remembers-itself ยท steeropathy ยท multi-shroomed-bandit ยท once-upon-256-dim ยท sample-me-softly-with-this-prompt ยท the-shroomifier ยท attack-on-applepear

(Every one of those is a real, running project. I trained several of them on my laptop CPU, because why not.)

๐Ÿ’ฅ Come say hi in my collision chamber

My personal site is a chat with a tiny LLM running entirely in your browser, and every answer it generates renders as a real particle collision. Click the event below to fire your own question into the chamber:

One question fired into the chamber: the model answers while its layers, attention heads and logit-lens flips render as a real collision.

๐Ÿš€ How my projects fit together

One engine for looking inside a model, one factory for the directions it steers with, and the experiments that run on both. Click any box to open its repo.

flowchart TD
    hd["๐Ÿงญ <b>hidden-directions</b><br/>turn a behavior into a vector โ€”<br/>inject it, bake it into the weights,<br/>or catch a bake"]
    bs(["๐Ÿง  <b>brainscope</b><br/>watch a model think: an OpenAI-compatible server<br/>with a live view into the residual stream<br/>โ€” logit lens ยท attention ยท J-lens ยท live steering"])
    st["๐Ÿ•น๏ธ <b>steeropathy</b><br/>agents that talk through activations<br/>and J-space, never text โ€” moods, concepts,<br/>a zombie outbreak fought by mind-reading"]
    tm["โš–๏ธ <b>in-two-minds</b><br/>catch an agent hesitating between two tools,<br/>in its activations before it commits"]

    hd -->|"directions &<br/>baked personas"| bs
    bs -->|"hosts the model,<br/>captures activations"| st
    bs -->|"hosts the model,<br/>captures activations"| tm
    st -.->|"steers with"| hd

    click hd "https://github.com/moudrkat/hidden-directions"
    click bs "https://github.com/moudrkat/brainscope"
    click st "https://github.com/moudrkat/steeropathy"
    click tm "https://github.com/moudrkat/in-two-minds"

    classDef engine fill:#1f6feb,stroke:#1158c7,color:#ffffff;
    classDef exp fill:#8957e5,stroke:#6e40c9,color:#ffffff;
    class bs,hd engine;
    class st,tm exp;
Loading

The two blue boxes are the instrument. brainscope hosts any Hugging Face model and streams its internals to the browser; hidden-directions makes the steering vectors โ€” and bakes them into weights, then audits for the bake. The two purple boxes are experiments run under that lens. steeropathy wires agents together through activations instead of text; in-two-minds catches an agent hesitating between tools before it commits.


๐Ÿ”ฌ Also on the bench

Smaller, self-contained ways to look inside:

  • ๐Ÿ“œ paper-remembers โ€” Hopfield's 1982 paper, running live: rub out any part of the page and watch it rebuild itself
  • ๐ŸŽฌ green-room โ€” a multi-character agent has already cast the scene before it writes a word of dialogue; see it in the activations, then recast it
  • ๐ŸŽญ sixteen-voices โ€” how a tiny transformer encodes writing style, through LoRA adapters and attention heads
  • ๐Ÿ‘๏ธ show-me-your-attention โ€” attention maps and neuron activations over your own prompt
  • ๐Ÿ’ฅ detektor โ€” the collision chamber above, open source (SmolLM2 in your browser, no server)
  • ๐Ÿ–ผ๏ธ jepa-demo โ€” I-JEPA & V-JEPA 2 hands-on, no GPU needed, with a visual deep-dive article
  • ๐Ÿ„ Mushroom-generator โ€” a VAE growing mushrooms, with latent-space walks and the decoder taken apart layer by layer
  • ๐ŸŽ Applepear โ€” apples vs pears in a tiny CNN, activations and grad-CAM included
  • โš™๏ธ Minimize_me โ€” race TensorFlow optimizers across loss landscapes

๐Ÿƒ And off the bench

  • ๐ŸŽจ personal-rembrandt โ€” you can't build a personal brand, so build a personal Rembrandt: paste your bio, GPT-2 reads it in your browser, and its activations repaint his 1659 self-portrait โ€” the brand-safe words sink into shadow. Teaches you very little about the model and a lot about Rembrandt
  • ๐Ÿ›๏ธ go-to-damn-bed โ€” a Claude Code skill that sends you to bed like a mom sends naughty children: it saves your work into TOMORROW.md, then counts to three. It never says what happens at three
  • ๐Ÿ‘‘ KingOfDiamonds โ€” the King of Diamonds game from Alice in Borderland, played by LLMs in character, recursive strategic thinking and all
  • ๐Ÿ—จ๏ธ paralel-discordverse โ€” your company's Discord gets a parallel universe, populated entirely by fictional colleagues
  • ๐Ÿงฎ least-squares-method โ€” code archaeology: a printed Pascal listing, photographed page by page and revived on Turbo Pascal 5.5

None of it is perfect. That's kind of delightful.

Pinned Loading

  1. brainscope brainscope Public

    Watch your model think while your app talks to it: an OpenAI-compatible server with a live layer-by-layer view of the residual stream (logit lens, J-lens, steering, traces).

    Python 39 7

  2. Minimize_me Minimize_me Public

    Explore Tensorflow optimizers with Minimize Me app!

    Python 4

  3. hidden-directions hidden-directions Public

    Bake an advocate persona into 9 KB of transformer weights. Catch one in 2 seconds. Same toolkit.

    Python 1

  4. sixteen-voices sixteen-voices Public

    An Interpretability Experiment on a Tiny Transformer

    Python

  5. steeropathy steeropathy Public

    Agents that talk through model internals โ€” activations & J-space โ€” instead of text. No words pass between them. The lab on top of brainscope + hidden-directions.

    Python 21 2

  6. in-two-minds in-two-minds Public

    Catch your agent hesitating between two tools โ€” a logit-lens demo for brainscope

    Python