vicreg

solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightning

Toolkit for training and evaluating Self-Supervised Learning (SSL) frameworks for Speaker Verification (SV).

JEPA agent playing Minecraft from pixels: latent world model + MPC planning, 664K params on one 8GB GPU, trained on raw gameplay with no labels. A complete lab notebook - including a 20-attempt research dead end, documented with its root cause.

Train a JEPA world model on a set of pre-collected trajectories from an environment involving an agent in two rooms.

Latent JEPA world model (SIGReg + VICReg) with a CEM planner in latent space, trained from scratch on a parking task.

This a tensorflow implementation of VICReg - a self-supervised learning architecture that prevents collapse in an intuitive manner using a loss function that 1. maintains the variance of each embedding over a batch above a threshold and 2. decorrelating pairs of embeddings over a batch and attracting them to 0. Training was done using TPU on colab

A VIcReg Implementation in pytorch

Modifications to the Histomorphological Phenotype Learning pipeline.

A hands-on lab for reproducing representation collapse and preventing it with Barlow Twins and VICReg.