Skip to content
View francescobrigante's full-sized avatar

Highlights

  • Pro

Block or report francescobrigante

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
francescobrigante/README.md

Francesco Brigante

Applied AI Researcher @ Translated · PhD Student @ Sapienza University of Rome

Large-scale generative models · Representation learning · Audio & music ML

SAGE paper LinkedIn Email


I train large generative models, at work and in my research.

At Translated, in the Foundation Models team, I work on pre-training, continued pre-training and distillation of large-scale multilingual language models. At Sapienza, as a PhD student, I study generative models for audio and how to give their latent spaces semantic structure. Before Translated, I worked on production LLM systems, including a RAG assistant deployed for the Italian Ministry of Education.

I like owning the whole stack: data curation, model design, custom CUDA kernels, distributed training on HPC and careful evaluation. I'm also a musician, which is where the audio obsession comes from.


⭐ Featured Research

Paper · Project page · Weights

SAGE: fidelity vs inference cost

A compact 105M-parameter VAE for 44.1 kHz stereo music. A Swin Transformer V2 encoder and decoder work on the STFT, and LAION-CLAP semantic distillation shapes the latent space.

  • High fidelity, low cost: matches an autoencoder 8× larger and 4× slower in listening tests
  • Semantic latent: state of the art on all 19 latent-probing tasks
  • Open and reproducible: trained only on public music
  • Built end to end: data, fused CUDA kernels, DDP on 16×A100 (CINECA Leonardo), evaluation

Supported by an ISCRA allocation on Leonardo and a €5,000 Google Cloud Research Credits award.


🎵 Selected Projects

Project What it is Highlight
Audio2PianoRoll Automatic music transcription with CQT and a custom U-Net 83% F1 on GuitarSet
MusicBuddy Real-time AI accompanist: an LSTM and a music-theory "Ear" follow your MIDI playing and answer with chords ~3 ms per chord decision · demo
Audio Style Transfer Piano ↔ violin transfer through latent disentanglement Complex-valued representations
VectorRAG vs GraphRAG Benchmark of vector, graph and hybrid RAG for enterprise retrieval 10× fewer tokens at 0.84 faithfulness

🔧 Open-Source Contributions

microsoft/Swin-Transformer #389  stars
Fused window CUDA kernels: fixed an out-of-bounds read that silently corrupts outputs on any non-square input, generalised the kernels to non-square windows, per-axis shifts and bfloat16, and ported them to ROCm, where they had never compiled. Bit-exact against eager on NVIDIA RTX 3080 and AMD MI300X, with a GPU-free test suite running in CI.


🛠️ Stack

Large-scale training: PyTorch (DDP) · Megatron Bridge · Lightning · Hydra · SLURM / HPC · Weights & Biases
Kernels & systems: CUDA · ROCm · C++ · Python
LLMs: Hugging Face Transformers · PEFT / QLoRA · distillation · LLM evaluation · RAG
Audio: torchaudio · librosa · neural audio codecs · MIDI


Happy to talk about audio generative models, large-scale training or music. The best way to reach me is email.

Pinned Loading

  1. SAGE SAGE Public

    SAGE: Semantic Audio Generative Encoder. A compact Swin V2 VAE for 44.1 kHz stereo music with a CLAP-aligned latent (official code)

    Python 14

  2. Audio2PianoRoll Audio2PianoRoll Public

    A deep learning-based Automatic Music Transcription (AMT) system that converts isolated guitar audio into a Piano Roll representation using CQT and a U-Net-style architecture

    Jupyter Notebook 3

  3. MusicBuddy MusicBuddy Public

    MusicBuddy: a real-time AI accompanist that listens to your MIDI instrument and plays chords with you

    Python 1

  4. VectorRAG-vs-GraphRAG VectorRAG-vs-GraphRAG Public

    Comparative study evaluating performances of Milvus Vector-based RAG vs Neo4j Graph-based RAG systems for Enterprise Knowledge Retrieval

    Python 3

  5. Digital-Self-Replica Digital-Self-Replica Public

    Build a unique digital replica that is not only able to respond via chat naturally and correctly as the real person would, but also using his writing style and lexical/syntactic preferences. Only t…

    Jupyter Notebook