This repository contains the official PyTorch implementation of the PASTA ๐ (Policy-optimization via Adaptive Smooth Tchebycheff Attention) algorithm, as presented in the paper:
Alejandro Murillo-Gonzรกlez, Mahmoud Ali, and Lantao Liu. Adaptive Smooth Tchebycheff Attention for Multi-Objective Policy Optimization. Robotics: Science and Systems (RSS) 2026
PASTA ๐ enables stable policy optimization for non-Convex Pareto tradeoffs.
To quickly run the PASTA ๐ algorithm and reproduce the included minimal demo run the following commands.
- Clone the repository:
git clone https://github.com/AlejandroMllo/PASTA.git
cd PASTA- Create the Conda environment:
conda env create -f environment.yml- Activate the environment:
conda activate pasta-env- Run the Multi-Objective demo:
python src/demo_pasta.pyThe provided demo illustrates the PASTA ๐ algorithm within a deliberately minimal multi-objective environment, designed to facilitate rapid evaluation and seamless adaptation.
This repository includes:
src/pasta.pyโ single-file implementation of the PASTA ๐ algorithm, including the smoothness controller.src/demo_pasta.pyโ a minimal demo script showing how to run PASTA ๐ on a simple MORL environmentREADME.mdโ this documentationenvironment.ymlโ Conda environment file with the required dependencies
To use the algorithm in your own research or experiments:
- Inspect
demo_pasta.pyto see how the environment and training loop are configured. - Import the core PASTA ๐ classes from the
src/pasta.pyfile. - Customize the actor and critic architectures, if needed, to handle your environment's observation space.
If you use this code or the PASTA ๐ algorithm in your work, please cite:
@INPROCEEDINGS{Murillo-GonzรกlezA-RSS-26,
AUTHOR = {Alejandro Murillo-Gonzรกlez AND Mahmoud Ali AND Lantao Liu},
TITLE = {{Adaptive Smooth Tchebycheff Attention for Multi-Objective Policy Optimization}},
BOOKTITLE = {Proceedings of Robotics: Science and Systems},
YEAR = {2026},
ADDRESS = {Sydney, Australia},
MONTH = {July},
DOI = {10.15607/RSS.2026.XXII.134}
}