Skip to content
RtwotwoPublic

About

We keep up with cutting-edge research in autonomous driving, analyze outstanding works based on evaluation benchmarks including NAVSIM, Bench2Drive and HUGSIM, and integrate technology and philosophy to drive the advancement of safe and efficient autonomous driving.

Topics

Resources

Contributing

Stars

3 stars

Watchers

2 watching

Forks

Latest commit

Β 

History

22 Commits

Folders and files

NameName
Last commit message
Last commit date
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Awesome Autonomous Driving Research

A curated research collection for end-to-end autonomous driving, driving world models, vision-language-action models, recursive self-improvement, public datasets, and reproducible evaluation. The catalog currently contains 244 papers across four research tracks.

Last updated: 2026-10-11. Verify paper metadata against the latest arXiv or publisher version before citation.

Table of Contents

Papers

Tags were checked against paper titles, abstracts, and method descriptions. GitHub repositories were checked against paper titles, arXiv identifiers, official project pages, and repository contents. Code pending marks an announced implementation that is not yet available; Partial code identifies a limited release such as inference or data tools. Project-only repositories are identified in the resource notes. Missing links mean no matching implementation was verified as of the audit date. The per-paper evidence and search coverage are recorded in data/github-audit.json.

The RSI track groups autonomous-driving research with an explicit iterative improvement loop. Papers may describe this as self-improving, self-evolving, safe online learning, or agentic evolution; inclusion does not imply that a fully general recursively self-modifying system has been demonstrated.

End-to-End Autonomous Driving

77 papers; 52 with a verified public code link.

2026
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
NavSafe-∞
NavSafe-∞: Benchmarking Closed-Loop Driving Safety in Photorealistic Environments
2026 Closed-Loop Benchmark Β· Photorealistic Simulation Β· Safety Evaluation arXiv πŸ’»
Driving on Registers, Reasoning on Risk
Driving on Registers, Reasoning on Risk: Risk-Aware Occupancy for Register-Based End-to-End Autonomous Driving
2026 Occupancy Representation Β· Token Representation Β· Risk-Aware Planning arXiv
DRiF
Data-Driven Risk Fields for Safer End-to-End Autonomous Driving
2026 Relative Risk Supervision Β· BEV Risk Fields Β· Safety-Aware Planning arXiv
RUDC
A Risk-Sensitive and Uncertainty-Aware Decision-Making and Control Framework for Safe and Robust Autonomous Driving
2026 Safe Reinforcement Learning Β· Policy Uncertainty Β· Control Barrier Functions arXiv
AD-Diff Bench
Understanding Autonomous Driving Datasets by Describing Differences between Image Subsets in Natural Language
2026 Dataset Understanding Β· Benchmark Β· Domain Shift arXiv πŸ’»
CrashDiffuser
CrashDiffuser: VLM-Guided Collision Intent Reasoning for Fine-Grained Safety-Critical Traffic Scenario Generation
2026 Scenario Generation Β· VLM-Guided Reasoning Β· Safety Evaluation arXiv
NAVSIM Score Basis Audit
When Shared Rollouts Fail in Defensive Driving Evaluation: A NAVSIM Score Basis Audit
ECCV 2026 Workshop Evaluation Audit Β· Numerical Robustness Β· Defensive Driving arXiv πŸ’»
NeoAD
Drive Like Humans, Plan Like Machines: An Explicit Sense and Safety Aware Autonomous Driving Framework
CVPR 2026 Workshop Explicit Planning Tokens Β· Safety-Aware Planning Β· BEV Representation Paper πŸ’»
DiDrive
DiDrive: A Risk-Aware Hierarchical Diffusion Framework for Safe Offline Reinforcement Learning in Autonomous Driving
2026 Offline Reinforcement Learning Β· Risk-Aware Diffusion Β· Candidate Ranking arXiv
PriorEye
PriorEye: Geospatial Visual Priors for End-to-End Autonomous Driving
ECCV 2026 Geospatial Priors Β· Anticipatory Planning arXiv πŸ’» 🌐
FlowR2A
FlowR2A: Learning Reward-to-Action Distribution for Multimodal Driving Planning
2026 Reward-Conditioned Planning Β· Flow Matching Β· Multi-Modal Trajectories arXiv πŸ’» 🌐
World Engine
World Engine: Towards the Era of Post-Training for Autonomous Driving
2026 Post-Training Β· Interactive Simulation Β· Long-Tail Safety arXiv πŸ’» 🌐
Gigapixel
Scaling Self-Play for End-to-End Driving
2026 Self-Play Β· Closed-Loop Reinforcement Learning arXiv πŸ’»
Code pending: The repository contains a README and assets. The announced code, data, and model release schedule starts after this audit date.
COMPACT-VA
Planning-aligned Token Compression for Long-Context Autonomous Driving
2026 Token Compression Β· Long-Context Memory Β· Planning-Aware Learning arXiv
TOAD
Test-Time Trajectory Optimization for Autonomous Driving
2026 Test-Time Optimization Β· Cross-Entropy Search Β· Trajectory Scoring arXiv πŸ’» 🌐
NTR
NTR: Neural Token Reconstruction for Scene Token Bottleneck in End-to-End Driving
2026 Scene Tokenization Β· Perception-Free Planning Β· Reconstruction Supervision arXiv
CLOVER
CLOVER: Closed-Loop Value Estimation and Ranking for End-to-End Autonomous Driving Planning
2026 Closed-Loop Self-Distillation Β· Trajectory Scoring Β· Multi-Metric Planning arXiv πŸ’»
Partial code: Inference scripts and checkpoints are public; official training and pseudo-expert generation code remain pending.
123D
123D: Unifying Multi-Modal Autonomous Driving Data at Scale
2026 Driving Data Library Β· Multi-Modal Datasets Β· Data Standardization arXiv πŸ’»
ReflectDrive-2
ReflectDrive-2: Reinforcement-Learning-Aligned Self-Editing for Discrete Diffusion Driving
2026 Discrete Diffusion Β· Trajectory Editing arXiv
RAD-2
RAD-2: Scaling Reinforcement Learning in a Generator-Discriminator Framework
2026 Diffusion Planning Β· Reinforcement Learning Β· Closed-Loop Adaptation arXiv πŸ’» 🌐
Official shared RAD/RAD-2 repository. Released scripts are labeled RAD core components; a RAD-2-specific implementation was not verified.
MOSAIC
Scaling-Aware Data Selection for End-to-End Autonomous Driving Systems
CVPR 2026 Data Selection Β· Data Scaling Β· Evaluation Alignment arXiv
FlowAD
FlowAD: Ego-Scene Interactive Modeling for Autonomous Driving
2026 Ego-Scene Interaction Β· Scene Flow Β· Closed-Loop Evaluation arXiv πŸ’»
SparseDriveV2
SparseDriveV2: Scoring is All You Need for End-to-End Autonomous Driving
2026 Trajectory Scoring Β· Sparse Proposals Β· Multi-Modal Planning arXiv πŸ’»
HDP
Unleashing the Potential of Diffusion Models for End-to-End Autonomous Driving
2026 Diffusion Planning Β· Reinforcement Learning Β· Real-World Validation arXiv πŸ’» 🌐
MeanFuser
MeanFuser: Fast One-Step Multi-Modal Trajectory Generation and Adaptive Reconstruction via MeanFlow for End-to-End Autonomous Driving
CVPR 2026 Flow Matching Β· One-Step Planning Β· Multi-Modal Trajectories arXiv πŸ’»
PCM
A Generalizable Physics-guided Causal Model for Trajectory Prediction in Autonomous Driving
ICRA 2026 Causal Modeling Β· Motion Prediction Β· Domain Generalization arXiv πŸ’»
PlannerRFT
PlannerRFT: Reinforcing Diffusion Planners through Closed-Loop and Sample-Efficient Fine-Tuning
2026 Reinforcement Fine-Tuning Β· Diffusion Planning Β· Adaptive Trajectories arXiv
DrivoR
Driving on Registers
2026 Register Tokens Β· Vision Transformer Backbone Β· Trajectory Scoring arXiv πŸ’» 🌐
AlignDrive
AlignDrive: Aligned Lateral-Longitudinal Planning for End-to-End Autonomous Driving
2026 Lateral-Longitudinal Planning Β· Path-Conditioned Planning arXiv πŸ’» 🌐
Code pending: The linked author repository currently contains only .gitattributes; implementation is not released.
2025
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
LEAD
LEAD: Minimizing Learner-Expert Asymmetry in End-to-End Driving
2025 Imitation Learning Β· Privileged Learning Β· Closed-Loop Evaluation arXiv πŸ’»
DiffusionDriveV2
DiffusionDriveV2: Reinforcement Learning-Constrained Truncated Diffusion Modeling in End-to-End Autonomous Driving
2025 Diffusion Planning Β· Reinforcement Learning Β· Diverse Trajectories arXiv πŸ’»
Spatial Retrieval AD
Spatial Retrieval Augmented Autonomous Driving
2025 Spatial Retrieval Β· Geospatial Priors Β· Robust Planning arXiv πŸ’» 🌐
LAP
LAP: Fast LAtent Diffusion Planner for Autonomous Driving
2025 Latent-Space Diffusion Β· Intent-Kinematics Disentanglement Β· Feature Alignment arXiv πŸ’»
Code pending: The repository contains only a README and announces a future code release.
GuideFlow
GuideFlow: Constraint-Guided Flow Matching for Planning in End-to-End Autonomous Driving
2025 Flow Matching Β· Safety-Constrained Planning arXiv πŸ’»
Code pending: The repository contains documentation and images; the README says the code is still being organized.
DiffRefiner
DiffRefiner: Coarse to Fine Trajectory Planning via Diffusion Refinement with Semantic Interaction for End to End Autonomous Driving
AAAI 2026 Diffusion Planning Β· Trajectory Refinement arXiv
MiMo-Embodied
MiMo-Embodied: X-Embodied Foundation Model Technical Report
2025 Embodied Foundation Model Β· Cross-Embodiment Transfer Β· Autonomous Driving arXiv πŸ’» 🌐
UniMM-V2X
UniMM-V2X: MoE-Enhanced Multi-Level Fusion for End-to-End Cooperative Autonomous Driving
2025 Cooperative Driving Β· Multi-Agent Planning Β· V2X arXiv πŸ’»
UniLION
UniLION: Towards Unified Autonomous Driving Model with Linear Group RNNs
2025 LiDAR Β· Multi-View Fusion Β· Efficient Transformers arXiv πŸ’»
ZTRS
Zero-Human Demonstration End-to-end Autonomous Driving with Trajectory Scorer
2025 Trajectory Scoring Β· Zero-Shot Planning Β· Policy Optimization arXiv πŸ’»
ResAD
ResAD: Normalized Residual Trajectory Modeling for End-to-End Autonomous Driving
CVPR 2026 Residual Trajectory Modeling Β· Inertial Reference Β· Diffusion Planning arXiv πŸ’» 🌐
Code pending: The author-linked repository currently contains only a README; implementation is not released.
EvaDrive
EvaDrive: Evolutionary Adversarial Policy Optimization for End-to-End Autonomous Driving
2025 Evolutionary Reinforcement Learning Β· Iterative Planning Β· Closed-Loop Driving arXiv
DistillDrive
DistillDrive: End-to-End Multi-Mode Autonomous Driving Distillation by Isomorphic Hetero-Source Planning Model
2025 Knowledge Distillation Β· Planning-Centric Learning arXiv πŸ’»
DiffSemanticFusion
DiffSemanticFusion: Semantic Raster BEV Fusion for Autonomous Driving via Online HD Map Diffusion
2025 HD Map Generation Β· BEV Semantics Β· Sensor Fusion arXiv πŸ’»
Partial code: Mapless QCNet training and evaluation components are public; the full DiffSemanticFusion release is still being organized.
GEMINUS
GEMINUS: Dual-aware Global and Scene-Adaptive Mixture-of-Experts for End-to-End Autonomous Driving
2025 Mixture-of-Experts Β· Driving Skills Β· Adaptive Planning arXiv πŸ’»
Partial code: Data preprocessing tools are public; the training implementation remains pending.
TrajFlow
TrajFlow: Multi-modal Motion Prediction via Flow Matching
IROS 2025 Flow Matching Β· Motion Prediction Β· Multi-Modal Forecasting arXiv πŸ’» 🌐
ETA
ETA: Efficiency through Thinking Ahead, A Dual Approach to Self-Driving with Large Models
ICCV 2025 Dual-System VLM Β· Fast-Slow Planning Β· Inference Efficiency arXiv πŸ’»
GTRS
Generalized Trajectory Scoring for End-to-end Multimodal Planning
CVPR 2025 Trajectory Scoring Β· Multi-Modal Planning arXiv πŸ’»
DriveSuprim
DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planning
AAAI 2026 Trajectory Selection Β· Safety Scoring Β· Imitation Learning arXiv πŸ’»
NAVSIM
Pseudo-Simulation for Autonomous Driving
CORL 2025 Evaluation Benchmark Β· Pseudo-Simulation Β· Open-Loop Metrics arXiv πŸ’»
GaussianFusion
GaussianFusion: Gaussian-Based Multi-Sensor Fusion for End-to-End Autonomous Driving
NEURIPS 2025 Multi-Sensor Fusion Β· Gaussian Representation Β· End-to-End Planning arXiv πŸ’»
iPad
iPad: Iterative Proposal-centric End-to-End Autonomous Driving
2025 Proposal-Centric Planning Β· Iterative Refinement Β· Sparse Representation arXiv πŸ’»
TransDiffuser
TransDiffuser: Diverse Trajectory Generation with Decorrelated Multi-modal Representation for End-to-end Autonomous Driving
2025 Diffusion Planning Β· Multi-Modal Trajectories Β· Trajectory Diversity arXiv
BridgeAD
Bridging Past and Future: End-to-End Autonomous Driving with Historical Prediction and Planning
CVPR 2025 Temporal Memory Β· Historical Prediction Β· Trajectory Planning arXiv πŸ’»
Hydra-MDP++
Hydra-MDP++: Advancing End-to-End Driving via Expert-Guided Hydra-Distillation
2025 Knowledge Distillation Β· Expert-Guided Planning Β· Multi-Head Policy arXiv
TrajHF
Learning Personalized Driving Styles via Reinforcement Learning from Human Feedback
2025 Human Feedback Β· Personalized Driving Styles Β· Trajectory Generation arXiv
HiP-AD
HiP-AD: Hierarchical and Multi-Granularity Planning with Deformable Attention for Autonomous Driving in a Single Decoder
2025 Hierarchical Planning Β· Multi-Granularity Queries arXiv πŸ’»
DriveTransformer
DriveTransformer: Unified Transformer for Scalable End-to-End Autonomous Driving
ICLR 2025 Unified Perception-Prediction-Planning Β· Transformer Architecture arXiv πŸ’»
GoalFlow
GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Driving
2025 Flow Matching Β· Goal-Conditioned Planning Β· Multi-Modal Trajectories arXiv πŸ’»
MomAD
Don't Shake the Wheel: Momentum-Aware Planning in End-to-End Autonomous Driving
2025 Trajectory Momentum Β· Occlusion Robustness Β· End-to-End Planning arXiv πŸ’»
2024
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
DiffusionDrive
DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Driving
CVPR 2025 Diffusion Policy Β· Real-Time Planning Β· Multi-Modal Trajectories arXiv πŸ’»
NAVSIM
NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking
NEURIPS 2024 Benchmarking Β· Non-Reactive Simulation Β· Data-Driven Evaluation arXiv πŸ’»
Hydra-MDP
Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillation
CVPR 2024 Knowledge Distillation Β· Multi-Teacher Learning Β· Trajectory Selection arXiv πŸ’»
Code pending: The official repository contains a README and assets; code and model release are delayed.
SparseDrive
SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representation
2024 Sparse Scene Representation Β· Multi-Task Learning Β· End-to-End Planning arXiv πŸ’»
VADv2
VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planning
2024 Vectorized Scene Representation Β· End-to-End Planning arXiv πŸ’» 🌐
Partial code: Core VADv2 model and configuration are public in the VAD repository and require integration with VADv1.
2023
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
BEV-Planner
Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?
CVPR 2024 BEV Representation Β· Trajectory Planning arXiv πŸ’»
VAD
VAD: Vectorized Scene Representation for Efficient Autonomous Driving
ICCV 2023 Vectorized Scene Representation Β· End-to-End Planning arXiv πŸ’»
2022
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
UniAD
Planning-oriented Autonomous Driving
CVPR 2023 Unified Autonomous Driving Β· Planning-Oriented Learning arXiv πŸ’» 🌐
ST-P3
ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning
ECCV 2022 Spatial-Temporal Learning Β· End-to-End Planning Β· Closed-Loop Evaluation arXiv πŸ’»
Official repository transferred from OpenPerceptionX to OpenDriveLab.
TransFuser
TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving
2022 Sensor Fusion Β· Imitation Learning Β· End-to-End Driving arXiv πŸ’»
2021
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
NEAT
NEAT: Neural Attention Fields for End-to-End Autonomous Driving
ICCV 2021 Neural Attention Fields Β· Bird’s-Eye View Β· Imitation Learning arXiv πŸ’»
Roach
End-to-End Urban Driving by Imitating a Reinforcement Learning Coach
ICCV 2021 Imitation Learning Β· Reinforcement Learning Β· CARLA arXiv πŸ’»
IVMP
Learning Interpretable End-to-End Vision-Based Motion Planning for Autonomous Driving with Optical Flow Distillation
ICRA 2021 Vision-Based Planning · Optical Flow Distillation · Interpretability arXiv 🌐
TransFuser
Multi-Modal Fusion Transformer for End-to-End Autonomous Driving
CVPR 2021 Transformer Β· Sensor Fusion Β· Imitation Learning arXiv πŸ’»
MP3
MP3: A Unified Model to Map, Perceive, Predict and Plan
CVPR 2021 Mapless Driving Β· Online Mapping Β· Neural Planning arXiv
2020
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
P3
Perceive, Predict, and Plan: Safe Motion Planning Through Interpretable Semantic Representations
ECCV 2020 Semantic Occupancy Β· Joint Planning Β· Interpretability arXiv
Data Aggregation
Exploring Data Aggregation in Policy Learning for Vision-Based Urban Autonomous Driving
CVPR 2020 DAgger Β· Imitation Learning Β· Policy Generalization Paper πŸ’»
Implicit Affordances
End-to-End Model-Free Reinforcement Learning for Urban Driving Using Implicit Affordances
CVPR 2020 Reinforcement Learning Β· Implicit Affordances Β· Urban Driving arXiv πŸ’» 🌐
Partial code: Official inference code and model weights; the repository is a fork of Learning by Cheating.

Vision-Language-Action Models

75 papers; 44 with a verified public code link.

2026
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
FocusDrive
FocusDrive: Reasoning with Visual Focus for Autonomous Driving
2026 Visual Focus Β· Grounded Reasoning Β· Trajectory Planning arXiv
iDriveVLA
Evaluation Is All You Need for Multi-Modal Autonomous Driving
2026 Multi-Modal Planning Β· Trajectory Scoring Β· VLM Guidance arXiv
Run-then-Walk
Sometimes You Gotta Run Before You Can Walk: Run-then-Walk Scheduling Strategy for VLM Autonomous Driving
2026 VLM Planning Β· Reinforcement Learning Β· Safety arXiv
FIVE-VLA
FIVE-VLA: Fast and EffectIVE Autonomous Driving with Recurrent Action Memory
2026 Efficient VLA Β· Recurrent Action Memory Β· Direct Trajectory Prediction arXiv
Qwen-Drive-1.0
Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Driving
2026 Vision-Language Foundation Model Β· 3D Perception Β· Joint Planning arXiv πŸ’»
HybridDriveVLA
HybridDriveVLA: Vision-Language-Action Model with Visual CoT reasoning and ToT Evaluation for Autonomous Driving
2026 Visual Chain-of-Thought Β· Waypoint Evaluation Β· Safety and Comfort Paper
Plug-and-Play
Plug-and-Play Traffic Element Awareness for End-to-End Autonomous Driving
2026 Traffic Element Conditioning Β· End-to-End Planning arXiv πŸ’»
BrainWAM
BrainWAM: Action-Space Coordination of Semantic Priors and Predictive Dynamics for Autonomous Driving
2026 VLA-WAM Integration Β· Predictive Dynamics Β· Joint Planning arXiv
DriveVLA-M0
DriveVLA-M0: Failure-Aware Memory Augmentation for Autonomous Driving
2026 Failure Memory Β· Retrieval Augmentation Β· Distribution Shift arXiv πŸ’»
FactorDrive
FactorDrive: Adaptive Multi-Step Reasoning Driven by Planning-Critical Factors for End-to-End Autonomous Driving
2026 Spatial Reasoning Β· Reasoning Optimization Β· Trajectory Planning arXiv
DEFT-RLVR
Deferred Exposure of Future Trajectories for Verifiable Reasoning in Autonomous Driving VLMs
2026 Reinforcement Learning with Verifiable Rewards Β· Reasoning Supervision arXiv πŸ’»
WorkDrive
WorkDrive: Roadwork Chain of Causation for Autonomous Driving
2026 Work-Zone Reasoning Β· VLM Planning Β· Robustness arXiv
Post-Training Survey
Post-Training in End-to-End Autonomous Driving
2026 Survey Β· Post-Training Β· Policy Optimization arXiv πŸ’» 🌐
Official companion paper collection for the survey; no driving implementation is claimed.
LingBot-VLA 2.0
From Foundation to Application: Improving VLA Models in Practice
2026 Generalist VLA Β· Data Scaling Β· Real-World Deployment arXiv πŸ’» 🌐
AnchorVLA
AnchorVLA: Bridging Discrete Decisions and Continuous Trajectories for Vision-Language-Action Planning
2026 Navigation-Conditioned Planning Β· Continuous Actions arXiv
DriveTeach-VLA
Teaching Vision-Language-Action Models What to See and Where to Look
ECCV 2026 Spatial Grounding Β· Action-Grounded Supervision arXiv πŸ’»
WVM
World Value Models for Robotic Manipulation
2026 Cross-Domain Robotics Β· World-Value Modeling arXiv
Qwen-RobotNav
Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation System
2026 Agentic Navigation Β· Configurable Visual Context Β· Cross-Domain Navigation arXiv πŸ’» 🌐
Official report and demos are public; implementation and model weights are not released.
DriveReward
DriveReward: A Comprehensive Dataset and Generative Vision-Language Reward Model for Autonomous Driving
2026 Reward Modeling Β· Trajectory Selection Β· Data Scaling arXiv
ChainFlow-VLA
ChainFlow-VLA: Causal Flow Planning with Vision-Language Models
2026 Causal Flow Matching Β· Trajectory Generation Β· Global Consistency arXiv πŸ’»
IKN
Grounding Driving VLA via Inverse Kinematics
2026 Inverse Kinematics Β· Future-State Grounding Β· Trajectory Recovery arXiv
CRAFT
CRAFT: Counterfactual-to-Interactive Reinforcement Fine-Tuning for Driving Policies
2026 Counterfactual Learning Β· Interactive Reinforcement Learning Β· Policy Fine-Tuning arXiv πŸ’» 🌐
OneDrive
OneDrive: Unified Multi-Paradigm Driving with Vision-Language-Action Models
2026 Unified Multimodal Decoding Β· Structured Actions Β· End-to-End Planning arXiv πŸ’»
Partial code: nuScenes code and training scripts are public; model weights and the NAVSIM release remain pending.
UniDriveVLA
UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving
2026 Joint Perception and Planning Β· 3D Grounding Β· VLA arXiv πŸ’»
DVGT-2
DVGT-2: Vision-Geometry-Action Model for Autonomous Driving at Scale
2026 Vision-Geometry-Action Β· 3D Geometry Β· Action Planning arXiv πŸ’»
AutoDrive-P3
AutoDrive-P3: Unified Chain of Perception-Prediction-Planning Thought via Reinforcement Fine-Tuning
ICLR 2026 Chain-of-Thought Β· Reinforcement Fine-Tuning Β· Unified Driving arXiv πŸ’»
The original repository redirects here. This is a follow-up implementation that also incorporates Run-then-Walk.
Learning from Mistakes
Learning from Mistakes: Post-Training for Driving VLA with Takeover Data
2026 Takeover Learning Β· Post-Training Β· Distribution Shift arXiv
AutoMoT
AutoMoT: A Unified Vision-Language-Action Model with Asynchronous Mixture-of-Transformers for End-to-End Autonomous Driving
2026 Asynchronous VLA Β· Mixture-of-Transformers Β· Efficient Inference arXiv πŸ’» 🌐
DynVLA
DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Driving
2026 World Dynamics Reasoning Β· Dynamics Tokens Β· Action Planning arXiv πŸ’» 🌐
EvoDriveVLA
EvoDriveVLA: Evolving Driving VLA Models via Collaborative Perception-Planning Distillation
2026 Knowledge Distillation Β· Perception-Planning Alignment arXiv πŸ’»
Curious-VLA
Devil is in Narrow Policy: Unleashing Exploration in Driving VLA Models
CVPR 2026 Exploration Β· Reinforcement Learning Β· Policy Improvement arXiv πŸ’»
LaST-VLA
LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Driving
2026 Latent Reasoning Β· Spatio-Temporal Grounding arXiv πŸ’»
Code pending: Inference code, training code, and the training dataset remain unchecked on the release roadmap.
LinkVLA
Unifying Language-Action Understanding and Generation for Autonomous Driving
2026 Language-Action Alignment Β· Parallel Action Generation arXiv
ELF-VLA
Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failures
2026 Learning from Failures Β· Reinforcement Learning Β· Long-Tail Exploration arXiv πŸ’»
Code pending: Inference code, training code, and the training dataset remain unchecked on the release roadmap.
NoRD
NoRD: A Data-Efficient Vision-Language-Action Model that Drives without Reasoning
CVPR 2026 Data Efficiency Β· Reasoning-Free VLA Β· Driving Policy arXiv πŸ’»
VGGDrive
VGGDrive: Empowering Vision-Language Models with Cross-View Geometric Grounding for Autonomous Driving
CVPR 2026 Cross-View Geometry Β· 3D Grounding Β· VLM arXiv πŸ’»
HiST-VLA
HiST-VLA: A Hierarchical Spatio-Temporal Vision-Language-Action Model for End-to-End Autonomous Driving
2026 Hierarchical Planning Β· Spatio-Temporal Reasoning Β· 3D Grounding arXiv
Dual-System Driving
From Representational Complementarity to Dual Systems: Synergizing VLM and Vision-Only Backbones for End-to-End Driving
2026 Dual-System VLM Β· Vision-Only Backbones Β· Representation Complementarity arXiv
SparseOccVLA
SparseOccVLA: Bridging Occupancy and Vision-Language Models via Sparse Queries for Unified 4D Scene Understanding and Planning
2026 Sparse Occupancy Β· 4D Scene Understanding Β· Unified Planning arXiv πŸ’»
SGDrive
SGDrive: Scene-to-Goal Hierarchical World Cognition for Autonomous Driving
2026 Scene-to-Goal Reasoning Β· Hierarchical Planning Β· 3D Grounding arXiv πŸ’»
FLARE
FLARE: Learning Future-Aware Latent Representations from Vision-Language Models for Autonomous Driving
2026 Latent Future Representation Β· VLM Transfer Β· Trajectory Planning arXiv
2025
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
ColaVLA
ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Driving
CVPR 2026 Latent Reasoning Β· Hierarchical Planning Β· Parallel Trajectories arXiv πŸ’» 🌐
SpaceDrive
SpaceDrive: Infusing Spatial Awareness into VLM-based Autonomous Driving
2025 Spatial Awareness Β· 3D Reasoning Β· VLM Planning arXiv πŸ’»
WAM-Flow
WAM-Flow: Parallel Coarse-to-Fine Motion Planning via Discrete Flow Matching for Autonomous Driving
2025 Discrete Flow Matching Β· Parallel Planning Β· Structured Actions arXiv πŸ’»
Partial code: SFT, inference, and evaluation code are public; reinforcement-learning code remains pending.
OpenREAD
OpenREAD: Reinforced Open-Ended Reasoning for End-to-End Autonomous Driving with LLM-as-Critic
2025 Reasoning Fine-Tuning Β· Reinforcement Learning Β· Driving Policy arXiv πŸ’»
Partial code: Models, inference, and evaluation scripts are public; training code remains pending.
Alpamayo-R1
Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail
2025 Causal Reasoning Β· Trajectory Planning Β· Long-Tail Driving arXiv πŸ’» 🌐
Partial code: Core model and inference are public. This checkpoint uses supervised learning and does not include the paper's RL post-training weights.
Cosmos-Predict2.5
World Simulation with Video Foundation Models for Physical AI
2025 World Foundation Model Β· Video Generation Β· Flow-Based Modeling arXiv πŸ’»
ReflectDrive-1
Discrete Diffusion for Reflective Vision-Language-Action Models in Autonomous Driving
2025 Discrete Diffusion Β· Reflective Reasoning Β· Trajectory Generation arXiv πŸ’»
Code pending: The repository contains only a README and license; NAVSIM and training code are still pending.
OccVLA
OccVLA: Vision-Language-Action Model with Implicit 3D Occupancy Supervision
2025 Occupancy Grounding Β· 3D Spatial Understanding Β· VLA arXiv
FastDriveVLA
FastDriveVLA: Efficient End-to-End Driving via Plug-and-Play Reconstruction-based Token Pruning
AAAI 2026 Visual Token Pruning Β· Efficient Inference Β· VLA arXiv
AutoVLA
AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning
NEURIPS 2025 Joint Reasoning and Action Β· Autoregressive VLA Β· Reinforcement Learning arXiv πŸ’» 🌐
ReCogDrive
ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Driving
2025 Cognitive Planning Β· Action Tokenization Β· Reinforcement Learning arXiv πŸ’»
DiffVLA
DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Driving
2025 Diffusion Planning Β· BEV Efficiency Β· Action Diversity arXiv πŸ’»
DriveMoE
DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Driving
2025 Mixture-of-Experts Β· Scenario Specialization Β· End-to-End Planning arXiv πŸ’» 🌐
LightEMMA
LightEMMA: A Longitudinal Evaluation of Vision-Language Models for Autonomous Driving
2025 VLM Evaluation Β· Open-Loop Benchmarking Β· Inference Cost arXiv πŸ’»
OpenDriveVLA
OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model
2025 Spatially Grounded Actions Β· Language-Conditioned Driving Β· VLA arXiv πŸ’»
Partial code: Model and inference code are public; training scripts remain pending.
Cosmos-Reason1
Cosmos-Reason1: From Physical Common Sense To Embodied Reasoning
2025 Physical Reasoning Β· Embodied Foundation Model arXiv πŸ’»
SimLingo
SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignment
CVPR 2025 Language-Action Alignment Β· Closed-Loop Driving Β· Action Dreaming arXiv πŸ’»
AlphaDrive
AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoning
2025 VLM Reasoning Β· Reinforcement Learning Β· Long-Tail Driving arXiv πŸ’»
2024
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
EMMA
EMMA: End-to-End Multimodal Model for Autonomous Driving
2024 Multimodal Foundation Model · Trajectory Generation · Joint Driving Tasks arXiv 🌐
DriVLMe
DriVLMe: Enhancing LLM-Based Autonomous Driving Agents with Embodied and Social Experiences
IROS 2024 Embodied Experience Β· Social Reasoning Β· Driving Agents arXiv πŸ’»
DriveVLM
DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Models
CoRL 2024 Vision-Language Models Β· Hierarchical Planning Β· Hybrid Driving System arXiv πŸ’» 🌐
The official GitHub repository hosts the paper and project website; model implementation is not released.
VLP
VLP: Vision Language Planning for Autonomous Driving
CVPR 2024 Vision-Language Planning Β· Long-Tail Reasoning Β· Motion Planning arXiv
DriveLM
DriveLM: Driving with Graph Visual Question Answering
ECCV 2024 Graph VQA Β· Driving Reasoning Β· End-to-End Planning arXiv πŸ’» 🌐
LMDrive
LMDrive: Closed-Loop End-to-End Driving with Large Language Models
CVPR 2024 Language-Guided Driving Β· Closed-Loop Control Β· Instruction Following arXiv πŸ’»
Dolphins
Dolphins: Multimodal Language Model for Driving
ECCV 2024 Vision-Language Model Β· Driving Instruction Tuning Β· In-Context Learning arXiv πŸ’» 🌐
Partial code: Inference code and checkpoint are public; training code and benchmark release remain pending.
On the Road with GPT-4V
On the Road with GPT-4V(ision): Early Explorations of Visual-Language Model on Autonomous Driving
ICLR 2024 Vision-Language Models Β· Driving Reasoning Β· Open-World Scenarios arXiv πŸ’»
Official test images, prompts, and responses are public; this repository is an exploration archive rather than a released driving implementation.
LLM-Driver
Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Driving
ICRA 2024 Large Language Models Β· Vectorized Scene Inputs Β· Explainable Driving arXiv πŸ’»
DriveGPT4
DriveGPT4: Interpretable End-to-End Autonomous Driving via Large Language Model
IEEE RA-L 2024 Multimodal LLM Β· End-to-End Control Β· Driving Explanations arXiv πŸ’» 🌐
DiLu
DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Models
ICLR 2024 Large Language Models Β· Knowledge and Memory Β· Self-Evolving Driving arXiv πŸ’» 🌐
2023
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
DriveMLM
DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving
2023 Multimodal LLM Β· Behavior Planning Β· Closed-Loop Driving arXiv πŸ’»
Code pending: The official README lists code, models, dataset, and annotations as unreleased.
LanguageMPC
LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving
2023 Large Language Models · Motion Planning · Decision Making arXiv 🌐
GPT-Driver
GPT-Driver: Learning to Drive with GPT
NeurIPS 2023 Workshop Large Language Models Β· Trajectory Planning Β· Numerical Reasoning arXiv πŸ’» 🌐
Drive as You Speak
Drive as You Speak: Enabling Human-Like Interaction with Large Language Models in Autonomous Vehicles
2023 Large Language Models Β· Human-Vehicle Interaction Β· Decision Making arXiv
2022
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
DOROTHIE
DOROTHIE: Spoken Dialogue for Handling Unexpected Situations in Interactive Autonomous Driving Agents
Findings of EMNLP 2022 Spoken Dialogue Β· Interactive Driving Β· Human-Agent Collaboration arXiv πŸ’» 🌐

Driving World Models

74 papers; 42 with a verified public code link.

2026
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
TerrainForge
TerrainForge: Physics-Grounded road geometry Editing for Counterfactual Autonomous Driving
2026 Counterfactual Simulation Β· Road Geometry Editing Β· Vehicle Dynamics arXiv
AD-E2E-JEPA
AD-E2E-JEPA: A Joint-Embedding Predictive Architecture For End-to-End Autonomous Driving
2026 Joint-Embedding Prediction Β· Goal-Conditioned Planning Β· Efficient World Model arXiv πŸ’»
Code pending: The author announces source-code release by October 19, 2026; the current repository contains a README and figures.
DreamStream
DreamStream: Towards Policy-Oriented Generative Simulation for End-to-End Driving
CoRL 2026 Generative Simulation Β· Closed-Loop Evaluation Β· Policy-Oriented Fidelity arXiv πŸ’» 🌐
Code pending
ForeDrive
ForeDrive: Foresight-Guided End-to-End Autonomous Driving with a Planning-Relevant Latent World Model
2026 Latent World Model Β· JEPA Β· Future-Conditioned Planning arXiv
ZYT-World
ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulation
2026 Driving World Model Β· Controllable Simulation arXiv
MM-Future
MM-Future: Multi-Mode Joint World-Action Modeling for Autonomous Driving
2026 Multimodal Future Prediction Β· World Modeling arXiv
SV-WAM
SV-WAM: An Efficient Surround-View World-Action Model for End-to-End Autonomous Driving
2026 World-Action Model Β· Semantic Video Representation arXiv
VATIX
How Far Can 5,500 Hours of Driving Take You? A Scaling Law Analysis of Video Diffusion Models
2026 Video Diffusion Β· Driving Data Scaling Β· World Generation arXiv πŸ’»
BehaviorWorldGen
BehaviorWorldGen: Closing the Loop between Action Models and World Simulators via Controllable Behavior-Aware Structured World Generation
2026 Behavior-Conditioned Generation Β· Driving Simulation Β· World Model arXiv
WA-JEPA
WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Driving
2026 Video JEPA Β· World-Action Modeling Β· Self-Supervised Learning arXiv πŸ’»
RISE
RISE: Adaptive Imagination for World Action Models
2026 World-Action Modeling Β· Action-Conditioned Prediction arXiv
DA-WAM
DA-WAM: Decision-Aligned Future Latents for Driving World Models
2026 World-Action Modeling Β· Latent Dynamics arXiv
4D-WAM
4D-WAM: 4D Consistent World Modeling for Autonomous Driving
2026 World-Action Modeling Β· 4D Scene Representation arXiv
SimWAM
SimWAM: A Simple World Action Model for End-to-End Autonomous Driving
2026 World-Action Model Β· Training-Time Prediction Β· End-to-End Driving arXiv πŸ’»
SUV
SUV: Future Scene Understanding as Video Generation for End-to-End Driving
2026 Video Generation Β· Scene Understanding Β· End-to-End Driving arXiv πŸ’»
Partial code: Checkpoint and inference code are public; training and the WOD-E2E pipeline remain pending.
Auto-JEPA
Auto-JEPA: A Latent World Model of Continuous Intent for End-to-End Autonomous Driving
2026 Action-Centered JEPA Β· Latent Dynamics Β· Planning arXiv πŸ’»
Code pending: The paper links this repository, which currently contains a scaffold; model components are still being organized.
INTACT
INTACT: Isomorphic Intent-to-Action Learning for Search-Free World Models
2026 Intent-to-Action Β· JEPA Β· Reward-Free Learning arXiv πŸ’»
HyWorldVLA
HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Driving
2026 VLA-WAM Integration Β· Latent World Modeling Β· Driving Policy arXiv
GeoWorldAD
GeoWorldAD: Geometry World Action Model for Autonomous Driving
2026 Geometric Grounding Β· 3D Scene Modeling Β· Future-Aware Planning arXiv πŸ’»
Code pending: The repository links the paper; training and inference code are still listed as coming soon.
OWMDrive
OWMDrive: Causality-Aware End-to-End Autonomous Driving via 4D Occupancy World Model
2026 Temporal Causal Dynamics Β· World Modeling Β· End-to-End Planning arXiv
Metis
Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigation
2026 World-Action Modeling Β· Efficient Inference Β· Decoupled Video and Action arXiv πŸ’»
Code pending: The repository contains the project description and assets; inference and training code remain pending.
NVIDIA OmniDreams
NVIDIA OmniDreams: Real-Time Generative World Model for Closed-Loop Autonomous Vehicle Simulation
2026 Interactive Simulation Β· Closed-Loop Evaluation Β· Long-Tail Scenarios arXiv πŸ’»
Cosmos 3
Cosmos 3: Omnimodal World Models for Physical AI
2026 Omnimodal Foundation Model Β· World Generation Β· Physical AI arXiv πŸ’» 🌐
X-Foresight
X-Foresight: A Joint Vision-Action Causal Forecasting Network via Predictive World Modeling
2026 Video-Based World Modeling Β· Future Reasoning Β· VLA arXiv
Xiaomi EV World Model
Xiaomi Auto World Model: A Joint World Model Integrating Reconstruction and Generation for Autonomous Driving
2026 3D Reconstruction Β· World Generation Β· Autonomous Driving arXiv
GEM
GEM: Gaussian Evolution Model for Occupancy Forecasting and Motion Planning
2026 Occupancy Forecasting Β· 3D Scene Dynamics Β· Motion Planning arXiv
EponaV2
EponaV2: Driving World Model with Comprehensive Future Reasoning
2026 World Model Β· Data-Efficient Planning Β· Annotation-Free Learning arXiv πŸ’»
Code pending: The repository currently contains only a README and license; no implementation is present.
HorizonDrive
HorizonDrive: Self-Corrective Autoregressive World Model for Long-horizon Driving Simulation
2026 Autoregressive Simulation Β· Long-Horizon Rollout Β· Self-Correction arXiv πŸ’»
DAWN
The DAWN of World-Action Interactive Models
2026 World-Action Co-Modeling Β· Joint Prediction and Planning arXiv πŸ’»
DeepSight
DeepSight: Long-Horizon World Modeling via Latent States Prediction for End-to-End Autonomous Driving
2026 Latent-State Prediction Β· Long-Horizon World Modeling Β· VLM Reasoning arXiv πŸ’»
CoWorld-VLA
CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving
2026 Latent World Reasoning Β· Planning-Oriented VLA Β· 3D Grounding arXiv πŸ’»
DriveFuture
DriveFuture: Future-Aware Latent World Models for Autonomous Driving
2026 Latent World Model · Future-Conditioned Planning arXiv 🌐
X-Cache
X-Cache: Cross-Chunk Block Caching for Few-Step Autoregressive World Models Inference
2026 Real-Time Simulation Β· Autoregressive Video Generation Β· Inference Efficiency arXiv
DriveVA
DriveVA: Video Action Models are Zero-Shot Drivers
ECCV 2026 World-Model Planning Β· Domain Generalization Β· Robustness arXiv πŸ’»
ExploreVLA
ExploreVLA: Dense World Modeling and Exploration for End-to-End Autonomous Driving
ECCV 2026 Policy Exploration Β· Reinforcement Learning Β· World Modeling arXiv πŸ’» 🌐
Partial code: Data preprocessing and configuration files are public; model/training code and checkpoints remain pending.
DriveDreamer-Policy
DriveDreamer-Policy: A Geometry-Grounded World-Action Model for Unified Generation and Planning
2026 Geometry-Grounded World Model Β· Unified Generation and Planning arXiv πŸ’» 🌐
Uni-World VLA
Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Driving
ECCV 2026 Unified VLA and World Model Β· Closed-Loop Planning arXiv πŸ’»
Latent-WAM
Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving
2026 Latent World-Action Model Β· Spatial Representation Β· Temporal Dynamics arXiv
X-World
X-World: Controllable Ego-Centric Multi-Camera World Models for Scalable End-to-End Driving
2026 Simulation Benchmark Β· VLA Evaluation Β· Controllable Scenarios arXiv
Fast-WAM
Fast-WAM: Do World Action Models Need Test-time Future Imagination?
2026 World-Action Model Β· Training-Time Imagination Β· Inference Efficiency arXiv πŸ’» 🌐
WorldDrive
Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation
2026 WorldDrive Β· Scene Generation Β· Motion Planning arXiv πŸ’»
ResWorld
ResWorld: Temporal Residual World Model for End-to-End Autonomous Driving
ICLR 2026 Temporal Residual Dynamics Β· World-Model Planning arXiv πŸ’»
DriveWorld-VLA
DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving
2026 Unified VLA and World Model Β· Latent Dynamics Β· Joint Planning arXiv πŸ’»
UniDWM
UniDWM: Towards a Unified Driving World Model via Multifaceted Representation Learning
2026 Unified Driving World Model Β· Geometry and Dynamics arXiv
Drive-JEPA
Drive-JEPA: Video JEPA Meets Multimodal Trajectory Distillation for End-to-End Driving
2026 JEPA Β· Self-Supervised Video Learning Β· Planning Representation arXiv πŸ’»
UniDrive-WM
UniDrive-WM: Unified Understanding, Planning and Generation World Model for Autonomous Driving
2026 Unified VLM Planning Β· World Modeling Β· End-to-End Driving arXiv πŸ’» 🌐
The repository hosts the official project website; the Code button does not link to a released implementation.
2025
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
DriveLaW
DriveLaW:Unifying Planning and Video Generation in a Latent Driving World
2025 World-Action Model Β· Video Generation Β· Joint Planning arXiv πŸ’» 🌐
Official repository transferred from wm-research/DriveLaW to Xiaomi Research.
WorldRFT
WorldRFT: Latent World Model Planning with Reinforcement Fine-Tuning for Autonomous Driving
2025 Reinforcement Fine-Tuning Β· Latent World Model Β· End-to-End Planning arXiv πŸ’»
Code pending: The author repository currently contains a README and license; the README says code will be uploaded later.
MindDrive
MindDrive: An All-in-One Framework Bridging World Models and Vision-Language Model for End-to-End Autonomous Driving
2025 Trajectory Scoring Β· World-Model Planning Β· Multi-Modal Planning arXiv πŸ’» 🌐
SimScale
SimScale: Learning to Drive via Real-World Simulation at Scale
2025 Driving Simulation Β· Synthetic Data Generation Β· Policy Learning arXiv πŸ’» 🌐
DriveVLA-W0
DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving
2025 World-Model Pretraining Β· Data Scaling Laws Β· Policy Learning arXiv πŸ’»
WorldMirror
WorldMirror: Universal 3D World Reconstruction with Any-Prior Prompting
2025 3D Reconstruction Β· Geometric Foundation Model Β· World Representation arXiv πŸ’»
RAP
RAP: 3D Rasterization Augmented End-to-End Planning
2025 Alternative-Trajectory Generation Β· Closed-Loop Recovery Β· World Modeling arXiv πŸ’» 🌐
IRL-VLA
IRL-VLA: Training an Vision-Language-Action Policy via Reward World Model
2025 Inverse Reinforcement Learning Β· Policy Post-Training Β· VLA arXiv πŸ’»
Code pending: The repository contains the paper description and figures; no implementation is present.
World4Drive
World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Model
ICCV 2025 Self-Supervised World Model Β· Annotation-Free Planning arXiv πŸ’»
EponaV1
Epona: Autoregressive Diffusion World Model for Autonomous Driving
ICCV 2025 Autoregressive Video Diffusion Β· Long-Horizon Prediction Β· Planning arXiv πŸ’» 🌐
WoTE
End-to-End Driving with Online Trajectory Evaluation via BEV World Model
2025 Online Trajectory Evaluation Β· BEV World Model Β· Closed-Loop Planning arXiv πŸ’»
Cosmos-Transfer1
Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Control
2025 Controllable World Generation Β· Multi-Modal Conditioning Β· Simulation arXiv πŸ’»
HERMES
HERMES: A Unified Self-Driving World Model for Simultaneous 3D Scene Understanding and Generation
ICCV 2025 3D Scene Understanding Β· World Generation Β· Unified World Model arXiv πŸ’»
Cosmos
Cosmos World Foundation Model Platform for Physical AI
2025 World Foundation Model Β· Video Generation Β· Physical AI arXiv πŸ’»
2024
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
GaussianAD
GaussianAD: Gaussian-Centric End-to-End Autonomous Driving
2024 Gaussian Representation Β· 3D Scene Modeling Β· End-to-End Planning arXiv πŸ’»
LAW
Enhancing End-to-End Autonomous Driving with Latent World Model
ICLR 2025 Latent World Model Β· Self-Supervised Representation Β· End-to-End Planning arXiv πŸ’»
Vista
Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability
NEURIPS 2024 Driving World Model Β· Controllable Generation Β· Generalization arXiv πŸ’» 🌐
GenAD
Generalized Predictive Model for Autonomous Driving
CVPR 2024 Driving Video Prediction Β· Large-Scale Pretraining Β· Zero-Shot Generalization arXiv πŸ’» 🌐
Partial code: OpenDV download, preprocessing, and annotation tools are public; a GenAD predictive-model implementation was not verified.
WoVoGen
WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generation
ECCV 2024 World Volume Β· Multi-Camera Generation Β· Diffusion Model arXiv πŸ’»
Drive-WM
Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving
CVPR 2024 Multi-View Forecasting Β· Counterfactual Planning Β· World Model arXiv πŸ’» 🌐
Code pending: The repository contains the Diffusers codebase; paper-specific model weights and training code remain pending.
DrivingDiffusion
DrivingDiffusion: Layout-Guided multi-view driving scene video generation with latent diffusion model
ECCV 2024 Latent Diffusion Β· Multi-View Video Β· Layout Control arXiv πŸ’»
Code pending: Some configurations and custom Diffusers components are present; the README still lists training and inference as coming soon.
DriveDreamer
DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving
ECCV 2024 Diffusion World Model Β· Real-World Driving Β· Controllable Generation arXiv πŸ’»
2023
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
OccWorld
OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving
2023 Occupancy World Model Β· 3D Scene Forecasting Β· Planning arXiv πŸ’»
ADriver-I
ADriver-I: A General World Model for Autonomous Driving
2023 Vision-Action Modeling Β· Autoregressive Prediction Β· Driving Control arXiv
GAIA-1
GAIA-1: A Generative World Model for Autonomous Driving
2023 Generative World Model Β· Video Prediction Β· Action Conditioning arXiv
2022
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
MILE
Model-Based Imitation Learning for Urban Driving
NeurIPS 2022 Latent Dynamics Β· Model-Based Imitation Β· Urban Driving arXiv πŸ’»
2021
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
World on Rails
Learning to Drive from a World on Rails
ICCV 2021 Factorized World Model Β· Model-Based Imitation Β· CARLA arXiv πŸ’» 🌐
DriveGAN
DriveGAN: Towards a Controllable High-Quality Neural Simulation
CVPR 2021 Controllable Simulation Β· Action-Conditioned Generation Β· Neural World Model arXiv πŸ’»

Recursive Self-Improvement for Autonomous Driving

18 papers; 6 with a verified public code link.

2026
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
RoXDrive
RoXDrive: Closed-Loop Reinforcement Learning for End-to-End Autonomous Driving via Action-Faithful Rollouts
2026 World-Model Feedback Β· Closed-Loop Policy Improvement Β· Action-Faithful Rollouts arXiv πŸ’» 🌐
Code pending: The official repository contains a README and project-page assets; implementation is not released.
OPTED
OPTED: On-Policy Fine-Tuning for End-to-End Driving using a Render-Free Teacher
2026 On-Policy Fine-Tuning · Privileged Teacher · Reinforcement Learning arXiv 🌐
DriveZero
DriveZero: End-to-End Driving Beyond Human Demonstrations
2026 Self-Play Β· Closed-Loop Reinforcement Learning Β· Teacher Distillation πŸ’» 🌐
Partial code: DriveRL inference code and checkpoints are public; DriveZero and DriveVFM remain unchecked on the release roadmap.
Self-Improving Autonomous Vehicles
Self-Improving Autonomous Vehicles via Real-World Reinforcement Learning
IJCAI 2026 Real-World Reinforcement Learning Β· Informative Scenario Collection Β· Safety-Aware Exploration Paper
CL4AD
Scaling Curriculum Learning For Autonomous Driving
Under review at NeurIPS 2026 Curriculum Learning Β· Reinforcement Learning Β· Sample Efficiency arXiv πŸ’»
AlignADV
From Attacks to Curricula: Learnability-Guided Adversarial Training for Safe Autonomous Driving
2026 Adversarial Training · Curriculum Learning · Safety arXiv 🌐
EvoDrive
EvoDrive: Pareto Evolution for Safety-Critical Autonomous Driving via Self-Improving LLM Agents
arXiv 2026 Agentic Evolution Β· Safety-Critical Scenario Generation Β· Pareto Optimization arXiv πŸ’» 🌐
The GitHub repository hosts the project website only; no implementation was verified.
Agentic AI + SkillBank
Agentic AI in Autonomous Driving: LLM-Enhanced RL with Reusable Skills and Adaptive Exploration for Enhanced Safety
ICAART 2026 LLM-Guided Reinforcement Learning Β· Reusable Driving Skills Β· Continual Self-Improvement Paper
Dense Learning
Breaking through safety performance stagnation in autonomous vehicles with dense learning
Nature Communications 2026 Dense Reinforcement Learning Β· Safety-Critical Learning Β· Real-World Testing Paper πŸ’»
2025
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
Safe-Evolving RL
An Uncertainty-Aware Safe-Evolving Reinforcement Learning Algorithm for Decision-Making and Control in Highway Autonomous Driving
Eng. Appl. Artif. Intell. 2025 Safe Online Reinforcement Learning Β· Policy Improvement Stability Β· Uncertainty-Aware Control Paper
Mechanism-Experience Learning
A Safe and Efficient Self-Evolving Algorithm for Decision-Making and Control of Autonomous Driving Systems
IEEE T-ITS 2025 Self-Evolving Driving Policy Β· Mechanism-Experience Learning Β· Safety-Constrained Optimization arXiv
Expert-Agent Feedback
Integrating Expert-Agent Bi-Directional Positive Feedback for Autonomous Driving Through Reinforcement Learning
Intelligent Transportation Engineering 2025 Expert-Agent Co-Evolution Β· Online Interaction Data Β· Reinforcement Learning Paper πŸ’»
Safe Self-Evolution with Risk Quantification
A Safe Self-Evolution Algorithm for Autonomous Driving Based on Data-Driven Risk Quantification Model
Accid. Anal. Prev. 2025 Risk-Aware Self-Evolution Β· Safe Driving Policy Β· Simulation and Real-Vehicle Testing Paper
Gigaflow
Robust Autonomy Emerges from Self-Play
ICML 2025 Self-Play · Closed-Loop Reinforcement Learning · Large-Scale Simulation arXiv 🌐
2024
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
Human Feedback for Intelligent Driving
Human Feedback Enhanced Autonomous Intelligent Systems: A Perspective from Intelligent Driving
Autonomous Intelligent Systems 2024 Human Feedback Β· Self-Evolving Intelligent Driving Β· Interactive Reinforcement Learning Paper
2023
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
DCARL
Continuous Improvement of Self-Driving Cars Using Dynamic Confidence-Aware Reinforcement Learning
Nat. Mach. Intell. 2023 Confidence-Aware Reinforcement Learning Β· Continuous Policy Improvement Β· Real-World Driving Paper πŸ’»
2022
🧠 Method πŸ—“οΈ Year / Venue 🏷️ Tags πŸ”— Resources
Self-Improving Safety RL
Self-Improving Safety Performance of Reinforcement Learning Based Driving with Black-Box Verification Algorithms
arXiv 2022 Black-Box Verification Β· Failure-Driven Policy Updates Β· Safety-Critical Scenarios arXiv πŸ’»
Trustworthy Improvement RL
Trustworthy Safety Improvement for Autonomous Driving Using Reinforcement Learning
Transp. Res. Part C 2022 Trustworthy Reinforcement Learning Β· Baseline-Guarded Improvement Β· Highway Safety Paper

Public Datasets

Dataset access terms and releases follow the original providers. The source and inspiration repositories are listed in Acknowledgements.

Perception and Multimodal Understanding

29 datasets.

Dataset / Method and Paper Title Task Scale Access Resources
KITTI
The KITTI Vision Benchmark Suite
Perception, Tracking, and Depth Stereo video; LiDAR; Karlsruhe routes Open 🌍 πŸ“„
Cityscapes
The Cityscapes Dataset for Semantic Urban Scene Understanding
Semantic Segmentation 5,000 finely annotated images; 50 cities Registration 🌍 πŸ“„
nuScenes
A Multimodal Dataset for Autonomous Driving
3D Detection and Tracking 1,000 scenes; 6 cameras; LiDAR and radar Registration 🌍 πŸ“„ πŸ’»
Waymo Open Dataset
Waymo Open Dataset: An Autonomous Driving Dataset
Perception, Motion, and End-to-End Driving Perception, Motion, and End-to-End subsets Registration 🌍 πŸ“„ πŸ’»
Argoverse 2
Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecasting
Perception and Motion Forecasting 6 US cities; multiple sensor and motion datasets Open 🌍 πŸ“„ πŸ’»
PandaSet
PandaSet: Advanced Sensor Suite Dataset for Autonomous Driving
3D Detection and Segmentation 100+ scenes; 7 cameras; 2 lidars Registration 🌍 πŸ’»
ONCE
One Million Scenes for Autonomous Driving
3D Detection and Self-Supervised Learning 1M scenes; 7 cameras; 1 lidar Open 🌍 πŸ“„ πŸ’»
Audi A2D2
A2D2: Audi Autonomous Driving Dataset
Perception and Semantic Segmentation Around 40,000 frames; 6 cameras; 5 lidars Open 🌍 πŸ’»
BDD100K
BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning
Video, Detection, and Segmentation 100K videos; 10 tasks Registration 🌍 πŸ“„ πŸ’»
ApolloScape
The ApolloScape Open Dataset for Autonomous Driving and Its Application
Perception and Scene Parsing Multiple cities; stereo and surround-view tasks Registration 🌍 πŸ“„
Honda H3D
The H3D Dataset for Full-Surround 3D Multi-Object Detection and Tracking in Crowded Urban Scenes
3D Detection and Tracking 160 scenes; 27,721 frames; 1M labeled instances Open 🌍 πŸ“„
Mapillary Vistas
The Mapillary Vistas Dataset for Semantic Understanding of Street Scenes
Semantic and Instance Segmentation 25K images; 66 object categories Registration 🌍 πŸ“„ πŸ’»
Talk2Car
Taking Control of Your Self-Driving Car
Language Grounding 11,959 commands; 850 videos Open 🌍 πŸ“„ πŸ’»
SUTD-TrafficQA
A Question Answering Benchmark and an Efficient Network for Video Reasoning over Traffic Events
Traffic Video QA 10,080 videos; 62,535 QA pairs Request 🌍 πŸ“„ πŸ’»
DRAMA
Joint Risk Localization and Captioning in Driving
Risk Localization & Captioning 17,785 scenarios Open 🌍 πŸ“„
NuScenes-QA
A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenario
Multimodal Driving QA 34,149 scenes; 459,941 QA pairs Open 🌍 πŸ“„ πŸ’»
DriveGPT4 / BDD-X
Interpretable End-to-end Autonomous Driving via Large Language Model
Instruction Tuning & Control 16,803 train; 2,123 test clips Project 🌍 πŸ“„
LingoQA
Visual Question Answering for Autonomous Driving
Driving Video QA 28K scenarios; 419K annotations Open 🌍 πŸ“„ πŸ’»
DriveLM
Driving with Graph Visual Question Answering
Graph Visual QA 4,072 train; 799 validation frames Open 🌍 πŸ“„ πŸ’»
MAPLM
A Real-World Large-Scale Vision-Language Dataset for Map and Traffic Scene Understanding
Map & Traffic Understanding 2M point clouds; panoramic imagery Open 🌍 πŸ’»
NuInstruct
Holistic Autonomous Driving Understanding by Bird's-Eye-View Injected Multi-Modal Large Models
Multi-view Instruction QA 91K pairs; 17 subtasks Open 🌍 πŸ“„ πŸ’»
CODA-LM
Automated Evaluation of Large Vision-Language Models on Self-driving Corner Cases
Corner-case Evaluation 9,768 scenarios; 63K+ annotations Open 🌍 πŸ“„ πŸ’»
OmniDrive-nuScenes
A Holistic LLM-Agent Framework for Autonomous Driving with 3D Perception, Reasoning and Planning
3D Perception & Reasoning nuScenes-derived; offline and online QA Open 🌍 πŸ“„ πŸ’»
Senna Planning QA
Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Driving
Planning-oriented QA Generated from nuScenes Generation Scripts 🌍 πŸ“„ πŸ’»
Rank2Tell
A Multimodal Driving Dataset for Joint Importance Ranking and Reasoning
Importance Ranking and Reasoning Driving videos with dense QA annotations Open 🌍 πŸ“„
doScenes
An Autonomous Driving Dataset with Natural Language Instruction for Human Interaction and Vision-Language Navigation
Natural-Language Driving Instructions Public instruction and referentiality annotations Open 🌍 πŸ“„ πŸ’»
nuScenes-MQA
Integrated Evaluation of Captions and QA for Autonomous Driving Datasets using Markup Annotations
Captioning and Visual QA nuScenes-based multimodal captions and QA Research Release 🌍 πŸ“„
BDD-OIA
Explainable Object-induced Action Decision for Autonomous Vehicles
Explainable Driving Decisions BDD100K-derived video annotations Open 🌍 πŸ“„
HAD Advice
Grounding Human-to-Vehicle Advice for Self-Driving Vehicles
Language Grounding and Advice Human-to-vehicle advice annotations Open 🌍 πŸ“„

Motion, Planning, and Cooperative Driving

10 datasets.

Dataset / Method and Paper Title Task Scale Access Resources
INTERACTION
The INTERACTION Dataset: A Road Intersection-Centric Autonomous Driving Dataset
Motion Forecasting and Planning 11 locations; 10 Hz trajectories Open 🌍 πŸ“„ πŸ’»
highD
The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways
Vehicle Trajectory Prediction 110,000 vehicles; 60 recording hours Request 🌍 πŸ“„
Waymo Open Motion Dataset
Large Scale Interactive Motion Forecasting for Autonomous Driving
Interactive Motion Forecasting More than 100,000 20-second segments Registration 🌍 πŸ“„ πŸ’»
nuPlan
nuPlan: A Closed-Loop ML-Based Planning Benchmark for Autonomous Vehicles
Planning and Closed-Loop Simulation 1,282 hours; 4 cities Registration 🌍 πŸ“„ πŸ’»
PIE
PIE: A Large-Scale Dataset and Models for Pedestrian Intention Estimation and Trajectory Prediction
Pedestrian Intention and Trajectory Prediction 6+ hours; 300K+ labeled frames; 1,842 pedestrians Open 🌍 πŸ“„ πŸ’»
Lyft Level 5
One Thousand and One Hours: Self-driving Motion Prediction Dataset
Motion Forecasting and Planning 1,118 hours; about 170K scenes Request 🌍 πŸ“„ πŸ’»
DAIR-V2X
DAIR-V2X: A Large-Scale Benchmark for Vehicle-Infrastructure Cooperative 3D Object Detection
Vehicle-Infrastructure Cooperative Perception Vehicle and infrastructure sensor pairs Open 🌍 πŸ“„ πŸ’»
V2X-Seq
V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecasting
Cooperative Perception and Forecasting 4 scenarios; sequential multi-agent data Open 🌍 πŸ“„ πŸ’»
V2V4Real
V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perception
Vehicle-to-Vehicle Cooperative Perception 410 km; 20K LiDAR frames; 40K RGB frames; 240K boxes Open 🌍 πŸ“„ πŸ’»
OPV2V
OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communication
Cooperative Perception 73 scenes; 11,464 frames Open 🌍 πŸ“„ πŸ’»

Simulation and Synthetic Data

7 datasets.

Dataset / Method and Paper Title Task Scale Access Resources
CARLA Simulator
CARLA: An Open Urban Driving Simulator
Closed-Loop Driving Simulation Open-source simulator; multiple towns and scenarios Open 🌍 πŸ“„ πŸ’»
Virtual KITTI 2
Virtual KITTI 2
Synthetic Perception and Domain Transfer 5 scenarios; 5 weather and imaging conditions Open 🌍 πŸ“„
SHIFT
SHIFT: A Synthetic Driving Dataset for Continuous Multi-Task Domain Adaptation
Synthetic Multi-Task Perception 70+ hours; 2.5M annotated frames Open 🌍 πŸ“„ πŸ’»
DeepAccident
DeepAccident: A Motion and Accident Prediction Benchmark for V2X Autonomous Driving
Accident and Cooperative Perception 57K annotated frames; 285K samples; 691 scenarios Open 🌍 πŸ“„ πŸ’»
NAVSIM
Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking
Planning Evaluation OpenScene-derived; navtrain and navtest splits Open 🌍 πŸ“„ πŸ’»
Bench2Drive
Towards Multi-Ability Benchmarking of Closed-Loop End-to-End Autonomous Driving
Interactive Closed-Loop Driving 220 routes; 2M+ frames Open 🌍 πŸ“„ πŸ’»
HUGSIM
HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Driving
Photorealistic Closed-Loop Simulation Real-world reconstructed driving scenes Open 🌍 πŸ“„ πŸ’»

Public Evaluation Benchmarks

Benchmarks are grouped by evaluation protocol and research task; scores from different protocols remain separate.

Closed-Loop Planning

3 benchmarks.

Benchmark Track Evaluation Setting Primary Metric Resources
Bench2Drive End-to-End Planning CARLA closed-loop Driving Score 🌍 πŸ“„ πŸ’»
nuPlan Planning Reactive closed-loop Closed-loop score 🌍 πŸ“„ πŸ’»
CARLA Leaderboard 2.0 End-to-End Planning Interactive closed-loop Driving Score 🌍 πŸ’»

Open-Loop and Non-Reactive Planning

2 benchmarks.

Benchmark Track Evaluation Setting Primary Metric Resources
NAVSIM End-to-End Planning Non-reactive simulation PDMS 🌍 πŸ“„ πŸ’»
nuScenes Planning Planning / World Model Open-loop log replay Avg. L2 / Collision 🌍 πŸ“„ πŸ’»

VLA and Driving Reasoning

2 benchmarks.

Benchmark Track Evaluation Setting Primary Metric Resources
DriveLM VLA / Reasoning Graph VQA Accuracy / language metrics 🌍 πŸ“„ πŸ’»
Reason2Drive VLA / Reasoning Video-text reasoning Reasoning score 🌍 πŸ“„ πŸ’»

Reliability and Robustness

1 benchmark.

Benchmark Track Evaluation Setting Primary Metric Resources
DriveBench VLA / Reliability 17 visual reliability settings Accuracy / language / GPT score 🌍 πŸ“„ πŸ’»

Leaderboard

Benchmark results are stored in data/leaderboard.json. Each entry preserves its evaluation protocol, data split, and reproducibility evidence. Results from incompatible protocols are not ranked together.

License

This project is released under the Apache License 2.0.

Acknowledgements

We thank the maintainers of GE2EAD, GenAI4AD, and ReCogDrive for their research collections and dataset references, which helped inform this catalog. Please consult the original projects for their own licenses and access terms.

About

We keep up with cutting-edge research in autonomous driving, analyze outstanding works based on evaluation benchmarks including NAVSIM, Bench2Drive and HUGSIM, and integrate technology and philosophy to drive the advancement of safe and efficient autonomous driving.

Topics

Resources

Contributing

Stars

3 stars

Watchers

2 watching

Forks

Releases

Packages

Contributors

Languages