Abstract
Autonomous driving technologies have achieved significant advances in recent years, yet their real-world deployment remains constrained by data scarcity, safety requirements, and the need for generalization across diverse environments. In response, synthetic data and virtual environments have emerged as powerful enablers, offering scalable, controllable, and richly annotated scenarios for training and evaluation. This survey presents a comprehensive review of recent developments at the intersection of autonomous driving, simulation technologies, and synthetic datasets. We organize the landscape across three core dimensions: (i) the use of synthetic data for perception and planning, (ii) digital twin-based simulation for system validation, and (iii) domain adaptation strategies bridging synthetic and real-world data. We also highlight the role of vision-language models and simulation realism in enhancing scene understanding and generalization. A detailed taxonomy of datasets, tools, and simulation platforms is provided, alongside an analysis of trends in benchmark design. Finally, we discuss critical challenges and open research directions, including Sim2Real transfer, scalable safety validation, cooperative autonomy, and simulation-driven policy learning, that must be addressed to accelerate the path toward safe, generalizable, and globally deployable autonomous driving systems.
| Original language | English |
|---|---|
| Pages (from-to) | 1-21 |
| Number of pages | 21 |
| Journal | IEEE Transactions on Intelligent Transportation Systems |
| DOIs | |
| Publication status | Published - 6 Apr 2026 |
Keywords
- Autonomous driving
- Deep Learning
- Autonomous Vehicle
- Synthetic Data
- Real2Sim
- Multimodal Learning
- Semantic Understanding
- Vision-Language Models
- semantic understanding
- vision-language models
- multimodal learning
- Sim2Real
- deep learning
- synthetic data
Fingerprint
Dive into the research topics of 'From Virtual Environments to Real-World Trials: Emerging Trends in Autonomous Driving'. Together they form a unique fingerprint.Student theses
-
A Relational Modelling Approach for Traffic Scene Understanding and Photorealistic Virtual Scenario Generation
HUMNABADKAR, A. S. (Author), BEHERA, A. (Director of Studies) & ZHANG, H. (Supervisor), 2026Student thesis: Doctoral Thesis
File
Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver