1212
GitHub - Insta360-Research-Team/AirSim360: Official implementation of "AirSim360: A Panoramic Simulation Platform within Drone View" Β· GitHub
Skip to content

Insta360-Research-Team/AirSim360

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

7 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

🚁 AirSim360: A Panoramic Simulation Platform within Drone View

CVPR 2026 arXiv Project Page Hugging Face Dataset

AirSim360 is a high-fidelity omnidirectional (360Β°) aerial simulation stack built on Unreal Engine 5.


AirSim360 paper teaser figure

πŸ“– Introduction

AirSim360 addresses the lack of large-scale, diverse equirectangular (ERP) drone data by supporting closed-loop flight with render-aligned multimodal exports. This repository provides release notes, user documentation, one synchronized demo sample, and media for the open release.

πŸ“‘ Table of Contents (Click to expand)

πŸ“’ Release Notice: The public upload of Omni360-Scene and Omni360-WayPoint may be delayed to around April 20, 2026 due to the large number of small files and network-related constraints. The software release is unaffected: both AirSim360 Air and AirSim360 Pro were updated on Hugging Face on April 17, 2026.


πŸ—“οΈ Update Log & Roadmap

This section will be updated continuously so users can track what has been released and what is coming next.

Date Type Status Details
2026-04-10 Software scenes Released First public scene packages are available: CityDowntown, Factory, SpanishCourtyard, DekogonGym, and AtmosphericHouse.
2026-04-17 AirSim360 Pro Released AirSim360 Pro is now publicly available.
From 2026-05 Monthly updates Planned New software scenes and dataset content will be added regularly.
Before the end of Q2 2026 Platform expansion Planned Linux support, more dynamic humans, and related calling methods will be added in later releases.
TBD Future release entry Reserved Add each new public release note here as the repository grows.

πŸ’» Hardware Requirements

To handle the stunning realism and simultaneous rendering of panoramic RGB, depth, and semantics, you will need a solid rig.

🐧 Linux user? Support is landing in Q2 2026. πŸͺŸ Windows user? Windows 10 & 11 are supported!

Specs Minimum (For casual flights) Recommended (For high-FPS panoramic data processing)
GPU NVIDIA GPU with 16GB+ VRAM NVIDIA GPU with 24GB+ VRAM
RAM 16GB+ System RAM 32GB+ System RAM

⚑ Quick Start

1. Download and install AirSim360 software

2. Start with the currently released datasets

  • Current public dataset tracks include Omni360-Scene and Omni360-WayPoint.
  • Omni360-Scene β€” Download on Hugging Face
  • Omni360-WayPoint β€” Download on Hugging Face
  • Note: the final public upload of both tracks may be delayed to around April 20, 2026.
  • Omni360-Scene follows the same structure shown in the demo sample: every frame is aligned across modalities by a shared file stem.
  • The core released modalities are:
    • Raw (panorama): Equirectangular RGB images.
    • Depth: True Euclidean depth in meters, stored as HDF5 datasets.
    • Semantic (seg_panorama): Semantic labels with class IDs carried in the Alpha channel.
    • Instance (instance_panorama): Instance labels where (Alpha, R, G, B) uniquely identifies an object, with Alpha storing the semantic class ID.
  • See data/demo_sample/PANORAMIC_DATA_FORMAT.md for the full format specification, and data/demo_sample/depth/read_depth_h5.py for a minimal depth reader.
  • A dedicated Omni360-WayPoint section with dataset breakdown and demo scripts will be added in a future update.

βš–οΈ AirSim360 Air vs. Pro

Feature πŸ•ΉοΈ AirSim360 Air πŸ› οΈ AirSim360 Pro
Target Users Researchers who want keyboard-and-mouse data collection with minimal setup. Developers who need programmatic control, batch capture, and integration.
Control Mode Integrated control panel, hotkeys (W/S, A/D), and multi-viewport feedback (FPV/TPV). Python / RPC workflow with an AirSim-style client interface.
Panorama and Sensors One-click capture with a direct collection workflow. Sensors are enabled via code; panorama resolution is fully configurable.
API Support No Yes
Typical Strengths Fast setup, simple collection, direct operation, zero environment setup. Automation, external control, code-driven sensors, API-based experiments.

Guides: Air User Guide Β· Pro User Guide

AirSim360 Air Demo

A short demo video of AirSim360 Air, showing its direct-use workflow and panoramic data collection interface.


πŸ“‚ Repository Layout

Path Purpose
πŸ“ software English user guides for AirSim360 Air and AirSim360 Pro. The software packages themselves are not stored in this repository; download links will be provided separately.
πŸ“ data/demo_sample One synchronized demo sample plus usage notes that explain the released data format. The full dataset address will be published separately.
πŸ“ media Static visuals, figures, UI screenshots, and diagram exports used in the project page and documentation.
πŸ“ scripts Small cross-cutting utilities (format conversion, batch checks, packaging helpers) that are not tied to a single dataset folder.

πŸ—ΊοΈ Available Software Scenes

The following scene packages are currently listed in the public software release. More scenes will be added over time, with monthly updates rolling out on the 15th of each month starting May 2026.

Scene Air Pro API Dynamic Actors
CityDowntown Yes Yes Pro only Planned
Factory Yes Yes Pro only Planned
SpanishCourtyard Yes Yes Pro only Planned
DekogonGym Yes Yes Pro only Planned
AtmosphericHouse Yes Yes Pro only Planned
New scenes coming in May Planned Planned Planned Planned

πŸ“₯ Download Access: All available scene packages and environment assets can be downloaded directly from the AirSim360 Hugging Face Repository.


🌍 Omni360-Scene

Omni360-Scene is the current panoramic scene-understanding release in the Omni360-X collection. The sample under data/demo_sample shows the core organization used by this dataset: the same frame stem is shared across RGB, depth, semantic, and instance labels, which makes multimodal alignment straightforward.

The current public specification focuses on four aligned outputs:

  • Raw (panorama): Equirectangular RGB images.
  • Depth: True Euclidean depth in meters, saved as an HDF5 /depth dataset with float32 values directly in meters β€” no rescaling or de-quantization is needed when reading. Maximum supported distance is 1000 m. For backward compatibility, the reader (data/demo_sample/depth/read_depth_h5.py) also accepts the legacy uint16 format with a depth_range_m attribute, recovered via depth_uint16 / 65535 * depth_range_m.
  • Semantic (seg_panorama): Semantic labels aligned pixel-by-pixel with the panorama, where the Alpha channel stores the semantic class ID. The mapping of class names to IDs is recorded in the semantic_list text file.
  • Instance (instance_panorama): Instance labels where the (Alpha, R, G, B) tuple identifies a specific object instance, with Alpha storing the semantic class ID.

Omni360-X panorama RGB (frame 3080) Omni360-X depth visualization (frame 3080) Omni360-X semantic segmentation (frame 3080) Omni360-X instance segmentation (frame 3080)

The current public release covers three main scenes with full support for all four modalities (RGB, depth, semantic, and instance). The corresponding semantic label IDs are shipped alongside each dataset.

Scene RGB Depth Semantic Instance Open-Source Count
City Park Environment Collection βœ… βœ… βœ… βœ… 80,000
Downtown West Modular Pack βœ… βœ… βœ… βœ… 24,812
New York City βœ… βœ… βœ… βœ… 20,716
Current public total β€” β€” β€” β€” 125,528

Notes:

  1. Additional premium/paid scenes will be released and updated on a monthly basis.
  2. Appropriate randomization has been applied to all 6 degrees of freedom (6-DoF) for the panoramic camera across the provided datasets. This ensures a diverse variety of viewing positions and directions, rather than fixing a single orientation.

πŸ›£οΈ Long-Term Open-Source Plan

  • Starting May 2026, we will release 5 new AirSim360 scenes each month, shared across the Air and Pro editions.
  • Starting May 2026, we will also release 2 new dataset scenes each month, each containing 2,000 panoramic images. Data types will be adjusted based on developer feedback, and community suggestions are welcome.
  • Before the end of Q2 2026, we will provide additional dynamic human assets inside the AirSim360 software packages, along with the corresponding calling methods and automatic ground attachment for human placement β€” so developers no longer need to know ground coordinates in advance.
  • We welcome feedback on software usage. Adopted suggestions will be acknowledged in a new section at the end of this page.
  • The panoramic plugin and other useful features will be published separately on FAB, and will be free for individual developers.

🀝 Acknowledgement

We gratefully acknowledge the following open-source projects:


πŸ“ Citation

If you find our work useful in your research, please consider citing:

@article{ge2025airsim360,
  title={Airsim360: A panoramic simulation platform within drone view},
  author={Ge, Xian and Pan, Yuling and Zhang, Yuhang and Li, Xiang and Zhang, Weijun and Zhang, Dizhe and Wan, Zhaoliang and Lin, Xin and Zhang, Xiangkai and Liang, Juntao and others},
  journal={arXiv preprint arXiv:2512.02009},
  year={2025}
}

About

Official implementation of "AirSim360: A Panoramic Simulation Platform within Drone View"

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages