Consumer drones · Quality-guided capture · 3D Gaussian Splatting

OpenFlyScanA Quality-Guided Aerial Reconstruction System for Consumer Drones

Zhongrui You1,2Zhen Li2,3Junli Liu2,4Zhigang Wang2Bin Zhao2,4
1 Beihang University2 Shanghai Artificial Intelligence Laboratory3 Shanghai Jiao Tong University4 Northwestern Polytechnical University

TL;DR: OpenFlyScan predicts regional 3DGS reconstruction quality and guides targeted reacquisition with consumer drones to improve large-scale urban reconstructions.

Expo East Gaussian reconstruction rendered in Unreal Engine, showing garden buildings, trees, and ponds from an oblique aerial view.
EXPO EAST3DGS reconstruction from consumer-drone imageryView reconstructed scenes

Expo East · Gaussian reconstruction rendered in Unreal Engine

01Capture

Automated oblique surveys

02Assess & reacquire

Learned regional quality feedback

03Reconstruct

Gaussian scenes for UAV simulation

Video

2 min 59 sec · English narration

Real-world takeoff, automated capture, regional quality prediction, targeted reacquisition, and reconstruction for UAV simulation.

Overview

Constructing large-scale urban 3DGS assets remains constrained by equipment costs and delayed quality feedback. Preset surveys can leave complex surfaces insufficiently observed, with defects discovered only after reconstruction. OpenFlyScan is a quality-guided aerial reconstruction system for consumer drones that integrates a GS quality model, a reacquisition planner, and a custom-designed mobile app.

The model learns from GS rendering errors to predict regional quality before target-scene reconstruction. These predictions guide complementary reacquisition strips, executed through the app, which also supports automated oblique surveys and data transfer without additional onboard hardware. Initial-survey and additional images are jointly reconstructed.

Reconstructed Scenes

Interactive GS viewer · Spark

Field captures and reconstructions of real-world datasets. Simulation scenes are excluded.

Static preview of the Expo East reconstruction
Interactive preview · Spark

Expo East

An urban site reconstructed from real aerial captures.

Watch the reconstruction in our video ↗

Click to load a scene. The 3D viewer downloads scene data and uses your GPU.

Method

The mobile app manages capture and mission execution, while a remote workstation predicts regional reconstruction quality and plans targeted reacquisition.

Consumer-drone capture, timely quality feedback, targeted reacquisition, and joint reconstruction.

GS quality model

The GS quality model consists of a frozen pretrained Pi3X backbone and a trainable cross-modal Quality Predictor. It combines multi-view image features, feed-forward geometry, and relative camera geometry to predict regional reconstruction quality.

Base supervision uses measured regional GS rendering errors; Sparse supervision uses weak targets constructed by removing supporting observations.

Read the method in the paper ↗

Real-World Reacquisition Results

+10.95 dBPSNR at additional views · Expo West

At Expo West, our method improves the reconstruction of roof grating and glass-panel boundaries. The sliders compare the initial reconstruction with joint reconstruction after targeted reacquisition.

Blurred roof grating in the initial reconstructionClearer roof grating after our targeted reacquisitionBeforeOurs

Roof grating

Indistinct glass-panel framing in the initial reconstructionMore distinct glass-panel framing after our targeted reacquisitionBeforeOurs

Glass roof

View the full comparison with SfM and SwiftMap-AdaptFull paper figure comparing Before, SfM, SwiftMap-Adapt, and Ours at Expo West, with roof and glass close-ups.

Original comparison from the paper. The reported PSNR gain is evaluated at registered additional views, not across the entire scene.

Resources

BibTeX

@unpublished{you2026openflyscan,
  title = {OpenFlyScan: A Quality-Guided Aerial Reconstruction
           System for Consumer Drones},
  author = {You, Zhongrui and Li, Zhen and Liu, Junli and
            Wang, Zhigang and Zhao, Bin},
  year = {2026},
  note = {Preprint}
}

Preprint citation. The arXiv identifier will be added after publication.

Acknowledgments

We thank Shanghai Artificial Intelligence Laboratory for providing computing resources, UAV platforms, experimental facilities, and technical support for model training and real-world deployment.