2026-05-20 アリゾナ大学

A mixed reflectance scene contains objects whose surfaces vary from matte, or dull (wooden box) to specular, or shiny (chrome figurines) and in-between reflectance (plant, statue). A laser (green light) scans the entire scene. After computational separation of matte and specular scene parts, the 3D shape of the matte parts is evaluated directly, and the specular parts are evaluated via the reflection signal from the matte parts, effectively turning them into a large virtual screen for the specular measurement. Aniket Dashpute et al.
<関連情報>
- https://news.arizona.edu/news/turning-surroundings-virtual-screen-could-help-machines-better-see-3d
- https://www.nature.com/articles/s41467-026-72254-6
混合反射シーンの正確かつ高速なイベントベース形状計測 Accurate and fast event-based shape measurement of mixed reflectance scenes
Aniket Dashpute,Jiazhang Wang,James Taylor,Oliver Cossairt,Ashok Veeraraghavan & Florian Willomitzer
Nature Communications Published:20 May 2026
DOI:https://doi.org/10.1038/s41467-026-72254-6
Abstract
Event-based structured light systems have recently emerged as an exciting alternative to frame-based triangulation for 3D measurement of diffuse surfaces, offering high dynamic range and fast capture speed, but at the cost of reduced data quality. Existing event-based and frame-based 3D imaging systems are typically tailored to a single surface reflectance type, diffuse or specular, and therefore struggle with mixed reflectance scenes. In this work, we present an event-based structured light system for fast and accurate 3D imaging of mixed reflectance scenes. Using epipolar constraints on the captured events, we decompose reflections into diffuse, two-bounce specular, and other multi-bounce reflections. Diffuse surfaces are reconstructed via triangulation and repurposed as a virtual screen for deflectometry to evaluate specular surfaces, requiring only a scanning laser and an event camera. Our system achieves motion-robust 3D reconstructions at < 600 μm depth accuracy and introduces a fast diffuse-only capture mode operating at 250 Hz.

