Virtual Pattern Projection Device

Method to ease visual correspondence in images using virtual projected patterns obtained replacing a conventional pattern projector with a robust depth sensor

Patent title Virtual Pattern Projection Device
Thematic area Industry, Digital and Security
Ownership ALMA MATER STUDIORUM - UNIVERSITA' DI BOLOGNA
Inventors Matteo Poggi, Fabio Tosi, Luca Bartolomei, Stefano Mattoccia
Protection National
Licensing status Italy (IT)
Filed on 13 July 2023

Despite the improvements enabled by deep-learning, passive stereo struggles facing the visual correspondence problem in some circumstances like, for instance, in the presence of untextured regions. Purposely, active systems project patterns onto the sensed scene to ease this task. However, pattern projectors have severe limitations; they only work at close range, without sunlight, can interfere with other projectors, have thermal drift, etc.

The proposed method enables the effectiveness of active systems without a pattern projector, with all its inherent limitations. The virtual projection in our solution is achieved leveraging a robust depth sensor. Moreover, our method can be extended to other configurations (e.g. multi-view stereo, monocular depth estimation, depth completion, optical flow)

All application fields needing scene depth/flow perception. Improve depth/flow perception enabling higher robustness to domain change issues affecting deep-learning networks. The envisioned setup is already available in many target application fields (e.g., autonomous/assisted driving) and consumer devices (e.g., smartphones and tablets)

Page published on: 28 August 2023