Method for determining the depth from images by self-adaptive learning

The invention refers to a method for 3D reconstruction using a stereo camera and a neural network based on automatic learning which self- adapts to the different environmental conditions during operation.

Patent title Method to determine the depth from images by self-adaptive learning of a neural network and system thereof
Thematic area Industry, Digital and Security
Ownership ALMA MATER STUDIORUM - UNIVERSITA' DI BOLOGNA
Inventors Matteo Poggi, Alessio Tonioni, Fabio Tosi, Stefano Mattoccia, Luigi Di Stefano
Protection Italy, Europe, USA, China
Licensing status Available for development agreements, option, license and other exploitation agreements
Keywords 3D reconstruction, Stereo matching, Deep learning, Self-adaptive, Depth from images
Filed on 02 December 2019

The information on the depth of the observed points is crucial and some times essential in applications such as, for example, autonomous or assisted driving, 3D reconstruction starting from 2D images or Augmented Reality.

The patented method reduces the need for data necessary for the network training before it becomes effective. Compared to deep learning techniques mainly based on Convolutional Neural Network implemented on bulky and/or high-energy consuming devices, they are less expensive in terms of computation. A low-energy-consumption stereo smart camera could be produced on the basis of the invention. It would be able to self-adapt to the examined environment in real time while processing stereo edge maps. 

APPLICATIONS:

  • Autonomous driving systems;
  • Computer Vision;
  • Robotics;
  • Augmented Reality,
  • Ricostruzione 3D.

ADVANTAGES:

  • Self-training system;
  • Accuracy maintained unchanged;
  • Image processing both on-board and on other external hardware devices.
Page published on: 27 January 2020