2024-03-28T19:50:32Zhttp://digital.csic.es/dspace-oai/requestoai:digital.csic.es:10261/1793372019-06-11T11:27:30Zcom_10261_106com_10261_4col_10261_1241
2019-04-04T11:38:38Z
urn:hdl:10261/179337
Deep lidar CNN to understand the dynamics of moving vehicles
Vaquero, Victor
Sanfeliu, Alberto
Moreno-Noguer, Francesc
Ministerio de Economía y Competitividad (España)
Moreno-Noguer, Francesc [https://orcid.org/0000-0002-8640-684X]
Laser radar
Task analysis
Vehicle dynamics
Three-dimensional displays
Dynamics
Machine learning
Semantics
Trabajo presentado en la IEEE International Conference on Robotics and Automation (ICRA), celebrado en Brisbane (Australia), del 21 al 25 de mayo de 2018
Perception technologies in Autonomous Driving are experiencing their golden age due to the advances in Deep Learning. Yet, most of these systems rely on the semantically rich information of RGB images. Deep Learning solutions applied to the data of other sensors typically mounted on autonomous cars (e.g. lidars or radars) are not explored much. In this paper we propose a novel solution to understand the dynamics of moving vehicles of the scene from only lidar information. The main challenge of this problem stems from the fact that we need to disambiguate the proprio-motion of the “observer” vehicle from that of the external “observed” vehicles. For this purpose, we devise a CNN architecture which at testing time is fed with pairs of consecutive lidar scans. However, in order to properly learn the parameters of this network, during training we introduce a series of so-called pretext tasks which also leverage on image data. These tasks include semantic information about vehicleness and a novel lidar-flow feature which combines standard image-based optical flow with lidar scans. We obtain very promising results and show that including distilled image information only during training, allows improving the inference results of the network at test time, even when image data is no longer used.
2019-04-04T11:38:38Z
2019-04-04T11:38:38Z
2018
comunicación de congreso
IEEE International Conference on Robotics and Automation (ICRA) (2018)
978-1-5386-3081-5
http://hdl.handle.net/10261/179337
10.1109/ICRA.2018.8460554
2577-087X
http://dx.doi.org/10.13039/501100003329
eng
http://dx.doi.org/10.1109/ICRA.2018.8460554
Sí
info:eu-repo/grantAgreement/MINECO/Plan Estatal de Investigación Científica y Técnica y de Innovación 2013-2016/TIN2017-90086-R
info:eu-repo/grantAgreement/MINECO/Plan Estatal de Investigación Científica y Técnica y de Innovación 2013-2016/DPI2016-78957-R
info:eu-repo/grantAgreement/MINECO/Plan Estatal de Investigación Científica y Técnica y de Innovación 2013-2016/MDM-2016-0656
openAccess
Institute of Electrical and Electronics Engineers