English   español  
Please use this identifier to cite or link to this item: http://hdl.handle.net/10261/195654
logo share SHARE logo core CORE   Add this article to your Mendeley library MendeleyBASE

Visualizar otros formatos: MARC | Dublin Core | RDF | ORE | MODS | METS | DIDL
Exportar a otros formatos:


Active perception with dynamic vision sensors. Minimum saccades with optimum recognition

AuthorsYousefzadeh, Amirreza; Orchard, Garrick; Serrano-Gotarredona, Teresa ; Linares-Barranco, Bernabé
Keywordsspiking neural networks
Artificial neural networks
convolutional neural networks
machine vision
neural network hardware
object recognition
robot vision systems
Issue DateAug-2018
PublisherInstitute of Electrical and Electronics Engineers
CitationIEEE Transactions on Biomedical Circuits and Systems 12(4): 927-939 (2018)
AbstractVision processing with dynamic vision sensors (DVSs) is becoming increasingly popular. This type of a bio-inspired vision sensor does not record static images. The DVS pixel activity relies on the changes in light intensity. In this paper, we introduce a platform for the object recognition with a DVS in which the sensor is installed on a moving pan-tilt unit in a closed loop with a recognition neural network. This neural network is trained to recognize objects observed by a DVS, while the pan-tilt unit is moved to emulate micro-saccades. We show that performing more saccades in different directions can result in having more information about the object, and therefore, more accurate object recognition is possible. However, in high-performance and low-latency platforms, performing additional saccades adds latency and power consumption. Here, we show that the number of saccades can be reduced while keeping the same recognition accuracy by performing intelligent saccadic movements, in a closed action-perception smart loop. We propose an algorithm for smart saccadic movement decisions that can reduce the number of necessary saccades to half, on average, for a predefined accuracy on the N-MNIST dataset. Additionally, we show that by replacing this control algorithm with an artificial neural network that learns to control the saccades, we can also reduce to half the average number of saccades needed for the N-MNIST recognition.
Publisher version (URL)https://doi.org/10.1109/TBCAS.2018.2834428
Appears in Collections:(IMSE-CNM) Artículos
Files in This Item:
File Description SizeFormat 
accesoRestringido.pdf15,38 kBAdobe PDFThumbnail
Show full item record
Review this work

Related articles:

WARNING: Items in Digital.CSIC are protected by copyright, with all rights reserved, unless otherwise indicated.