← Search

Data · dataset · 2025

Energy-Efficient Visual Search by Eye Movements with a Low-Latency Spiking Neural Agent

Listed in ScienceDB

Human vision incorporates a non-uniform resolution retina, efficient eye movement strategies, and spiking neural networks (SNNs) to balance requirements in visual field size, visual resolution, energy cost, and inference latency.

Description

However, whether these features can synergize to produce more energy-efficient computer vision algorithms with human-like eye movements remains underexplored. Here, we record human visual search data and establish an bio-inspired visual search model (BVSM).

To our knowledge, BVSM is a rare SNN-based active visual search agent: it unifies non-uniform retinal sampling, event-driven spiking feature processing and memory, and a learned eye-movement policy within a single closed-loop framework, enabling low-latency saccade decisions in continuous space. The model combines a non-uniform resolution retina with spiking feature extraction, memory, and saccade decision modules, and employs population coding for fast saccade decisions.

Read the rest (1 more)

It can learn either a human-like or near-optimal fixation strategy by reinforcement learning, outperform human search performance, and achieve high energy efficiency through low saccade decision latency and sparse activation. Our findings suggest that SNNs with non-uniform resolution retina and efficient eye-movement strategies can facilitate more energy-efficient computer vision algorithms, especially when a large visual field, high visual resolution, and low energy cost are simultaneously required.

Links

Where it is published

Catalogue records · 1

Topics

Provenance · 1 source records, 11 field assertions
SourceKeyLast seenRaw
ScienceDB10.57760/sciencedb.3453212 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:earth-environmentalmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:energymapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:engineeringmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:humanitiesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:life-sciencesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:social-sciencemapping · scidb cnconnector:scidb_cn@1.0.0
descriptionsource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/description
licensesource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/rights
publication_datesource · scidb cnconnector:scidb_cn@1.0.0
titlesource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/title