Source-linked AI summary

ReckOn: A 28nm Sub-mm2 Task-Agnostic Spiking Recurrent Neural Network Processor Enabling On-Chip Learning over Second-Long Timescales

Charlotte Frenkel, Giacomo Indiveri

arXiv:2208.09759v1cs.NEcs.ARcs.ET

TL;DR

Autonomous edge devices need on-chip adaptation to changing users, environments, and tasks, but prior memory-constrained learning devices handled mainly static or instantaneous data. ReckOn uses a spiking RNN with eligibility-propagation-based online learning, sparsity, and address-event processing to train over seconds across navigation, gesture recognition, and keyword spotting. It achieves task-agnostic end-to-end learning with sub-150µW training power and sub-mm² area, including 0.45mm² core area and 138kB SRAM.

  • Problem

    Changing users, environments, and tasks limit inference-only edge-device robustness, while prior end-to-end on-chip learning was restricted mainly to static data or instantaneous decisions without temporal memory.

  • Method

    ReckOn is a spiking RNN processor using local eligibility traces, sparse processing, and address-event representations for online learning over seconds with millisecond temporal resolution.

  • Results

    ReckOn demonstrates end-to-end on-chip learning on gesture recognition, keyword spotting, and navigation, achieving 87.3%-, 90.7%-, and 96.4%-accuracy respectively, with a 0.45mm² core and 138kB SRAM.

  • Takeaways & Limitations

    ReckOn supports task-agnostic learning over thousands of timesteps within constrained edge-device power and area budgets, enabling chip repurposing and sensor fusion.

Abstract

from arXiv · show

A robust real-world deployment of autonomous edge devices requires on-chip adaptation to user-, environment- and task-induced variability. Due to on-chip memory constraints, prior learning devices were limited to static stimuli with no temporal contents. We propose a 0.45-mm$^2$ spiking RNN processor enabling task-agnostic online learning over seconds, which we demonstrate for navigation, gesture recognition, and keyword spotting within a 0.8-% memory overhead and a <150-$μ$W training power budget.

Loading 2208.09759v1…