Shift-and-Safe: Addressing permanent faults in aggressively undervolted CNN accelerators

Toca-Díaz, Yamilka (Universidad de Zaragoza) ; Gran Tejero, Rubén (Universidad de Zaragoza) ; Valero, Alejandro (Universidad de Zaragoza)

Resumen: Underscaling the supply voltage () to ultra-low levels below the safe-operation threshold voltage () holds promise for substantial power savings in digital CMOS circuits. However, these benefits come with pronounced challenges due to the heightened risk of bitcell permanent faults stemming from process variations in current technology node sizes. This work delves into the repercussions of such faults on the accuracy of a 16-bit fixed-point Convolutional Neural Network (CNN) inference accelerator powering on-chip activation memories at ultra-low voltages. Through an in-depth examination of fault patterns, memory usage, and statistical analysis of activation values, this paper introduces Shift-and-Safe: two novel and cost-effective microarchitectural techniques exploiting the presence of outlier activation values and the underutilization of activation memories. Particularly, activation outliers enable a shift-based data representation that reduces the impact of faults on the activation values, whereas the memory underutilization is exploited to maintain a safe replica of affected activations in idle memory regions. Remarkably, these mechanisms do not add any burden to the programmer and are independent of application characteristics, rendering them easily deployable across real-world CNN accelerators. Experimental results show that Shift-and-Safe maintains the CNN accuracy even in the presence of almost a quarter of the total activations with faults. In addition, average energy savings are by 5% and 11% compared to the state-of-the-art approach and a conventional accelerator supplied at , respectively.

Idioma: Inglés

DOI: 10.1016/j.sysarc.2024.103292

Año: 2024

Publicado en: Journal of Systems Architecture 157 (2024), 103292 [10 pp.]
ISSN: 1383-7621

Factor impacto JCR: 4.1 (2024)

Categ. JCR: COMPUTER SCIENCE, SOFTWARE ENGINEERING rank: 23 / 128 = 0.18 (2024) - Q1 - T1
Categ. JCR: COMPUTER SCIENCE, HARDWARE & ARCHITECTURE rank: 13 / 60 = 0.217 (2024) - Q1 - T1

Factor impacto SCIMAGO: 1.22 - Software (Q1) - Hardware and Architecture (Q1)

Financiación: info:eu-repo/grantAgreement/ES/DGA/T58-23R
Financiación: info:eu-repo/grantAgreement/ES/MICINN/PID2022-136454NB-C22

Tipo y forma: Article (Published version)

Área (Departamento): Área Arquit.Tecnología Comput. (Dpto. Informát.Ingenie.Sistms.)