https://www.mdu.se/

mdu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Exploration of Activation Fault Reliability in Quantized Systolic Array-Based DNN Accelerators
Tallinn Univ Technol, Tallinn, Estonia..
Tallinn Univ Technol, Tallinn, Estonia..
Univ Alberta, Edmonton, AB, Canada..
Tallinn Univ Technol, Tallinn, Estonia..
Show others and affiliations
2024 (English)In: 2024 25TH INTERNATIONAL SYMPOSIUM ON QUALITY ELECTRONIC DESIGN, ISQED 2024, IEEE, 2024Conference paper, Published paper (Refereed)
Abstract [en]

The stringent requirements for the Deep Neural Networks (DNNs) accelerator's reliability stand along with the need for reducing the computational burden on the hardware platforms, i.e. reducing the energy consumption and execution time as well as increasing the efficiency of DNN accelerators. Moreover, the growing demand for specialized DNN accelerators with tailored requirements, particularly for safety-critical applications, necessitates a comprehensive design space exploration to enable the development of efficient and robust accelerators that meet those requirements. Therefore, the trade-off between hardware performance, i.e. area and delay, and the reliability of the DNN accelerator implementation becomes critical and requires tools for analysis. This paper presents a comprehensive methodology for exploring and enabling a holistic assessment of the trilateral impact of quantization on model accuracy, activation fault reliability, and hardware efficiency. A fully automated framework is introduced that is capable of applying various quantization-aware techniques, fault injection, and hardware implementation, thus enabling the measurement of hardware parameters. Moreover, this paper proposes a novel lightweight protection technique integrated within the framework to ensure the dependable deployment of the final systolic-array-based FPGA implementation. The experiments on established benchmarks demonstrate the analysis flow and the profound implications of quantization on reliability, hardware performance, and network accuracy, particularly concerning the transient faults in the network's activations.

Place, publisher, year, edition, pages
IEEE, 2024.
Series
International Symposium on Quality Electronic Design, ISSN 1948-3287
Keywords [en]
deep neural networks, design space exploration, quantization, fault simulation, reliability assessment
National Category
Computer Systems
Identifiers
URN: urn:nbn:se:mdh:diva-68065DOI: 10.1109/ISQED60706.2024.10528372ISI: 001229692400008Scopus ID: 2-s2.0-85192830380ISBN: 9798350309270 (print)ISBN: 9798350309287 (print)OAI: oai:DiVA.org:mdh-68065DiVA, id: diva2:1884523
Conference
25th International Symposium on Quality Electronic Design (ISQED), San Francisco, USA, APR 03-05, 2024
Available from: 2024-07-17 Created: 2024-07-17 Last updated: 2024-07-17Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Daneshtalab, Masoud

Search in DiVA

By author/editor
Daneshtalab, Masoud
By organisation
Embedded Systems
Computer Systems

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 35 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf