Skip to main content
Video s3
    Details
    Presenter(s)
    Corey Lammie Headshot
    Display Name
    Corey Lammie
    Affiliation
    Affiliation
    James Cook University
    Country
    Country
    Switzerland
    Author(s)
    Display Name
    Corey Lammie
    Affiliation
    Affiliation
    James Cook University
    Display Name
    Jason Eshraghian
    Affiliation
    Affiliation
    University of Michigan
    Display Name
    Chenqi Li
    Affiliation
    Affiliation
    University of Toronto
    Affiliation
    Affiliation
    York University
    Display Name
    Roman Genov
    Affiliation
    Affiliation
    University of Toronto
    Display Name
    Wei D. Lu
    Affiliation
    Affiliation
    University of Michigan, Ann Arbor
    Affiliation
    Affiliation
    James Cook University
    Abstract

    The impact of device and circuit-level effects in mixed-signal RRAM accelerators typically manifest as performance degradation of DL algorithms, but the degree of impact varies based on algorithmic features. These include network architecture, capacity, weight distribution, and the type of inter-layer connections. Techniques are continuously emerging to efficiently train sparse neural networks, which may have activation sparsity, quantization, and memristive noise. In this paper, we present a generalized Design Space Exploration (DSE) methodology to quantify the benefits and limitations of dense and sparse mapping schemes for a variety of network architectures. While sparsity of connectivity promotes less power consumption and is often optimized for extracting localized features, its performance on tiled RRAM arrays may be more susceptible to noise due to under-parameterization, when compared to dense mapping schemes. Moreover, we present a case study quantifying and formalizing the trade-offs of typical non-idealities introduced into 1T1R tiled memristive architectures and the size of modular crossbar tiles using the CIFAR-10 dataset.

    Slides
    • Design Space Exploration of Dense and Sparse Mapping Schemes for RRAM Architectures (application/pdf)