About cookies on this site Our websites require some cookies to function properly (required). In addition, other cookies may be used with your consent to analyze site usage, improve the user experience and for advertising. For more information, please review your options. By visiting our website, you agree to our processing of information as described in IBM’sprivacy statement. To provide a smooth navigation, your cookie preferences will be shared across the IBM web domains listed here.
Publication
IEEE T-ED
Paper
ReSta: Recovery of Accuracy During Training of Deep Learning Models in a 14-nm Technology-Based ReRAM Array
Abstract
In this article, we propose an electrical bias technique to recover the accuracy of a degraded HfOx-based resistive random access memory (ReRAM) array in deep neural network (DNN) training. We simulate degradation through the application of ~104 pulses having high pulse amplitude, resulting in a fatigued ReRAM array that fails to converge during training. We propose a novel technique, recovery stabilization (ReSta), which can recover the array accuracy up to the level it was before the fatigue was introduced. After using the proposed controlled recovery technique, we obtain an accuracy of 98% on the reduced Modified National Institute of Standard and Technology (MNIST) classification task, approaching a floating point baseline. This work demonstrates a viable pathway to recover the performance of the fatigued ReRAM crossbar arrays in in-memory DNN training.