Calibrating Process Variation at System Level with In-Situ Low-Precision Transfer Learning for Analog Neural Network Processors
| Title | Calibrating Process Variation at System Level with In-Situ Low-Precision Transfer Learning for Analog Neural Network Processors |
| Publication Type | Conference Paper |
| Year of Publication | 2018 |
| Authors | Jia, Kaige, Liu, Zheyu, Wei, Qi, Qiao, Fei, Liu, Xinjun, Yang, Yi, Fan, Hua, Yang, Huazhong |
| Conference Name | Proceedings of the 55th Annual Design Automation Conference |
| Publisher | ACM |
| Conference Location | New York, NY, USA |
| ISBN Number | 978-1-4503-5700-5 |
| Keywords | analog neural network, analogical transfer, Analogies and Transference, Human Behavior, human factors, in-situ transfer learning, low-precision, process variation, pubcrawl |
| Abstract | Process Variation (PV) may cause accuracy loss of the analog neural network (ANN) processors, and make it hard to be scaled down, as well as feasibility degrading. This paper first analyses the impact of PV on the performance of ANN chips. Then proposes an in-situ transfer learning method at system level to reduce PV's influence with low-precision back-propagation. Simulation results show the proposed method could increase 50% tolerance of operating point drift and 70% $\sim$ 100% tolerance of mismatch with less than 1% accuracy loss of benchmarks. It also reduces 66.7% memories and has about 50x energy-efficiency improvement of multiplication in the learning stage, compared with the conventional full-precision (32bit float) training system. |
| URL | https://dl.acm.org/citation.cfm?doid=3195970.3196004 |
| DOI | 10.1145/3195970.3196004 |
| Citation Key | jiaCalibratingProcessVariation2018 |