doi: 10.18178/ijml.2024.14.3.1164
Optimizing Neural Network Compilation via Adaptive Workflow with AutoTVM
,
Tay-Jyi Lin2,3
,
Juin-Ming Lu3 ,
Tien-Fu Chen1,3,*
- 1Department of Computer Science, National Yang-Ming Chiao-Tung University, Hsinchu, Taiwan
- 2Department of Computer Science and Information Engineering, National Chung Cheng University, Chia-Yi, Taiwan
- 3Electronic and Optoelectronic System Research Laboratories, Industrial Technology Research Institute, Hsinchu, Taiwan
- Manuscript receivedJanuary 4, 2024
- revisedJanuary 20, 2024
- acceptedFebruary 13, 2024
- publishedSeptember 20, 2024
Abstract
With the development of deep neural networks, network compilation plays as an important role for achieving faster execution time. Black-box optimization aims to find an optimal solution by searching the design space. However, it suffers from countless costly hardware measurements, which greatly increase the compilation time. This paper aims to reduce the compilation time by reducing hardware measurements. Our solution includes adaptive early-stop, a self-tuning module that controls tuning workflow according to real-time measurements, a K-means cluster sampling module, a history database that records and organizes measurement results for later usages, a decoupled online tuning service. We extend the work leveraging multiple users of online services, including shared history data and module hyperparameter suggestions. Experiments show our proposed approach achieves 52.39% reduction in hardware measurements for auto-tuning with AutoTVM.
Keywords
- TVM
- neural network compilation
- auto-tuning
- auto-optimization
How to Cite
Yu-Hsiang Chen, Tay-Jyi Lin, Juin-Ming Lu, and Tien-Fu Chen, "Optimizing Neural Network Compilation via Adaptive Workflow with AutoTVM," International Journal of Machine Learning, vol. 14, no. 3, pp. 92-96, 2024. https://doi.org/10.18178/ijml.2024.14.3.1164
Copyright & License
Copyright © 2024 by the authors. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).