Abstract—There have been several researches of applying Deep Belief Networks (DBNs) to predict time series data. Most of these works pointed out that DBNs can bring out better prediction accuracy than traditional Artificial Neural Networks. However, one of the main shortcomings of using DBNs in time series prediction concerns with the proper selection of their parameters. In this paper, we investigate the use of Harmony Search algorithm for determining the parameters of DBN in forecasting time series. Experimental results on several synthetic and real world time series datasets revealed that the DBN with parameters selected by Harmony Search performs better than the DBN with parameters selected by Particle Swarm Optimization (PSO) or random method in most of the tested datasets.
Index Terms—Deep belief network, parameters, time series prediction, harmony search.
D. N. Luu was with the Faculty of Computer Science and Engineering, Ho Chi Minh City University of Technology, Vietnam (e-mail: luudnbktp@ gmail.com).
N. N. Phien is with Center for Applied Information Technology and Faculty of Information Technology, Ton Duc Thang University, Ho Chi Minh City, Vietnam (e-mail: email@example.com).
D. T. Anh is with the Faculty of Computer Science and Engineering, Ho Chi Minh City University of Technology, Vietnam (e-mail: firstname.lastname@example.org).
Cite: Do Ngoc Luu, Nguyen Ngoc Phien, and Duong Tuan Anh, "Tuning Parameters in Deep Belief Networks for Time Series Prediction through Harmony Search," International Journal of Machine Learning and Computing vol. 11, no. 4, pp. 274-280, 2021.Copyright © 2021 by the authors. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).