SHI Lei, LI Tian, GAO Yufei, WEI Lin, LI Cuixia, TAO Yongcai
Abstract:
Knobs tuning is a key technology that affects the performance and adaptability of databases. However, traditional tuning methods have difficulty in finding the optimal configuration in high-dimensional continuous parameter spaces. The development of machine learning could bring new opportunities to solve this problem. By summarizing and analyzing relevant work, existing work was classified according to development time and characteristics, including expert decision-making, static rules, heuristic algorithms, traditional machine learning methods, and deep reinforcement learning methods. The database tuning problem was defined, and the limitations of heuristic algorithms in tuning problems were discussed. Traditional machine learning-based tuning methods were introduced, including random forest, support vector machine, decision tree, etc. The general process of using machine learning methods to solve tuning problems was described, and specific implementations were provided. The shortcomings of traditional machine learning models in adaptability and tuning capabilities were also discussed. The principles of deep reinforcement learning models were emphasized, and the mapping relationship between tuning problems and deep reinforcement learning models was defined. Recent relevant work on improving database performance, time consumption and model characteristics was introduced, and the process of building and training agents based on deep neural networks was described. Finally, the characteristics of existing work were summarized, and the research hotspots and development directions of machine learning in database tuning were outlined. Distributed scenarios, multi-granularity tuning, adaptive algorithms and self-maintenance capabilities were identified as future research trends