Smooth Twin Parametric Insensitive Support Vector Regression

NAVIGATE

Table of Contents

STATISTICS

Viewed1904

Downloads680

Smooth Twin Parametric Insensitive Support Vector Regression

[HTML] PDF下载 (680)

[1]HUANG Huajuan,WEI Xiuxi,ZHOU Yongquan.Smooth Twin Parametric Insensitive Support Vector Regression[J].Journal of Zhengzhou University (Engineering Science),2022,43(02):28-34.[doi:10.13705/j.issn.1671-6833.2022.02.005]

Copy

Journal of Zhengzhou University (Engineering Science)[ISSN 1671-6833/CN 41-1339/T] Volume: 43卷 Number of periods: 2022 02 Page number: 28-34 Column: Public date: 2022-02-27

Title:: Smooth Twin Parametric Insensitive Support Vector Regression

Author(s):: HUANG Huajuan¹; WEI Xiuxi¹; ZHOU Yongquan¹; 2; 1.College of Artificial Intelligence, Guangxi University for Nationalities, Nanning 530006, China; \
2.Guangxi Key Laboratory of Hybrid Computation and IC Design Analysis, Guangxi University for Nationalities, Nanning 530006, China

Keywords:: twin parametric insensitive support vector regression; smooth technology; heteroscedastic noise; Newton method; training efficiency

CLC:: TP18

DOI:: 10.13705/j.issn.1671-6833.2022.02.005

Abstract:: As one of the machine learning methods, twin parametric insensitive support vector regression (TPISVR) had a simple mathematical model and good learning performance. It was especially suitable for solving data regression problems with structural heteroscedasticity noise. However, the training speed of TPISVR was low, and the training efficiency needs to be improved. The traditional algorithm of TPISVR could be reduced to solve two quadratic programming problems with inequality constraints by transforming dual problems. However, this method of solving quadratic programming problems with large number of samples would be restricted by time and memory, which was the key to the low training efficiency of TPISVR. In this study, the positive sign function was introduced to transform the two quadratic programming problems of TPISVR into two non-differentiable unconstrained optimization problems. Secondly, CHKS smooth function and regular term were introduced to regularize TPISVR model, and smooth approximation was made to the non-differentiable unconstrained optimization problem, so as to transform the non-differentiable model into a differentiable unconstrained optimization problem. The new model was solved by Newton Armijo method with fast convergence speed, and a smooth twin parameterized insensitive support vector regression machine (STPISVR) was proposed. Finally, it was proved theoretically that STPISVR model was convergent and had arbitrary order smoothness; In order to verify the effectiveness and feasibility of the algorithm, simulation experiments were carried out on the artificial data set and UCI data set commonly used in machine learning. The experimental results showed that compared with other machine learning methods, STPISVR achieved higher training efficiency without reducing the accuracy.

References:: ［1］ COＲTES C，VAPNIK V． Support-vector networks［J］． Machine learning，1995，20( 3) : 273－297．
［2］ MELLO A Ｒ，STEMMEＲ M Ｒ，KOEＲICH A L．Incremental and decremental fuzzy bounded twin support vector machine［J］．Information sciences，2020，526: 20 －38．
［3］孙国栋，江亚杰，徐亮，等．BP 网络预测阈值的仪表重影字符识别方法研究［J］．郑州大学学报( 工学版) ，2020，41( 4) : 28－33．
［4］ FUNG G，MANGASAＲIAN O L． Proximal support vector machine classifiers［C］/ /Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining-KDD’ 01． New York: ACM，2001: 77－86．
［5］ MANGASAＲIAN O L，WILD E W． Multisurface proximal support vector machine classification via generalized eigenvalues［J］．IEEE transactions on pattern analysis and machine intelligence，2006，28 ( 1) : 69 －74．
［6］ JAYADEVA，KHEMCHANDANI Ｒ，CHANDＲA S． Twin support vector machines for pattern classification ［J］．IEEE transactions on pattern analysis and machine intelligence，2007，29( 5) : 905－910．
［7］ CHEN W J，SHAO Y H，LI C N，et al． Ν-projection twin support vector machine for pattern classification ［J］．Neurocomputing，2020，376: 10－24．
［8］ ZHANG X S，GAO X B，WANG Y．Twin support tensor machines for MCs detection［J］．Journal of electronics ( China) ，2009，26( 3) : 318－325．

［9］ PENG X J．TSVＲ: an efficient Twin Support Vector Machine for regression［J］． Neural networks，2010，23 ( 3) : 365－372．

［10］ LI Y M，SUN H J，YAN W Z，et al．Multi-output parameter-insensitive kernel twin SVＲ model［J］．Neural networks，2020，121: 276－293．

［11］黄文锋，徐珊珊，孙燚，等．基于多分辨率卷积神经网络的火焰检测［J］．郑州大学学报 ( 工学版) ， 2019，40( 5) : 79－83．

［12］ LPEZ J，MALDONADO S．Ｒobust twin support vector regression via second-order cone programming［J］． Knowledge-based systems，2018，152: 83－93．

［13］ HAO P Y． New support vector algorithms with parametric insensitive /margin model［J］． Neural networks，2010，23( 1) : 60－73．

［14］ PENG X J．Efficient twin parametric insensitive support vector regression model［J］．Neurocomputing，2012，79: 26－38．

［15］丁世飞，黄华娟．最小二乘孪生参数化不敏感支持向量回归机［J］．软件学报，2017，28 ( 12) : 3146 －3155．

［16］丁世飞，黄华娟，史忠植．加权光滑 CHKS 孪生支持向量机［J］．软件学报，2013，24( 11) : 2548－2557．

［17］黄华娟，丁世飞，史忠植．光滑 CHKS 孪生支持向量回归机［J］．计算机研究与发展，2015，52 ( 3) : 561 －568．

［18］王震．基于非平行超平面支持向量机的分类问题研究［D］．长春: 吉林大学，2014．

［19］黄华娟．孪生支持向量机关键问题的研究［D］．徐州: 中国矿业大学，2014．

Similar References:

Memo

Last Update: 2022-02-25