首页|Investigators from Guangxi University Target Machine Learning (Stochastic Three- term Conjugate Gradient Method With Variance Technique for Non-convex Learning)
Investigators from Guangxi University Target Machine Learning (Stochastic Three- term Conjugate Gradient Method With Variance Technique for Non-convex Learning)
扫码查看
点击上方二维码区域，可以放大扫码查看
原文链接
NETL
NSTL
By a News Reporter-Staff News Editor at Robotics & Machine Learning Daily News Daily News – Researchers detail new data in Machine Learning. According to news reporting out of Guangxi, People’s Republic of Chin a, by NewsRx editors, research stated, “In the training process of machine learn ing, the minimization of the empirical risk loss function is often used to measu re the difference between the model’s predicted value and the real value. Stocha stic gradient descent is very popular for this type of optimization problem, but converges slowly in theoretical analysis.” Financial support for this research came from Guangxi Science and Technology Bas e and Talent Project. Our news journalists obtained a quote from the research from Guangxi University, “To solve this problem, there are already many algorithms with variance reducti on techniques, such as SVRG, SAG, SAGA, etc. Some scholars apply the conjugate g radient method in traditional optimization to these algorithms, such as CGVR, SC GA, SCGN, etc., which can basically achieve linear convergence speed, but these conclusions often need to be established under some relatively strong assumption s. In traditional optimization, the conjugate gradient method often requires the use of line search techniques to achieve good experimental results. In a sense, line search embodies some properties of the conjugate methods. Taking inspirati on from this, we apply the modified three-term conjugate gradient method and lin e search technique to machine learning. In our theoretical analysis, we obtain t he same convergence rate as SCGA under weaker conditional assumptions.”
GuangxiPeople’s Republic of ChinaAsi aCyborgsEmerging TechnologiesMachine LearningGuangxi University
NETL
NSTL
