Why random reshuffling beats stochastic gradient descent by Gürbüzbalaban, M., Ozdaglar, A., Parrilo, P. A

“…Though RR has been numerically observed to outperform its with-replacement counterpart stochastic gradient descent (SGD), characterization of its convergence rate has been a long standing open question. …”
Get full text

Beyond convexity—Contraction and global convergence of gradient descent by Wensing, Patrick M, Slotine, Jean-Jacques

“…It demonstrates that in the case of a timeinvariant objective, most elementary results on gradient descent based on convexity can be replaced by much more general results based on contraction. …”
Get full text

On the convergence of the coordinate descent method for convex differentiable minimization

Get full text

Terrain relative localization for lunar entry, descent, and landing by Hale, Matthew J., S.M. Massachusetts Institute of Technology

Get full text

Tree block coordinate descent for map in graphical models by Sontag, David Alexander, Jaakkola, Tommi S.

Get full text
Get full text

Top of descent analysis for air traffic in Singapore airspace by Tan, Benjamin Zhi Yong

“…In this report, the main objective was to understand the Top of Descent (TOD) profiles airlines conduct on the approach to Singapore Changi International Airport (ICAO: WSSS). …”
Get full text

Multi-task gradient descent for multi-task learning by Bai, Lu, Ong, Yew-Soon, He, Tiantian, Gupta, Abhishek

“…Different from previous approaches, in this paper, we propose a novel Multi-task Gradient Descent (MGD) framework, which improves the generalization performance of multiple tasks through knowledge transfer. …”
Get full text

A machine learning approach for the prediction of top of descent by Tan, Benjamin Zhi Yong, Alam, Sameer, Ma, Chunyao

Subjects: Get full text

Descent methods and torsion on Jacobians of higher genus curves by Nicholls, C

“…</p> <p>Finally, we extend Schaefer’s algorithm for computing the Selmer group of a Jacobian to carry out a (4, 4)-descent on Jacobians of curves that admit a (4, 4)-isogeny.…”

Generalization bounds for label noise stochastic gradient descent by Huh, JE, Rebeschini, P

“…We develop generalization error bounds for stochastic gradient descent (SGD) with label noise in nonconvex settings under uniform dissipativity and smoothness conditions. …”

Enlargement of the processus vaginalis during testicular descent in rats. by Ramasamy, M, Di Pilla, N, Yap, T, Hrabovszky, Z, Farmer, P, Hutson, J

“…The role of the processus vaginalis (PV) during inguinoscrotal testicular descent remains controversial. Some authors propose passive dragging of the PV by the migrating testis, while others suggest active elongation. …”

Decentralised learning with distributed gradient descent and random features by Richards, D, Rebeschini, P, Rosasco, L

“…We investigate the generalisation performance of Distributed Gradient Descent with implicit regularisation and random features in the homogenous setting where a network of agents are given data sampled independently from the same unknown distribution. …”

Multileave gradient descent for fast online learning to rank by Whiteson, S, Schuth, A, Oosterhuis, H, de Rijke, M

“…The <em>dueling bandit gradient descent</em> (DBGD) algorithm has been shown to effectively learn combinations of these features solely from user interactions. …”

Visually guided step descent in children with Williams syndrome. by Cowie, D, Braddick, O, Atkinson, J

A second derivative SQP method with imposed descent by Gould, N, Robinson, D

“…Additionally, an explicit descent constraint is imposed on certain QP subproblems, which "guides" the iterates through areas in which nonconvexity is a concern. …”

Homomorphically encrypted gradient descent algorithms for quadratic programming by Bertolace, A, Gatsis, K, Margellos, K

“…In this paper, we evaluate the different fully homomorphic encryption schemes, propose an implementation, and numerically analyze the applicability of gradient descent algorithms to solve quadratic programming in a homomorphic encryption setup. …”

Solving Diophantine problems on curves via descent on the jacobian by Flynn, E

“…We suggest that the following plan will provide a powerful tool for trying to find the set of Q-rational points C(Q) on a curve C of genus&gt;1: (1) Attempt to find J(Q)/2J(Q) via descent on J, the Jacobian of C. (2) Deduce generators for J(Q) via an explicit theory of heights. (3). …”

Implicit regularization in matrix sensing via mirror descent by Wu, F, Rebeschini, P

“…We study discrete-time mirror descent applied to the unregularized empirical risk in matrix sensing. …”

Generalization bounds for label noise stochastic gradient descent by Huh, JE, Rebeschini, P

“…We develop generalization error bounds for stochastic gradient descent (SGD) with label noise in non-convex settings under uniform dissipativity and smoothness conditions. …”

Convergence of the Steepest Descent Method for Minimizing Convex Functions by Abu Hassan, Malik, Monsi, Mansor, Leong, Wah June

“…Kiwiel and Murty (1996) discuss the convergence properties of a class of steepest descent algorithm for minimizing a continuously differentiable quasiconvex function f on mo. …”
Get full text