Smoothness and Adaptivity in Nonlinear Optimization for Machine Learning Applications by Li, Haochuan

“…Besides, existing theory cannot well explain why adaptive methods outperform gradient descent in certain machine learning tasks like training transformers. …”
Get full text

Mechanisms and methods of proving parentage in the light of scientific studies and legal legislation in Algeria by مسعودي هشام

“…The issue of descent is one of the important topics because it is related to society and precisely to the family. …”
Get full text

Bayesian optimization for computationally extensive probability distributions. by Ryo Tamura, Koji Hukushima

“…Even when the number of sampling points on the posterior distributions is fixed to be small, the Bayesian optimization provides a better maximizer of the posterior distributions in comparison to those by the random search method, the steepest descent method, or the Monte Carlo method. Furthermore, the Bayesian optimization improves the results efficiently by combining the steepest descent method and thus it is a powerful tool to search for a better maximizer of computationally extensive probability distributions.…”
Get full text

Low-Rank Matrix Completion via QR-Based Retraction on Manifolds by Ke Wang, Zhuo Chen, Shihui Ying, Xinjian Xu

“…We devise two fast algorithms based on steepest gradient descent and conjugate gradient descent, and demonstrate their superiority over the promising baseline with the ratio of at least <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mn>24</mn><mo>%</mo></mrow></semantics></math></inline-formula>.…”
Get full text

Hacia una contextualización de las migraciones de caboverdeanos en el Gran Buenos Aires a partir de sus diferencias generacionales by María Cecilia Martino

“…From the incorporation of Cape Verdean society language to institution in order to promote the inclusion of young people in a context of growing political mobilization of African descent groups in the country, it is analyzed how the generational dimension was expressed. …”
Get full text

An application of results by Hardy, Ramanujan and Karamata to Ackermannian functions by Andreas Weiermann

“…In this article we give a fine structure analysis of such a Ackermann type descent recursion in the case that the ordinals below ω ^ω are represented via a Hardy Ramanujan style coding. …”
Get full text

Covid-19, the Chinese diaspora, and the enduring legacy of racism in Peru by José Ragas, Patricia Palma

“…Chinese individuals were thus targeted during past public health crises in Peru, but during the current coronavirus pandemic racist notions painting people of Chinese descent as “agents of contagion” diminished significantly. …”
Get full text

Musings on Deep Learning: Properties of SGD by Zhang, Chiyuan, Liao, Qianli, Rakhlin, Alexander, Sridharan, Karthik, Miranda, Brando, Golowich, Noah, Poggio, Tomaso

“…[previously titled "Theory of Deep Learning III: Generalization Properties of SGD"] In Theory III we characterize with a mix of theory and experiments the generalization properties of Stochastic Gradient Descent in overparametrized deep convolutional networks. …”
Get full text

Development of learning algorithms for fully connect layers of convolutional neural network by Wang, Yiming

“…Thus, the algorithm has the potential of achieving a better performance in lesser epochs of training as compared with traditional Gradient Descent Method.…”
Get full text

Proximal mean-field for neural network quantization by Ajanthan, T, Dokania, P, Hartley, R, Torr, P

“…In this work, we cast NN quantization as a discrete labelling problem, and by examining relaxations, we design an efficient iterative optimization procedure that involves stochastic gradient descent followed by a projection. We prove that our simple projected gradient descent approach is, in fact, equivalent to a proximal version of the well-known mean-field method. …”

Partial linearization based optimization for multi-class SVM by Mohapatra, P, Dokania, P, Jawahar, C, Kumar, M

“…In particular, it allows us to combine several of their desirable qualities into one approach: (i) the use of an expectation oracle (which provides the marginals over each output class) in order to estimate an informative descent direction, similar to exponentiated gradient; (ii) analytical computation of the optimal step-size in the descent direction that guarantees an increase in the dual objective, similar to Frank-Wolfe; and (iii) a block coordinate formulation similar to the one proposed for Frank-Wolfe, which allows us to solve large-scale problems. …”

Learning models in quantum computation and quantum control by Maity, R

“…Second, we study the hardness of learning unitary operations in U(d) via gradient descent on the time parameters of an alternating operator sequence, and numerically find that, despite the nonconvexity of the loss landscape, gradient descent always converges to the target unitary when the sequence contains d² or more parameters. …”

Predicting noise-induced hearing loss (NIHL) in TNB workers using GDAM algorithm by Rehman Gillani, Syed Muhammad Zubair

“…The performance of the proposed method known as ‘Gradient Descent Method with Adaptive Momentum (GDAM)’ is compared with ‘Gradient Descent Method with Adaptive Gain (GDM-AG)’ (Nazri, 2007) and ‘Gradient Descent with Simple Momentum (GDM)’ by performing simulations on classification problems. …”
Get full text
Get full text
Get full text

Training Multilayer Neural Network Based on Optimal Control Theory for Limited Computational Resources by Ali Najem Alkawaz, Jeevan Kanesan, Anis Salwa Mohd Khairuddin, Irfan Anjum Badruddin, Sarfaraz Kamangar, Mohamed Hussien, Maughal Ahmed Ali Baig, N. Ameer Ahammad

“…Backpropagation (BP)-based gradient descent is the general approach to train a neural network with a multilayer perceptron. …”
Get full text

Islam, Memory, and Morality in Yemen by Daniel Martin Varisco

“…(p. 6) However, the idiom of descent has also been the defining feature of Yemen’s tribes, so the role of descent per se is less relevant as a distinguishing marker than how the sadah relate to other social categories. …”
Get full text

Sagittal plane knee kinematics can be measured during activities of daily living following total knee arthroplasty with two IMU. by Bradley M Cornish, Laura E Diamond, David John Saxby, David G Lloyd, Beichen Shi, Jenna Lyon, Kevin Abbruzzese, Price Gallie, Jayishni Maharaj

“…The r_IMU and m_IMU methods estimated sagittal plane knee angles with excellent correlation (>0.95) compared to OMC for walking, squatting, sit-to-stand, and stair-ascent, and very good correlation (>0.90) for stair descent. For squatting, sit-to-stand, and walking, the mean RMSD for r_IMU and m_IMU compared to OMC were <4 degrees, < 5 degrees, and <6 degrees, respectively but higher for stair ascent and descent (~12 degrees). …”
Get full text

Interdecadal Variations in Extreme High–Temperature Events over Southern China in the Early 2000s and the Influence of the Pacific Decadal Oscillation by Baoyan Zhu, Bo Sun, Hua Li, Huijun Wang

“…Numerical experiments demonstrate that a negative phase of PDO may induce a strengthened Walker circulation and anomalous atmospheric descent motion as well as water vapor divergence over Southern China.…”
Get full text

An efficient algorithm for data parallelism based on stochastic optimization by Khalid Abdulaziz Alnowibet, Imran Khan, Karam M. Sallam, Ali Wagdy Mohamed

“…A dynamic batch size stochastic gradient descent approach based on performance-aware technology is suggested to address the aforesaid difficulties (DBS-SGD). …”
Get full text

Regimes beyond the One-Drop Rule: New Models of Multiracial Identity by Sarah Iverson, Ann Morning, Aliya Saperstein, Janet Xu

“…These findings show that younger, first-generation multiracial Americans, especially those of partial Asian or Hispanic descent, have left hypo- and hyperdescent regimes behind—unlike other young people today whose mixed-race ancestry stems from further back in their family tree.…”
Get full text

Association between miRNA Target Sites and Incidence of Primary Osteoarthritis in Women from Volga-Ural Region of Russia: A Case-Control Study by Anton Tyurin, Daria Shapovalova, Halida Gantseva, Valentin Pavlov, Rita Khusainova

“…According to ethnic heterogeneity, associations between the T allele (rs1061237) with OA in women of Russian descent (OR = 1.77), the G allele (rs6854081) in women of Tatar descent (OR = 4.78), the C allele (rs229069) and the T allele (rs73611720) in women of mixed descent and other ethnic groups (OR = 2.25 and OR = 3.02, respectively) were identified. …”
Get full text