A fast and simple algorithm for training neural probabilistic language models

A fast and simple algorithm for training neural probabilistic language models

In spite of their superior performance, neural probabilistic language models (NPLMs) remain far less widely used than n-gram models due to their notoriously long training times, which are measured in weeks even for moderately-sized datasets. Training NPLMs is computationally expensive because they a...

Fuld beskrivelse

Bibliografiske detaljer
Main Authors:	Mnih, A, Teh, Y
Format:	Journal article
Sprog:	English
Udgivet:	2012

Lignende værker

Language acquisition and probabilistic models: Keeping it simple
af: Villavicencio, Aline, et al.
Udgivet: (2022)

Language acquisition and probabilistic models: Keeping it simple
Udgivet: (2021)

Effects of Fast Simple Numerical Calculation Training on Neural Systems
af: Hikaru Takeuchi, et al.
Udgivet: (2016-01-01)

The concrete distribution: A continuous relaxation of discrete random variables
af: Maddison, C, et al.
Udgivet: (2017)

Fast Training Algorithms for Feed Forward Neural Networks
af: Luma N. M. Tawfiq, et al.
Udgivet: (2017-04-01)

African buffalo algorithm: Training the probabilistic neural network to solve classification problems
af: Mohammed Alweshah, et al.
Udgivet: (2022-05-01)

Probabilistic symmetries and invariant neural networks
af: Bloem-Reddy, B, et al.
Udgivet: (2020)

Fast Training Set Size Reduction Using Simple Space Partitioning Algorithms
af: Stefanos Ougiaroglou, et al.
Udgivet: (2022-12-01)

Efficient probabilistic inference in generic neural networks trained with non-probabilistic feedback
af: A. Emin Orhan, et al.
Udgivet: (2017-07-01)

Fast-M Adversarial Training Algorithm for Deep Neural Networks
af: Yu Ma, et al.
Udgivet: (2024-05-01)

Neural probabilistic motor primitives for humanoid control
af: Merel, J, et al.
Udgivet: (2019)

Enhanced Probabilistic Inference Algorithm Using Probabilistic Neural Networks for Learning Control
af: Yang Li, et al.
Udgivet: (2019-01-01)

Simple, Fast, Scalable, and Reliable Multiprocessor Algorithms
af: Jayanti, Siddhartha Visveswara
Udgivet: (2023)

Probabilistic neural network multi-model Kalman filter navigation algorithm
af: Liang Longkai, et al.
Udgivet: (2018-06-01)

A fast and simple algorithm for the maximum flow problem
af: Ahuja, Ravindra K., et al.
Udgivet: (2009)

A fast and simple algorithm for the maximum flow problem
af: Ahuja, Ravindra K., et al.
Udgivet: (2009)

A fast and simple algorithm for the maximum flow problem
Udgivet: (2004)

Evidence Networks: simple losses for fast, amortized, neural Bayesian model comparison
af: Niall Jeffrey, et al.
Udgivet: (2024-01-01)

Probabilistic coherence, logical consistency, and Bayesian learning: Neural language models as epistemic agents
af: Gregor Betz, et al.
Udgivet: (2023-01-01)

Probabilistic coherence, logical consistency, and Bayesian learning: Neural language models as epistemic agents.
af: Gregor Betz, et al.
Udgivet: (2023-01-01)

A fast learning algorithm for deep belief nets.
af: Hinton, G, et al.
Udgivet: (2006)

Probabilistic Algorithmic Knowledge
af: Joseph Y. Halpern, et al.
Udgivet: (2005-12-01)

A simple and fast label correcting algorithm for shortest paths
Udgivet: (2003)

Probabilistic modelling of morphologically rich languages
af: Botha, J
Udgivet: (2014)

A Brand-New Simple, Fast, and Effective Residual-Based Method for Radial Basis Function Neural Networks Training
af: Lifei Sun, et al.
Udgivet: (2023-01-01)

Computational power of probabilistic simple one-sided sticker languages / Mathuri Selvarajoo ...[et al.]
af: Selvarajoo, Mathuri, et al.
Udgivet: (2016)

Probabilistic Models with Deep Neural Networks
af: Andrés R. Masegosa, et al.
Udgivet: (2021-01-01)

Modeling Uncertainties in EEG Microstates: Analysis of Real and Imagined Motor Movements Using Probabilistic Clustering-Driven Training of Probabilistic Neural Networks
af: Martin Dinov, et al.
Udgivet: (2017-11-01)

Probabilistic Composition for Fast Group Decisions
af: Annibal Parracho Sant'Anna, et al.
Udgivet: (2011-12-01)

Probabilistic Encoding Models for Multivariate Neural Data
af: Marcus A. Triplett, et al.
Udgivet: (2019-01-01)

Chance-Constrained Probabilistic Simple Temporal Problems
af: Fang, Cheng, et al.
Udgivet: (2015)

Fast and simple model for atmospheric radiative transfer
af: F. C. Seidel, et al.
Udgivet: (2010-08-01)

Probabilistic medical predictions of large language models
af: Bowen Gu, et al.
Udgivet: (2024-12-01)

Probabilistic Top-Down Parsing and Language Modeling
af: Brian Roark
Udgivet: (2021-03-01)

Simple, efficient, and neural algorithms for sparse coding
af: Arora, Sanjeev, et al.
Udgivet: (2018)

Training nuclei detection algorithms with simple annotations
af: Henning Kost, et al.
Udgivet: (2017-01-01)

Language equivalence for probabilistic automata
af: Kiefer, S, et al.
Udgivet: (2011)

Application of the probabilistic collocation method for an uncertainty analysis of a simple ocean model
Udgivet: (2003)

Integration of Neural Embeddings and Probabilistic Models in Topic Modeling
af: Pantea Koochemeshkian, et al.
Udgivet: (2024-12-01)

Fast, Simple, and Accurate Time Series Analysis with Large Language Models: An Example of Mean-motion Resonances Identification
af: Evgeny A. Smirnov
Udgivet: (2024-01-01)