A fast and simple algorithm for training neural probabilistic language models

A fast and simple algorithm for training neural probabilistic language models

In spite of their superior performance, neural probabilistic language models (NPLMs) remain far less widely used than n-gram models due to their notoriously long training times, which are measured in weeks even for moderately-sized datasets. Training NPLMs is computationally expensive because they a...

Descripció completa

Dades bibliogràfiques
Autors principals:	Mnih, A, Teh, Y
Format:	Journal article
Idioma:	English
Publicat:	2012

Ítems similars

Language acquisition and probabilistic models: Keeping it simple
per: Villavicencio, Aline, et al.
Publicat: (2022)

Language acquisition and probabilistic models: Keeping it simple
Publicat: (2021)

Effects of Fast Simple Numerical Calculation Training on Neural Systems
per: Hikaru Takeuchi, et al.
Publicat: (2016-01-01)

The concrete distribution: A continuous relaxation of discrete random variables
per: Maddison, C, et al.
Publicat: (2017)

Fast Training Algorithms for Feed Forward Neural Networks
per: Luma N. M. Tawfiq, et al.
Publicat: (2017-04-01)

African buffalo algorithm: Training the probabilistic neural network to solve classification problems
per: Mohammed Alweshah, et al.
Publicat: (2022-05-01)

Probabilistic symmetries and invariant neural networks
per: Bloem-Reddy, B, et al.
Publicat: (2020)

Fast Training Set Size Reduction Using Simple Space Partitioning Algorithms
per: Stefanos Ougiaroglou, et al.
Publicat: (2022-12-01)

Efficient probabilistic inference in generic neural networks trained with non-probabilistic feedback
per: A. Emin Orhan, et al.
Publicat: (2017-07-01)

Fast-M Adversarial Training Algorithm for Deep Neural Networks
per: Yu Ma, et al.
Publicat: (2024-05-01)

Neural probabilistic motor primitives for humanoid control
per: Merel, J, et al.
Publicat: (2019)

Enhanced Probabilistic Inference Algorithm Using Probabilistic Neural Networks for Learning Control
per: Yang Li, et al.
Publicat: (2019-01-01)

Simple, Fast, Scalable, and Reliable Multiprocessor Algorithms
per: Jayanti, Siddhartha Visveswara
Publicat: (2023)

Probabilistic neural network multi-model Kalman filter navigation algorithm
per: Liang Longkai, et al.
Publicat: (2018-06-01)

A fast and simple algorithm for the maximum flow problem
per: Ahuja, Ravindra K., et al.
Publicat: (2009)

A fast and simple algorithm for the maximum flow problem
per: Ahuja, Ravindra K., et al.
Publicat: (2009)

A fast and simple algorithm for the maximum flow problem
Publicat: (2004)

Evidence Networks: simple losses for fast, amortized, neural Bayesian model comparison
per: Niall Jeffrey, et al.
Publicat: (2024-01-01)

Probabilistic coherence, logical consistency, and Bayesian learning: Neural language models as epistemic agents
per: Gregor Betz, et al.
Publicat: (2023-01-01)

Probabilistic coherence, logical consistency, and Bayesian learning: Neural language models as epistemic agents.
per: Gregor Betz, et al.
Publicat: (2023-01-01)

A fast learning algorithm for deep belief nets.
per: Hinton, G, et al.
Publicat: (2006)

Probabilistic Algorithmic Knowledge
per: Joseph Y. Halpern, et al.
Publicat: (2005-12-01)

A simple and fast label correcting algorithm for shortest paths
Publicat: (2003)

Probabilistic modelling of morphologically rich languages
per: Botha, J
Publicat: (2014)

A Brand-New Simple, Fast, and Effective Residual-Based Method for Radial Basis Function Neural Networks Training
per: Lifei Sun, et al.
Publicat: (2023-01-01)

Computational power of probabilistic simple one-sided sticker languages / Mathuri Selvarajoo ...[et al.]
per: Selvarajoo, Mathuri, et al.
Publicat: (2016)

Probabilistic Models with Deep Neural Networks
per: Andrés R. Masegosa, et al.
Publicat: (2021-01-01)

Modeling Uncertainties in EEG Microstates: Analysis of Real and Imagined Motor Movements Using Probabilistic Clustering-Driven Training of Probabilistic Neural Networks
per: Martin Dinov, et al.
Publicat: (2017-11-01)

Probabilistic Composition for Fast Group Decisions
per: Annibal Parracho Sant'Anna, et al.
Publicat: (2011-12-01)

Probabilistic Encoding Models for Multivariate Neural Data
per: Marcus A. Triplett, et al.
Publicat: (2019-01-01)

Chance-Constrained Probabilistic Simple Temporal Problems
per: Fang, Cheng, et al.
Publicat: (2015)

Fast and simple model for atmospheric radiative transfer
per: F. C. Seidel, et al.
Publicat: (2010-08-01)

Probabilistic medical predictions of large language models
per: Bowen Gu, et al.
Publicat: (2024-12-01)

Probabilistic Top-Down Parsing and Language Modeling
per: Brian Roark
Publicat: (2021-03-01)

Simple, efficient, and neural algorithms for sparse coding
per: Arora, Sanjeev, et al.
Publicat: (2018)

Training nuclei detection algorithms with simple annotations
per: Henning Kost, et al.
Publicat: (2017-01-01)

Language equivalence for probabilistic automata
per: Kiefer, S, et al.
Publicat: (2011)

Application of the probabilistic collocation method for an uncertainty analysis of a simple ocean model
Publicat: (2003)

Integration of Neural Embeddings and Probabilistic Models in Topic Modeling
per: Pantea Koochemeshkian, et al.
Publicat: (2024-12-01)

Fast, Simple, and Accurate Time Series Analysis with Large Language Models: An Example of Mean-motion Resonances Identification
per: Evgeny A. Smirnov
Publicat: (2024-01-01)