Sparse Representations for Fast, One-Shot Learning
Humans rapidly and reliably learn many kinds of regularities and generalizations. We propose a novel model of fast learning that exploits the properties of sparse representations and the constraints imposed by a plausible hardware mechanism. To demonstrate our approach we describe a computational mo...
| Main Authors: | , |
|---|---|
| Language: | en_US |
| Published: |
2004
|
| Online Access: | http://hdl.handle.net/1721.1/6673 |
| _version_ | 1826206193468571648 |
|---|---|
| author | Yip, Kenneth Sussman, Gerald Jay |
| author_facet | Yip, Kenneth Sussman, Gerald Jay |
| author_sort | Yip, Kenneth |
| collection | MIT |
| description | Humans rapidly and reliably learn many kinds of regularities and generalizations. We propose a novel model of fast learning that exploits the properties of sparse representations and the constraints imposed by a plausible hardware mechanism. To demonstrate our approach we describe a computational model of acquisition in the domain of morphophonology. We encapsulate phonological information as bidirectional boolean constraint relations operating on the classical linguistic representations of speech sounds in term of distinctive features. The performance model is described as a hardware mechanism that incrementally enforces the constraints. Phonological behavior arises from the action of this mechanism. Constraints are induced from a corpus of common English nouns and verbs. The induction algorithm compiles the corpus into increasingly sophisticated constraints. The algorithm yields one-shot learning from a few examples. Our model has been implemented as a computer program. The program exhibits phonological behavior similar to that of young children. As a bonus the constraints that are acquired can be interpreted as classical linguistic rules. |
| first_indexed | 2024-09-23T13:25:34Z |
| id | mit-1721.1/6673 |
| institution | Massachusetts Institute of Technology |
| language | en_US |
| last_indexed | 2024-09-23T13:25:34Z |
| publishDate | 2004 |
| record_format | dspace |
| spelling | mit-1721.1/66732019-04-11T02:52:48Z Sparse Representations for Fast, One-Shot Learning Yip, Kenneth Sussman, Gerald Jay Humans rapidly and reliably learn many kinds of regularities and generalizations. We propose a novel model of fast learning that exploits the properties of sparse representations and the constraints imposed by a plausible hardware mechanism. To demonstrate our approach we describe a computational model of acquisition in the domain of morphophonology. We encapsulate phonological information as bidirectional boolean constraint relations operating on the classical linguistic representations of speech sounds in term of distinctive features. The performance model is described as a hardware mechanism that incrementally enforces the constraints. Phonological behavior arises from the action of this mechanism. Constraints are induced from a corpus of common English nouns and verbs. The induction algorithm compiles the corpus into increasingly sophisticated constraints. The algorithm yields one-shot learning from a few examples. Our model has been implemented as a computer program. The program exhibits phonological behavior similar to that of young children. As a bonus the constraints that are acquired can be interpreted as classical linguistic rules. 2004-10-08T20:37:08Z 2004-10-08T20:37:08Z 1997-11-01 AIM-1633 http://hdl.handle.net/1721.1/6673 en_US AIM-1633 593039 bytes 557072 bytes application/postscript application/pdf application/postscript application/pdf |
| spellingShingle | Yip, Kenneth Sussman, Gerald Jay Sparse Representations for Fast, One-Shot Learning |
| title | Sparse Representations for Fast, One-Shot Learning |
| title_full | Sparse Representations for Fast, One-Shot Learning |
| title_fullStr | Sparse Representations for Fast, One-Shot Learning |
| title_full_unstemmed | Sparse Representations for Fast, One-Shot Learning |
| title_short | Sparse Representations for Fast, One-Shot Learning |
| title_sort | sparse representations for fast one shot learning |
| url | http://hdl.handle.net/1721.1/6673 |
| work_keys_str_mv | AT yipkenneth sparserepresentationsforfastoneshotlearning AT sussmangeraldjay sparserepresentationsforfastoneshotlearning |