On Memory Limitations in Natural Language Processing

This paper proposes a welcome hypothesis: a computationally simple device is sufficient for processing natural language. Traditionally it has been argued that processing natural language syntax requires very powerful machinery. Many engineers have come to this rather grim conclusion: almost all wo...

Full description

Bibliographic Details
Main Author: Church, Kenneth Ward
Other Authors: Szolovits, Peter
Published: 2023
Online Access:https://hdl.handle.net/1721.1/149526
Description
Summary:This paper proposes a welcome hypothesis: a computationally simple device is sufficient for processing natural language. Traditionally it has been argued that processing natural language syntax requires very powerful machinery. Many engineers have come to this rather grim conclusion: almost all working parsers are actually Turing Machines (TM). For example, Woods specifically designed his Augmented Transition Networks (ATNs) to be Turing Equivalent.