Informational and Causal Architecture of Continuous-time Renewal Processes

We introduce the minimal maximally predictive models (ϵ-machines) of processes generated by certain hidden semi-Markov models. Their causal states are either discrete, mixed, or continuous random variables and causal-state transitions are described by partial differential equations. As an applicatio...

Full description

Bibliographic Details
Main Authors: Crutchfield, James P., Marzen, Sarah E.
Other Authors: Massachusetts Institute of Technology. Department of Physics
Format: Article
Language:English
Published: Springer US 2017
Online Access:http://hdl.handle.net/1721.1/109960
Description
Summary:We introduce the minimal maximally predictive models (ϵ-machines) of processes generated by certain hidden semi-Markov models. Their causal states are either discrete, mixed, or continuous random variables and causal-state transitions are described by partial differential equations. As an application, we present a complete analysis of the ϵ-machines of continuous-time renewal processes. This leads to closed-form expressions for their entropy rate, statistical complexity, excess entropy, and differential information anatomy rates.