Noisy Data and Impulse Response Estimation
This paper investigates the impulse response estimation of linear time-invariant (LTI) systems when only noisy finite-length input-output data of the system is available. The competing parametric candidates are the least square impulse response estimates of possibly different lengths. It is known th...
| Main Authors: | , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | en_US |
| Published: |
Institute of Electrical and Electronics Engineers (IEEE)
2012
|
| Online Access: | http://hdl.handle.net/1721.1/69891 https://orcid.org/0000-0002-1470-2148 |
| _version_ | 1826206054438928384 |
|---|---|
| author | Beheshti, Soosan Dahleh, Munther A. |
| author2 | Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science |
| author_facet | Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Beheshti, Soosan Dahleh, Munther A. |
| author_sort | Beheshti, Soosan |
| collection | MIT |
| description | This paper investigates the impulse response estimation of linear time-invariant (LTI) systems when only noisy finite-length input-output data of the system is available. The competing parametric candidates are the least square impulse response estimates of possibly different lengths. It is known that the presence of noise prohibits using model sets with large number of parameters as the resulting parameter estimation error can be quite large. Model selection methods acknowledge this problem, hence, they provide metrics to compare estimates in different model classes. Such metrics typically involve a combination of the available least-square output error, which decreases as the number of parameters increases, and a function that penalizes the size of the model. In this paper, we approach the model class selection problem from a different perspective that is closely related to the involved denoising problem. The method primarily focuses on estimating the parameter error in a given model class of finite order using the available least-square output error. We show that such an estimate, which is provided in terms of upper and lower bounds with certain level of confidence, contains the appropriate tradeoffs between the bias and variance of the estimation error. Consequently, these measures can be used as the basis for model comparison and model selection. Furthermore, we demonstrate how this approach reduces to the celebrated AIC method for a specific confidence level. The performance of the method as the noise variance and/or the data length varies is explored, and consistency of the approach as the data length grows is analyzed. |
| first_indexed | 2024-09-23T13:23:22Z |
| format | Article |
| id | mit-1721.1/69891 |
| institution | Massachusetts Institute of Technology |
| language | en_US |
| last_indexed | 2024-09-23T13:23:22Z |
| publishDate | 2012 |
| publisher | Institute of Electrical and Electronics Engineers (IEEE) |
| record_format | dspace |
| spelling | mit-1721.1/698912022-10-01T14:56:51Z Noisy Data and Impulse Response Estimation Beheshti, Soosan Dahleh, Munther A. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Dahleh, Munther A. Dahleh, Munther A. This paper investigates the impulse response estimation of linear time-invariant (LTI) systems when only noisy finite-length input-output data of the system is available. The competing parametric candidates are the least square impulse response estimates of possibly different lengths. It is known that the presence of noise prohibits using model sets with large number of parameters as the resulting parameter estimation error can be quite large. Model selection methods acknowledge this problem, hence, they provide metrics to compare estimates in different model classes. Such metrics typically involve a combination of the available least-square output error, which decreases as the number of parameters increases, and a function that penalizes the size of the model. In this paper, we approach the model class selection problem from a different perspective that is closely related to the involved denoising problem. The method primarily focuses on estimating the parameter error in a given model class of finite order using the available least-square output error. We show that such an estimate, which is provided in terms of upper and lower bounds with certain level of confidence, contains the appropriate tradeoffs between the bias and variance of the estimation error. Consequently, these measures can be used as the basis for model comparison and model selection. Furthermore, we demonstrate how this approach reduces to the celebrated AIC method for a specific confidence level. The performance of the method as the noise variance and/or the data length varies is explored, and consistency of the approach as the data length grows is analyzed. 2012-03-30T16:39:30Z 2012-03-30T16:39:30Z 2010-01 2009-06 Article http://purl.org/eprint/type/JournalArticle 1053-587X 1941-0476 INSPEC Accession Number: 11054884 http://hdl.handle.net/1721.1/69891 Beheshti, S., and M.A. Dahleh. “Noisy Data and Impulse Response Estimation.” IEEE Transactions on Signal Processing 58.2 (2010): 510–521. Web. 30 Mar. 2012. © 2010 Institute of Electrical and Electronics Engineers https://orcid.org/0000-0002-1470-2148 en_US http://dx.doi.org/10.1109/tsp.2009.2032031 IEEE Transactions on Signal Processing Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use. application/pdf Institute of Electrical and Electronics Engineers (IEEE) IEEE |
| spellingShingle | Beheshti, Soosan Dahleh, Munther A. Noisy Data and Impulse Response Estimation |
| title | Noisy Data and Impulse Response Estimation |
| title_full | Noisy Data and Impulse Response Estimation |
| title_fullStr | Noisy Data and Impulse Response Estimation |
| title_full_unstemmed | Noisy Data and Impulse Response Estimation |
| title_short | Noisy Data and Impulse Response Estimation |
| title_sort | noisy data and impulse response estimation |
| url | http://hdl.handle.net/1721.1/69891 https://orcid.org/0000-0002-1470-2148 |
| work_keys_str_mv | AT beheshtisoosan noisydataandimpulseresponseestimation AT dahlehmunthera noisydataandimpulseresponseestimation |