The Augmented Geometrically Spaced Transform : applications of the single channel frequency estimator
Thesis: S.M., Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, February, 2021
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2021
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/1721.1/131006 |
| _version_ | 1826198069674246144 |
|---|---|
| author | Feldman, Jonathan Michael,S.M.Massachusetts Institute of Technology. |
| author2 | Joseph A. Paradiso. |
| author_facet | Joseph A. Paradiso. Feldman, Jonathan Michael,S.M.Massachusetts Institute of Technology. |
| author_sort | Feldman, Jonathan Michael,S.M.Massachusetts Institute of Technology. |
| collection | MIT |
| description | Thesis: S.M., Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, February, 2021 |
| first_indexed | 2024-09-23T10:58:23Z |
| format | Thesis |
| id | mit-1721.1/131006 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T10:58:23Z |
| publishDate | 2021 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1310062021-06-18T03:25:23Z The Augmented Geometrically Spaced Transform : applications of the single channel frequency estimator Applications of the single channel frequency estimator Feldman, Jonathan Michael,S.M.Massachusetts Institute of Technology. Joseph A. Paradiso. Program in Media Arts and Sciences (Massachusetts Institute of Technology) Program in Media Arts and Sciences (Massachusetts Institute of Technology) Program in Media Arts and Sciences Thesis: S.M., Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, February, 2021 Cataloged from the official PDF version of thesis. Includes bibliographical references (pages 99-103). The Augmented Geometrically Spaced Transform (AGST) is an auditory model that is based on an inversion of the acoustic piano, where the piano produces music and the transform analyses it. In contrast with the standard spectrogram, which is a complex frequency vector versus time, the AGST is based around a matrix of frequencies, known as the AGST Frequency Matrix, where for every frequency in the matrix, a spectral envelope is computed using a Single Channel Frequency Estimator (SCFE). The core invention of the thesis is the algorithm for the SCFE, which computes spectral envelopes with maximally high definition in a computationally efficient manner. A bank of SCFEs is assembled into a constant Q transform, known as a Geometrically Spaced Transform (GST). The GST can be used to visualize harmonics inside of musical notes, or audio in general, in a constant Q fashion. It is then shown that the AGST is a good front-end model for computational pitch perception. For example, it can be used to solve an important problem in auditory perception, the case of the missing fundamental. The entire thesis is framed in the context of building artificially intelligent music systems, including synthetic listeners (machines that listen in the way that people do), and synthetic performers (machines that allow for interactive music performance). by Jonathan Michael Feldman. S.M. S.M. Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences 2021-06-17T17:21:16Z 2021-06-17T17:21:16Z 2021 2021 Thesis https://hdl.handle.net/1721.1/131006 1256659362 eng MIT theses may be protected by copyright. Please reuse MIT thesis content according to the MIT Libraries Permissions Policy, which is available through the URL provided. http://dspace.mit.edu/handle/1721.1/7582 103 pages application/pdf Massachusetts Institute of Technology |
| spellingShingle | Program in Media Arts and Sciences Feldman, Jonathan Michael,S.M.Massachusetts Institute of Technology. The Augmented Geometrically Spaced Transform : applications of the single channel frequency estimator |
| title | The Augmented Geometrically Spaced Transform : applications of the single channel frequency estimator |
| title_full | The Augmented Geometrically Spaced Transform : applications of the single channel frequency estimator |
| title_fullStr | The Augmented Geometrically Spaced Transform : applications of the single channel frequency estimator |
| title_full_unstemmed | The Augmented Geometrically Spaced Transform : applications of the single channel frequency estimator |
| title_short | The Augmented Geometrically Spaced Transform : applications of the single channel frequency estimator |
| title_sort | augmented geometrically spaced transform applications of the single channel frequency estimator |
| topic | Program in Media Arts and Sciences |
| url | https://hdl.handle.net/1721.1/131006 |
| work_keys_str_mv | AT feldmanjonathanmichaelsmmassachusettsinstituteoftechnology theaugmentedgeometricallyspacedtransformapplicationsofthesinglechannelfrequencyestimator AT feldmanjonathanmichaelsmmassachusettsinstituteoftechnology applicationsofthesinglechannelfrequencyestimator AT feldmanjonathanmichaelsmmassachusettsinstituteoftechnology augmentedgeometricallyspacedtransformapplicationsofthesinglechannelfrequencyestimator |