Optimization of neural network feedback control systems using automatic differentiation
Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Aeronautics and Astronautics, 2009.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2010
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/59691 |
| _version_ | 1811095201873133568 |
|---|---|
| author | Rollins, Elizabeth, S.M. Massachusetts Institute of Technology |
| author2 | Steven R. Hall and Christopher W. Dever. |
| author_facet | Steven R. Hall and Christopher W. Dever. Rollins, Elizabeth, S.M. Massachusetts Institute of Technology |
| author_sort | Rollins, Elizabeth, S.M. Massachusetts Institute of Technology |
| collection | MIT |
| description | Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Aeronautics and Astronautics, 2009. |
| first_indexed | 2024-09-23T16:12:12Z |
| format | Thesis |
| id | mit-1721.1/59691 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T16:12:12Z |
| publishDate | 2010 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/596912019-04-12T21:56:41Z Optimization of neural network feedback control systems using automatic differentiation Rollins, Elizabeth, S.M. Massachusetts Institute of Technology Steven R. Hall and Christopher W. Dever. Massachusetts Institute of Technology. Dept. of Aeronautics and Astronautics. Massachusetts Institute of Technology. Dept. of Aeronautics and Astronautics. Aeronautics and Astronautics. Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Aeronautics and Astronautics, 2009. Cataloged from PDF version of thesis. Includes bibliographical references (p. 95-97). Optimal control problems can be challenging to solve, whether using analytic or numerical methods. This thesis examines the application of an adjoint method for optimal feedback control, which combines various algorithmic techniques into an original numerical method. In the method investigated here, a neural network defines the control input in both trajectory and feedback control optimization problems. The weights of the neural network that minimize a cost function are determined by an unconstrained optimization routine. By using automatic differentiation on the code that evaluates the cost function, the gradient of the cost with respect to the weights is obtained for the gradient search phase of the optimization process. Automatic differentiation is more efficient than hand-differentiating code for the user and provides exact gradients, allowing the optimization of the neural network weights to proceed more rapidly. Another benefit of this method comes from its use of neural networks, which are able to represent complex feedback control policies, because they are general nonlinear function approximators. Neural networks also have the potential to be generalizable, meaning that a control policy found using a sufficiently rich training set will often work well for other initial conditions outside of the training set. Finally, the software implementation is modular, which means that the user only needs to adjust a few codes in order to set up the method for a specific problem. The application of the adjoint method to three control problems with known solutions demonstrates the ability of the method to determine neural networks that produce near-optimal trajectories and control policies. by Elizabeth Rollins. S.M. 2010-10-29T18:13:25Z 2010-10-29T18:13:25Z 2009 2009 Thesis http://hdl.handle.net/1721.1/59691 668240932 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 97 p. application/pdf Massachusetts Institute of Technology |
| spellingShingle | Aeronautics and Astronautics. Rollins, Elizabeth, S.M. Massachusetts Institute of Technology Optimization of neural network feedback control systems using automatic differentiation |
| title | Optimization of neural network feedback control systems using automatic differentiation |
| title_full | Optimization of neural network feedback control systems using automatic differentiation |
| title_fullStr | Optimization of neural network feedback control systems using automatic differentiation |
| title_full_unstemmed | Optimization of neural network feedback control systems using automatic differentiation |
| title_short | Optimization of neural network feedback control systems using automatic differentiation |
| title_sort | optimization of neural network feedback control systems using automatic differentiation |
| topic | Aeronautics and Astronautics. |
| url | http://hdl.handle.net/1721.1/59691 |
| work_keys_str_mv | AT rollinselizabethsmmassachusettsinstituteoftechnology optimizationofneuralnetworkfeedbackcontrolsystemsusingautomaticdifferentiation |