Data Driven Linear Quadratic Gaussian Control Design
The implementation of the Linear Quadratic Gaussian (LQG) scheme is often considered problematic as it requires a dynamic model of the system as a whole. The challenges come from state variables without a physical representation and the interference factors that affect the reading process. This pape...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10064282/ |
| _version_ | 1797869044125138944 |
|---|---|
| author | Adi Novitarini Putri Carmadi Machbub Dimitri Mahayana Egi Hidayat |
| author_facet | Adi Novitarini Putri Carmadi Machbub Dimitri Mahayana Egi Hidayat |
| author_sort | Adi Novitarini Putri |
| collection | DOAJ |
| description | The implementation of the Linear Quadratic Gaussian (LQG) scheme is often considered problematic as it requires a dynamic model of the system as a whole. The challenges come from state variables without a physical representation and the interference factors that affect the reading process. This paper presents and assesses a combination of methods to adapt the LQG scheme to a discrete-time linear system. The method KalmanNet constructed by the Long-Short Term Memory architecture (LSTM) is employed to replace the role of Kalman Filter (KF). The Value Iteration (VI) algorithm supersedes the role of the Linear Quadratic Regulator (LQR) controller in solving quadratic regulation issues. The assessment of the proposed algorithm on a cart-pole system and batch distillation column with a disturbance factor in uncorrelated Gaussian white noise is carried out in a simulated way under a discrete-time linear system. The result indicates that the solving of regulation problems through the conventional LQG method is not conclusive as the output response oscillation is still in progress. The combination of the KalmanNet and VI algorithm, as aforementioned, provides better results as it proves to solve the regulation problem as well as to compel the system output to converge. |
| first_indexed | 2024-04-10T00:05:23Z |
| format | Article |
| id | doaj.art-3a4c47078baf49e4ae298e048c7ca789 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-10T00:05:23Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-3a4c47078baf49e4ae298e048c7ca7892023-03-16T23:00:25ZengIEEEIEEE Access2169-35362023-01-0111242272423710.1109/ACCESS.2023.325487910064282Data Driven Linear Quadratic Gaussian Control DesignAdi Novitarini Putri0https://orcid.org/0000-0001-8051-9352Carmadi Machbub1Dimitri Mahayana2Egi Hidayat3Control System and Computer Research Group, School of Electrical Engineering and Informatics, Institut Teknologi Bandung, Bandung, IndonesiaControl System and Computer Research Group, School of Electrical Engineering and Informatics, Institut Teknologi Bandung, Bandung, IndonesiaControl System and Computer Research Group, School of Electrical Engineering and Informatics, Institut Teknologi Bandung, Bandung, IndonesiaControl System and Computer Research Group, School of Electrical Engineering and Informatics, Institut Teknologi Bandung, Bandung, IndonesiaThe implementation of the Linear Quadratic Gaussian (LQG) scheme is often considered problematic as it requires a dynamic model of the system as a whole. The challenges come from state variables without a physical representation and the interference factors that affect the reading process. This paper presents and assesses a combination of methods to adapt the LQG scheme to a discrete-time linear system. The method KalmanNet constructed by the Long-Short Term Memory architecture (LSTM) is employed to replace the role of Kalman Filter (KF). The Value Iteration (VI) algorithm supersedes the role of the Linear Quadratic Regulator (LQR) controller in solving quadratic regulation issues. The assessment of the proposed algorithm on a cart-pole system and batch distillation column with a disturbance factor in uncorrelated Gaussian white noise is carried out in a simulated way under a discrete-time linear system. The result indicates that the solving of regulation problems through the conventional LQG method is not conclusive as the output response oscillation is still in progress. The combination of the KalmanNet and VI algorithm, as aforementioned, provides better results as it proves to solve the regulation problem as well as to compel the system output to converge.https://ieeexplore.ieee.org/document/10064282/Optimal controlLQGLSTMstate estimationreinforcement learning |
| spellingShingle | Adi Novitarini Putri Carmadi Machbub Dimitri Mahayana Egi Hidayat Data Driven Linear Quadratic Gaussian Control Design IEEE Access Optimal control LQG LSTM state estimation reinforcement learning |
| title | Data Driven Linear Quadratic Gaussian Control Design |
| title_full | Data Driven Linear Quadratic Gaussian Control Design |
| title_fullStr | Data Driven Linear Quadratic Gaussian Control Design |
| title_full_unstemmed | Data Driven Linear Quadratic Gaussian Control Design |
| title_short | Data Driven Linear Quadratic Gaussian Control Design |
| title_sort | data driven linear quadratic gaussian control design |
| topic | Optimal control LQG LSTM state estimation reinforcement learning |
| url | https://ieeexplore.ieee.org/document/10064282/ |
| work_keys_str_mv | AT adinovitariniputri datadrivenlinearquadraticgaussiancontroldesign AT carmadimachbub datadrivenlinearquadraticgaussiancontroldesign AT dimitrimahayana datadrivenlinearquadraticgaussiancontroldesign AT egihidayat datadrivenlinearquadraticgaussiancontroldesign |