Comparative Performance of UPQC Control System Based on PI-GWO, Fractional Order Controllers, and Reinforcement Learning Agent

In this paper, based on a benchmark on the performance of a Unified Power Quality Conditioner (UPQC), the improvement of this performance is presented comparatively by using Proportional Integrator (PI)-type controllers optimized by a Grey Wolf Optimization (GWO) computational intelligence method, f...

Full description

Bibliographic Details
Main Authors: Marcel Nicola, Claudiu-Ionel Nicola, Dumitru Sacerdoțianu, Adrian Vintilă
Format: Article
Language:English
Published: MDPI AG 2023-01-01
Series:Electronics
Subjects:
Online Access:https://www.mdpi.com/2079-9292/12/3/494
_version_ 1797624799530319872
author Marcel Nicola
Claudiu-Ionel Nicola
Dumitru Sacerdoțianu
Adrian Vintilă
author_facet Marcel Nicola
Claudiu-Ionel Nicola
Dumitru Sacerdoțianu
Adrian Vintilă
author_sort Marcel Nicola
collection DOAJ
description In this paper, based on a benchmark on the performance of a Unified Power Quality Conditioner (UPQC), the improvement of this performance is presented comparatively by using Proportional Integrator (PI)-type controllers optimized by a Grey Wolf Optimization (GWO) computational intelligence method, fractional order (FO)-type controllers based on differential and integral fractional calculus, and a PI-type controller in tandem with a Reinforcement Learning—Twin-Delayed Deep Deterministic Policy Gradient (RL-TD3) agent. The main components of the UPQC are a series active filter and an Active Parallel Filter (APF) coupled to a common DC intermediate circuit. The active series filter provides the voltage reference for the APF, which in turn corrects both the harmonic content introduced by the load and the <i>V<sub>DC</sub></i> voltage in the DC intermediate circuit. The UPQC performance is improved by using the types of controllers listed above in the APF structure. The main performance indicators of the UPQC-APF control system for the controllers listed above are: stationary error, voltage ripple, and fractal dimension (DF) of the <i>V<sub>DC</sub></i> voltage in the DC intermediate circuit. Results are also presented on the improvement of both current and voltage Total harmonic distortion (THD) in the case of, respectively, a linear and nonlinear load highly polluting in terms of harmonic content. Numerical simulations performed in a MATLAB/Simulink environment demonstrate superior performance of UPQC-APF control system when using PI with RL-TD3 agent and FO-type controller compared to classical PI controllers.
first_indexed 2024-03-11T09:47:41Z
format Article
id doaj.art-1780c5c971fb4c71ad2e0861c913ec89
institution Directory Open Access Journal
issn 2079-9292
language English
last_indexed 2024-03-11T09:47:41Z
publishDate 2023-01-01
publisher MDPI AG
record_format Article
series Electronics
spelling doaj.art-1780c5c971fb4c71ad2e0861c913ec892023-11-16T16:27:16ZengMDPI AGElectronics2079-92922023-01-0112349410.3390/electronics12030494Comparative Performance of UPQC Control System Based on PI-GWO, Fractional Order Controllers, and Reinforcement Learning AgentMarcel Nicola0Claudiu-Ionel Nicola1Dumitru Sacerdoțianu2Adrian Vintilă3Research and Development Department, National Institute for Research, Development and Testing in Electrical Engineering—ICMET Craiova, 200746 Craiova, RomaniaResearch and Development Department, National Institute for Research, Development and Testing in Electrical Engineering—ICMET Craiova, 200746 Craiova, RomaniaResearch and Development Department, National Institute for Research, Development and Testing in Electrical Engineering—ICMET Craiova, 200746 Craiova, RomaniaResearch and Development Department, National Institute for Research, Development and Testing in Electrical Engineering—ICMET Craiova, 200746 Craiova, RomaniaIn this paper, based on a benchmark on the performance of a Unified Power Quality Conditioner (UPQC), the improvement of this performance is presented comparatively by using Proportional Integrator (PI)-type controllers optimized by a Grey Wolf Optimization (GWO) computational intelligence method, fractional order (FO)-type controllers based on differential and integral fractional calculus, and a PI-type controller in tandem with a Reinforcement Learning—Twin-Delayed Deep Deterministic Policy Gradient (RL-TD3) agent. The main components of the UPQC are a series active filter and an Active Parallel Filter (APF) coupled to a common DC intermediate circuit. The active series filter provides the voltage reference for the APF, which in turn corrects both the harmonic content introduced by the load and the <i>V<sub>DC</sub></i> voltage in the DC intermediate circuit. The UPQC performance is improved by using the types of controllers listed above in the APF structure. The main performance indicators of the UPQC-APF control system for the controllers listed above are: stationary error, voltage ripple, and fractal dimension (DF) of the <i>V<sub>DC</sub></i> voltage in the DC intermediate circuit. Results are also presented on the improvement of both current and voltage Total harmonic distortion (THD) in the case of, respectively, a linear and nonlinear load highly polluting in terms of harmonic content. Numerical simulations performed in a MATLAB/Simulink environment demonstrate superior performance of UPQC-APF control system when using PI with RL-TD3 agent and FO-type controller compared to classical PI controllers.https://www.mdpi.com/2079-9292/12/3/494UPQCactive power filtergrey wolf optimizationfractional orderreinforcement learning
spellingShingle Marcel Nicola
Claudiu-Ionel Nicola
Dumitru Sacerdoțianu
Adrian Vintilă
Comparative Performance of UPQC Control System Based on PI-GWO, Fractional Order Controllers, and Reinforcement Learning Agent
Electronics
UPQC
active power filter
grey wolf optimization
fractional order
reinforcement learning
title Comparative Performance of UPQC Control System Based on PI-GWO, Fractional Order Controllers, and Reinforcement Learning Agent
title_full Comparative Performance of UPQC Control System Based on PI-GWO, Fractional Order Controllers, and Reinforcement Learning Agent
title_fullStr Comparative Performance of UPQC Control System Based on PI-GWO, Fractional Order Controllers, and Reinforcement Learning Agent
title_full_unstemmed Comparative Performance of UPQC Control System Based on PI-GWO, Fractional Order Controllers, and Reinforcement Learning Agent
title_short Comparative Performance of UPQC Control System Based on PI-GWO, Fractional Order Controllers, and Reinforcement Learning Agent
title_sort comparative performance of upqc control system based on pi gwo fractional order controllers and reinforcement learning agent
topic UPQC
active power filter
grey wolf optimization
fractional order
reinforcement learning
url https://www.mdpi.com/2079-9292/12/3/494
work_keys_str_mv AT marcelnicola comparativeperformanceofupqccontrolsystembasedonpigwofractionalordercontrollersandreinforcementlearningagent
AT claudiuionelnicola comparativeperformanceofupqccontrolsystembasedonpigwofractionalordercontrollersandreinforcementlearningagent
AT dumitrusacerdotianu comparativeperformanceofupqccontrolsystembasedonpigwofractionalordercontrollersandreinforcementlearningagent
AT adrianvintila comparativeperformanceofupqccontrolsystembasedonpigwofractionalordercontrollersandreinforcementlearningagent