Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

A DEEP REINFORCEMENT LEARNING APPROACH FOR FAST FREQUENCY CONTROL IN ELASTIC POWER SYSTEM

Albeladi, Faisal (2024) A DEEP REINFORCEMENT LEARNING APPROACH FOR FAST FREQUENCY CONTROL IN ELASTIC POWER SYSTEM. Doctoral Dissertation, University of Pittsburgh. (Unpublished)

[img] PDF
Restricted to University of Pittsburgh users only until 3 June 2026.

Download (16MB) | Request a Copy

Abstract

As power systems transition towards sustainable energy sources, the integration of renewables poses several challenges that necessitate innovative management and control strategies. This dissertation addresses the urgent challenges faced by modern power systems due to the high penetration of renewable energy sources, increased demand, and the integration of diverse market participants. These factors introduce significant unpredictability and complexity, leading to voltage and frequency stability issues and necessitating the construction of new power infrastructure, which imposes operational, financial and environmental burdens.

To overcome these obstacles, this dissertation explores the innovative application of Deep Learning (DL) and Reinforcement Learning (RL) to develop real-time, adaptive control strategies that can cope with the non-linear and stochastic nature of today's power grids. Specifically, it presents a model-free frequency control scheme utilizing Deep Reinforcement Learning (DRL) that focuses on enhancing primary and secondary frequency control mechanisms through the Deep Deterministic Policy Gradient (DDPG) method. This approach demonstrates significant potential in mitigating the adverse effects of grid stochasticity, thereby bolstering system stability.

Additionally, the dissertation delves into the optimization of grid-interactive efficient buildings using the Soft Actor-Critic (SAC) algorithm, optimizing a cluster of energy storage systems performance for improved peak shaving, valley filling, and grid self-sustainability. The experimental results demonstrate that the central controller achieves high performance at both local and district wide operational evaluation indices.

Lastly, we tackle the low inertia challenge in zero-carbon grids through the application of Graph Neural Networks (GNNs), particularly the Graph Attention Network (GAT), for effective inertia estimation. This innovative method aids in the precise management of grid resources post-disturbance, highlighting the critical role of attention mechanisms in enhancing decision-making processes for system operators.

The findings underscore the transformative impact of DL and RL in advancing power system control and management, especially amidst the complexities introduced by renewable energy integration and the transition to low-inertia grids. The proposed solutions not only pave the way for advanced real-time control strategies but also signify a leap towards sustainable and resilient power systems in the era of green energy.


Share

Citation/Export:
Social Networking:
Share |

Details

Item Type: University of Pittsburgh ETD
Status: Unpublished
Creators/Authors:
CreatorsEmailPitt UsernameORCID
Albeladi, Faisalfaa84@pitt.edufaa84
ETD Committee:
TitleMemberEmail AddressPitt UsernameORCID
Committee ChairBarati, Masoudmasoud.barati@pitt.edumab593
Committee MemberZhi-Hong, Maozhm4@pitt.eduzhm4
Committee MemberKwasinski, Alxeisakwasins@pitt.eduakwasins
Committee MemberAkcakaya, Muratakcakaya@pitt.eduakcakaya
Committee MemberDallal, Ahmedahd12@pitt.eduahd12
Committee MemberAghamolki, Hosseinhosseinghassempouraghamolki@eaton.com
Date: 3 June 2024
Date Type: Publication
Defense Date: 26 March 2024
Approval Date: 3 June 2024
Submission Date: 31 March 2024
Access Restriction: 2 year -- Restrict access to University of Pittsburgh for a period of 2 years.
Number of Pages: 159
Institution: University of Pittsburgh
Schools and Programs: Swanson School of Engineering > Electrical and Computer Engineering
Degree: PhD - Doctor of Philosophy
Thesis Type: Doctoral Dissertation
Refereed: Yes
Uncontrolled Keywords: Deep Reinforcement Learning Frequency control Grid-interactive efficient building inertia estimation Load frequency control primary frequency control Grid-supportive loads
Date Deposited: 03 Jun 2024 14:40
Last Modified: 03 Jun 2024 14:40
URI: http://d-scholarship.pitt.edu/id/eprint/45939

Metrics

Monthly Views for the past 3 years

Plum Analytics


Actions (login required)

View Item View Item