D3PI: Data-Driven Distributed Policy Iteration for Homogeneous Interconnected Systems

by   Siavash Alemzadeh, et al.

Control of large-scale networked systems often necessitates the availability of complex models for the interactions amongst the agents. While building accurate models of these interactions could become prohibitive in many applications, data-driven control methods can circumvent model complexities by directly synthesizing a controller from the observed data. In this paper, we propose the Data-Driven Distributed Policy Iteration (D3PI) algorithm to design a feedback mechanism for a potentially large system that enjoys an underlying graph structure characterizing communications among the agents. Rather than having access to system parameters, our algorithm requires temporary "auxiliary" links to boost information exchange of a small portion of the graph during the learning phase. Therein, the costs are partitioned for learning and non-learning agents in order to ensure consistent control of the entire network. After the termination of the learning process, a distributed policy is proposed for the entire networked system by leveraging estimated components obtained in the learning phase. We provide extensive stability and convergence guarantees of the proposed distributed controller throughout the learning phase by exploiting the structure of the system parameters that occur due to the graph topology and existence of the temporary links. The practicality of our method is then illustrated with a simulation.


page 1

page 2

page 3

page 4


Data-driven modeling and control of large-scale dynamical systems in the Loewner framework

In this contribution, we discuss the modeling and model reduction framew...

Near-Optimal Distributed Linear-Quadratic Regulator for Networked Systems

This paper studies the trade-off between the degree of decentralization ...

A Hybrid Graph Coloring Algorithm for GPUs

Graph algorithms mainly belong to two categories, topology-driven and da...

Robust Data-Driven Output Feedback Control via Bootstrapped Multiplicative Noise

We propose a robust data-driven output feedback control algorithm that e...

Inverse Graph Learning over Optimization Networks

Many inferential and learning tasks can be accomplished efficiently by m...

Online Regulation of Unstable LTI Systems from a Single Trajectory

Recently, data-driven methods for control of dynamic systems have receiv...

Control-Tutored Reinforcement Learning: Towards the Integration of Data-Driven and Model-Based Control

We present an architecture where a feedback controller derived on an app...

Please sign up or login with your details

Forgot password? Click here to reset