Learning Based Stochastic Data-Driven Predictive Control

Sandesh Athni Hiremath, Vikas Kumar Mishra, Naim Bajcinca

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


We consider a stochastic linear system with additive Gaussian noise and formulate a stochastic variant of Willems et al. fundamental lemma. Based on this, we formulate a stochastic optimal control problem wherein the system behavior is specified using the developed stochastic fundamental lemma. We call this the stochastic data-driven optimal control problem, which we then show to be equivalent to a statistical regression problem. Following this we construct a parameterized nonlinear estimator and use it to develop a learning algorithm to solve a stochastic data-driven predictive control problem. The proposed algorithm further enables us to consider different generalizations of the problem such as varying initial and Hankel matrix data obtained from stochastic linear and nonlinear system. Based on numerical simulations, we observe that the condition of persistency of excitation of inputs is not necessary for learning. This motivates us to formulate a lemma which indicates that the order of persistency of excitation required by inputs in the fundamental lemma is not strictly necessary.

Original languageEnglish
Title of host publication2022 IEEE 61st Conference on Decision and Control, CDC 2022
PublisherInstitute of Electrical and Electronics Engineers
Number of pages8
ISBN (Electronic)9781665467612
StatePublished - Dec 2022
Externally publishedYes
Event61st IEEE Conference on Decision and Control, CDC 2022 - Cancun, Mexico
Duration: 6 Dec 20229 Dec 2022

Publication series

NameProceedings of the IEEE Conference on Decision and Control
ISSN (Print)0743-1546
ISSN (Electronic)2576-2370


Conference61st IEEE Conference on Decision and Control, CDC 2022

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Modeling and Simulation
  • Control and Optimization


Dive into the research topics of 'Learning Based Stochastic Data-Driven Predictive Control'. Together they form a unique fingerprint.

Cite this