Data-Driven Stochastic Control of Delayed Air-Conditioning Systems

We consider a stochastic optimal control problem arising in the operation of industrial air-conditioning systems with delayed activation effects. The delayed transition between inactive and operational regimes induces a non-Markovian structure in the controlled dynamics. We derive a regression-based discrete dynamic programming algorithm on nested state-control grids. We give a probabilistic proof of convergence of the idealized time-discrete dynamic programming problem to the continuous-time value function. Numerical experiments based on calibrated multidimensional forecast-tracking Ornstein--Uhlenbeck models illustrate the effectiveness of the proposed methodology.

Source: arXiv:2610.35811v1 - http://arxiv.org/abs/2610.35811v1 PDF: https://arxiv.org/pdf/2610.35811v1 Original Link: http://arxiv.org/abs/2610.35811v1