Dynamical programming approach for controlling the directed Abelian Dhar-Ramaswamy model

Phys Rev E Stat Nonlin Soft Matter Phys. 2010 Sep;82(3 Pt 1):031108. doi: 10.1103/PhysRevE.82.031108. Epub 2010 Sep 3.

Abstract

A dynamical programming approach is used to deal with the problem of controlling the directed abelian Dhar-Ramaswamy model on two-dimensional square lattice. Two strategies are considered to obtain explicit results to this task. First, the optimal solution of the problem is characterized by the solution of the Bellman equation obtained by numerical algorithms. Second, the solution is used as a benchmark to value how far from the optimum other heuristics that can be applied to larger systems are. This approach is the first attempt on the direction of schemes for controlling self-organized criticality that are based on optimization principles that consider explicitly a tradeoff between the size of the avalanches and the cost of intervention.