Portal de Periódicos da CAPES

Adaptive critic designs

1997; Institute of Electrical and Electronics Engineers; Volume: 8; Issue: 5 Linguagem: Inglês

10.1109/72.623201

1941-0093

Danil Prokhorov, Donald C. Wunsch,

Extremum Seeking Control Systems

We discuss a variety of adaptive critic designs (ACDs) for neurocontrol. These are suitable for learning in noisy, nonlinear, and nonstationary environments. They have common roots as generalizations of dynamic programming for neural reinforcement learning approaches. Our discussion of these origins leads to an explanation of three design families: heuristic dynamic programming, dual heuristic programming, and globalized dual heuristic programming (GDHP). The main emphasis is on DHP and GDHP as advanced ACDs. We suggest two new modifications of the original GDHP design that are currently the only working implementations of GDHP. They promise to be useful for many engineering applications in the areas of optimization and optimal control. Based on one of these modifications, we present a unified approach to all ACDs. This leads to a generalized training procedure for ACDs.