Portal de Periódicos da CAPES

Metropolis Criterion Based Fuzzy Q-Learning Energy Management for Smart Grids

2012; Institute of Advanced Engineering and Science (IAES); Volume: 10; Issue: 8 Linguagem: Inglês

10.11591/telkomnika.v10i8.1626

2087-278X

Xin Li, Chuanzhi Zang, Wenwei Liu, Peng Zeng, Haibin Yu,

Smart Grid and Power Systems

For the energy management problems for demand response in electricity grid, a Metropolis Criterion based fuzzy Q-learning consumer energy management controller (CEMC) is proposed. Because of the uncertainties and highly time-varying, it is not easy to accurately obtain the complete information for the consumer behavior in electricity grid. In this case, the Q-learning, which is independent of mathematic model, and prior-knowledge, has good performance. The fuzzy inference and Metropolis Criterion are introduced in order to facilitate generalization in large state space and balance exploration and exploitation in action selection in Q-learning individually. Simulation results show that the proposed controller can learn to take the best action to regulate consumer behavior with the features of low average end-user financial costs and high consumer satisfaction. DOI: http://dx.doi.org/10.11591/telkomnika.v10i8.1626 Full Text: PDF