Direct adaptive control using single network adaptive critic

Swagat Kumar, Radhakant Padhi, Laxmidhar Behera

Research output: Chapter in Book/Report/Conference proceedingChapter

7 Citations (Scopus)

Abstract

An optimal control law for a general nonlinear system can be obtained by solving Hamilton-Jacobi-Bellman equation. However, it is difficult to obtain an analytical solution of this equation. In this paper, we propose a direct adaptive control method for affine systems where the optimal value function is approximated using a critic network and the weight update law is derived so as to satisfy the HJB equation. This provides an alternative method to solve the HJB equation in real-time and thus paves the way for introducing some notion of optimality to direct adaptive control paradigm. The efficacy of the scheme is demonstrated for a linearized mass-spring-damper system and its performance is compared with that of LQR. ©2007 IEEE.
Original languageEnglish
Title of host publication2007 IEEE International Conference on System of Systems Engineering, SOSE
DOIs
Publication statusPublished - 2007
Event 2007 IEEE International Conference on System of Systems Engineering - San Antonio, Texas, United States
Duration: 16 Apr 200718 Apr 2007

Publication series

Name2007 IEEE International Conference on System of Systems Engineering, SOSE

Conference

Conference 2007 IEEE International Conference on System of Systems Engineering
CountryUnited States
CitySan Antonio, Texas
Period16/04/0718/04/07

Fingerprint

Nonlinear systems

Cite this

Kumar, S., Padhi, R., & Behera, L. (2007). Direct adaptive control using single network adaptive critic. In 2007 IEEE International Conference on System of Systems Engineering, SOSE (2007 IEEE International Conference on System of Systems Engineering, SOSE). https://doi.org/10.1109/SYSOSE.2007.4304249
Kumar, Swagat ; Padhi, Radhakant ; Behera, Laxmidhar. / Direct adaptive control using single network adaptive critic. 2007 IEEE International Conference on System of Systems Engineering, SOSE. 2007. (2007 IEEE International Conference on System of Systems Engineering, SOSE).
@inbook{69eb6644e095475e93799cdfa90d0874,
title = "Direct adaptive control using single network adaptive critic",
abstract = "An optimal control law for a general nonlinear system can be obtained by solving Hamilton-Jacobi-Bellman equation. However, it is difficult to obtain an analytical solution of this equation. In this paper, we propose a direct adaptive control method for affine systems where the optimal value function is approximated using a critic network and the weight update law is derived so as to satisfy the HJB equation. This provides an alternative method to solve the HJB equation in real-time and thus paves the way for introducing some notion of optimality to direct adaptive control paradigm. The efficacy of the scheme is demonstrated for a linearized mass-spring-damper system and its performance is compared with that of LQR. {\circledC}2007 IEEE.",
author = "Swagat Kumar and Radhakant Padhi and Laxmidhar Behera",
year = "2007",
doi = "10.1109/SYSOSE.2007.4304249",
language = "English",
isbn = "1424411602",
series = "2007 IEEE International Conference on System of Systems Engineering, SOSE",
booktitle = "2007 IEEE International Conference on System of Systems Engineering, SOSE",

}

Kumar, S, Padhi, R & Behera, L 2007, Direct adaptive control using single network adaptive critic. in 2007 IEEE International Conference on System of Systems Engineering, SOSE. 2007 IEEE International Conference on System of Systems Engineering, SOSE, 2007 IEEE International Conference on System of Systems Engineering, San Antonio, Texas, United States, 16/04/07. https://doi.org/10.1109/SYSOSE.2007.4304249

Direct adaptive control using single network adaptive critic. / Kumar, Swagat; Padhi, Radhakant; Behera, Laxmidhar.

2007 IEEE International Conference on System of Systems Engineering, SOSE. 2007. (2007 IEEE International Conference on System of Systems Engineering, SOSE).

Research output: Chapter in Book/Report/Conference proceedingChapter

TY - CHAP

T1 - Direct adaptive control using single network adaptive critic

AU - Kumar, Swagat

AU - Padhi, Radhakant

AU - Behera, Laxmidhar

PY - 2007

Y1 - 2007

N2 - An optimal control law for a general nonlinear system can be obtained by solving Hamilton-Jacobi-Bellman equation. However, it is difficult to obtain an analytical solution of this equation. In this paper, we propose a direct adaptive control method for affine systems where the optimal value function is approximated using a critic network and the weight update law is derived so as to satisfy the HJB equation. This provides an alternative method to solve the HJB equation in real-time and thus paves the way for introducing some notion of optimality to direct adaptive control paradigm. The efficacy of the scheme is demonstrated for a linearized mass-spring-damper system and its performance is compared with that of LQR. ©2007 IEEE.

AB - An optimal control law for a general nonlinear system can be obtained by solving Hamilton-Jacobi-Bellman equation. However, it is difficult to obtain an analytical solution of this equation. In this paper, we propose a direct adaptive control method for affine systems where the optimal value function is approximated using a critic network and the weight update law is derived so as to satisfy the HJB equation. This provides an alternative method to solve the HJB equation in real-time and thus paves the way for introducing some notion of optimality to direct adaptive control paradigm. The efficacy of the scheme is demonstrated for a linearized mass-spring-damper system and its performance is compared with that of LQR. ©2007 IEEE.

UR - http://www.mendeley.com/research/direct-adaptive-control-using-single-network-adaptive-critic

U2 - 10.1109/SYSOSE.2007.4304249

DO - 10.1109/SYSOSE.2007.4304249

M3 - Chapter

SN - 1424411602

T3 - 2007 IEEE International Conference on System of Systems Engineering, SOSE

BT - 2007 IEEE International Conference on System of Systems Engineering, SOSE

ER -

Kumar S, Padhi R, Behera L. Direct adaptive control using single network adaptive critic. In 2007 IEEE International Conference on System of Systems Engineering, SOSE. 2007. (2007 IEEE International Conference on System of Systems Engineering, SOSE). https://doi.org/10.1109/SYSOSE.2007.4304249