Visible to the public Compositionality of Linearly Solvable Optimal Control in Networked Multi-Agent Systems

TitleCompositionality of Linearly Solvable Optimal Control in Networked Multi-Agent Systems
Publication TypeConference Paper
Year of Publication2021
AuthorsSong, Lin, Wan, Neng, Gahlawat, Aditya, Hovakimyan, Naira, Theodorou, Evangelos A.
Conference Name2021 American Control Conference (ACC)
Keywordscompositionality, Dynamical Systems, linearity, multi-agent systems, optimal control, pubcrawl, Task Analysis
AbstractIn this paper, we discuss the methodology of generalizing the optimal control law from learned component tasks to unlearned composite tasks on Multi-Agent Systems (MASs), by using the linearity composition principle of linearly solvable optimal control (LSOC) problems. The proposed approach achieves both the compositionality and optimality of control actions simultaneously within the cooperative MAS framework in both discrete and continuous-time in a sample-efficient manner, which reduces the burden of re-computation of the optimal control solutions for the new task on the MASs. We investigate the application of the proposed approach on the MAS with coordination between agents. The experiments show feasible results in investigated scenarios, including both discrete and continuous dynamical systems for task generalization without resampling.
DOI10.23919/ACC50511.2021.9483210
Citation Keysong_compositionality_2021