CPS: Medium: Hybrid Systems for Modeling and Teaching the Language of Surgery

Abstract: The objective of this research is to develop new principles for creating and comparing models of skilled human activities, and to apply those models to systems for teaching, training and assistance of humans performing these activities. The models investigated will include both hybrid systems and language-based models. The research will focus on modeling surgical manipulations during robotic minimally invasive surgery. Models for expert performance of surgical tasks will be derived from recorded motion and video data. Student data will be compared with these expert models, and both physical guidance and information display methods will be developed to provide feedback to the student based on the expert model. The intellectual merit of this work lies in the development of a new set of mathematical tools for modeling human skilled activity. These tools will provide new insights into the relationship between skill, style, and content in human motion. Additional intellectual merit lies in the connection of hybrid systems modeling to language models, the creation of techniques for automated training, and in the assessment of new training methods. The broader impact of this research will be the creation of automated methods for modeling and teaching skilled human motion. These methods will have enormous implications for the training and re-training of the US workforce. This project will also impact many diversity and outreach activities, including REU programs and summer camps for K-12 outreach. The senior personnel of this project also participate in the Robotic Systems Challenge and the Women in Science and Engineering program.