Sensing, Perception, Intelligence & Action in High Intensity, Dynamic Surgical Environments

Over the past decade, the rapid advancements in machine learning have revolutionized various fields, significantly impacting our lives. In this talk, we will delve into the realm of medical applications and explore the challenges and opportunities associated with integrating these cutting-edge technologies into computer-assisted interventions. Our primary focus will be on fostering acceptance and trust in machine learning and robotic solutions within the medical domain,which often necessitates the path through Intelligence Amplification(IA). Augmented Reality allows us to leverage IA to augment human intelligence and expertise, ultimately paving the way for the seamless integration of Artificial Intelligence (AI) and robotics into clinical solutions.

Drawing from some groundbreaking research conducted at the Chair of Computer-Aided Medical Procedures at both TU Munich and Johns Hopkins Universities, I will present a series of novel techniques developed to address the unique demands of medical applications. Specifically, we will explore their practical implementations in diverse areas, including Robotic Ultrasound Imaging, Multimodal Data Analysis, and Semantic Scene Graphs for Holistic Modeling of Surgical Domain. Furthermore, I will showcase compelling examples of how Augmented Reality solutions can serve as catalysts for embracing AI in computer-assisted surgery. In this talk, I will navigate at the intersection of machine learning, computer vision, intelligent user interfaces, and medical robotics to travel along the path from intelligence amplification to artificial intelligence in computer assisted interventions.