Autors: Manolova, A. H.
Title: System for touchless interaction with medical images in surgery using Leap Motion
Keywords: touchless interaction, Leap Motion controller, gesture recog

Abstract: In the operating room surgeons need to have access to pre- and intra-operative images such as computer tomography (CT), magnetic resonance imagery (MRI), x-ray images and fluoroscopy along with various procedure-specific imaging applications. This visual data supports diagnostics and planning and provide virtual “insight” into the body of the patient during surgery. Although surgeons rely on capture, browsing and manipulation of these images they are constrained by typical interaction mechanisms such as keyboard and mouse. At the heart of this constraint is the need to maintain a strict boundary between the sterile and non sterile environment. In this paper we present a new system based on combining the Leap Motion gesture recognition controller and medical imaging toolkit for touchless visualization and browsing for medical image data.


  1. H. M. Mentis, K. O'Hara, A. Sellen, R. Trivedi, 2012, Interaction Proxemics and Image Use in Neurosurgery, SIGCHI Conference on Human Factors in Computing Systems, Volume 1, pp. pp. 927-936
  2. K. O'Hara, G. Gonzalez, A. Sellen, G. Penney, A. Varnavas, H. Mentis, A. Criminisi, R. Corish, M. Rouncefield, N. Dastur, T. Carrell, 2014, Touchless Interaction in Surgery, Communications of the ACM, Volume 57(1), pp. pp. 70-77
  3. R. Johnson, K. O'Hara, A. Sellen, C. Cousins, A. Criminisi, 2011, Exploring the potential for touchless interaction in image-guided interventional radiology, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Volume , pp.
  4. J. Wachs, H. Stern, Y. Edan, M. Gillam, C. Feied, M. Smith, J. Handler, 2008, Real-time hand-gesture interface for browsing medical images, International Journal of Intelligent Computing in Medical Sciences & Image Processing, Volume 2, pp. pp. 15–25
  5. L. Ebert, G. Hatch, G. Ampanozi, M. Thali, S. Ross, 2013, Invisible touch: Control of a DICOM viewer with finger gestures using the Kinect depth camera, Journal of Forensic Radiology and Imaging, Volume 1, pp. pp. 10–14
  6. C. MacGregor, 2012, Kinect imaging lets surgeons keep their focus, New Scientist, Magazine, Volume 2865, pp.


9th International Conference on Communications, Electromagnetics and Medical Applications, vol. 1, pp. 113-116, 2014, Bulgaria, ISSN 1314-2100

Full text of the publication

Цитирания (Citation/s):
1. Reinschluessel, A. V., Teuber, J., Herrlich, M., Bissel, J., van Eikeren, M., Ganser, J., ... & Malaka, R. (2017, May). Virtual reality for user-centered design and evaluation of touch-free interaction techniques for navigating medical images in the operating room. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (pp. 2001-2009). - 2017 - в издания, индексирани в Scopus или Web of Science
2. Iqbal, M. Z., & Campbell, A. (2020). The emerging need for touchless interaction technologies. Interactions, 27(4), 51-52. - 2020 - в издания, индексирани в Scopus или Web of Science
3. Korayem, M. H., Madihi, M. A., & Vahidifar, V. (2021). Controlling surgical robot arm using leap motion controller with Kalman filter. Measurement, 178, 109372. - 2021 - в издания, индексирани в Scopus или Web of Science
4. Pearson, J., Bailey, G., Robinson, S., Jones, M., Owen, T., Zhang, C., ... & Raju, D. K. (2022, April). Can’t Touch This: Rethinking Public Technology in a COVID-19 Era. In CHI Conference on Human Factors in Computing Systems (pp. 1-14). - 2022 - в издания, индексирани в Scopus или Web of Science
5. Bautista Rojas, LE, Castillo, I., Espinel, H., Fonseca, J., & Rodriguez, S. (2021, November). Digital Hand Tracking. Non-contact interaction for the manipulation of diagnostic images in the operating room. In X Latin American Conference on Human Computer Interaction (pp. 1-4). - 2021 - в издания, индексирани в Scopus или Web of Science

Вид: пленарен доклад в международен форум