Детайли за публикацията
(Publication details)

Autors: Manolova, A. H.
Title: System for touchless interaction with medical images in surgery using Leap Motion
Keywords: touchless interaction, Leap Motion controller, gesture recognition

Abstract: In the operating room surgeons need to have access to pre- and intra-operative images such as computer tomography (CT), magnetic resonance imagery (MRI), x-ray images and fluoroscopy along with various procedure-specific imaging applications. This visual data supports diagnostics and planning and provide virtual “insight” into the body of the patient during surgery. Although surgeons rely on capture, browsing and manipulation of these images they are constrained by typical interaction mechanisms such as keyboard and mouse. At the heart of this constraint is the need to maintain a strict boundary between the sterile and non sterile environment. In this paper we present a new system based on combining the Leap Motion gesture recognition controller and medical imaging toolkit for touchless visualization and browsing for medical image data.


  1. H. M. Mentis, K. O'Hara, A. Sellen, R. Trivedi, 2012, Interaction Proxemics and Image Use in Neurosurgery, SIGCHI Conference on Human Factors in Computing Systems, Volume 1, pp. pp. 927-936
  2. K. O'Hara, G. Gonzalez, A. Sellen, G. Penney, A. Varnavas, H. Mentis, A. Criminisi, R. Corish, M. Rouncefield, N. Dastur, T. Carrell, 2014, Touchless Interaction in Surgery, Communications of the ACM, Volume 57(1), pp. pp. 70-77
  3. R. Johnson, K. O'Hara, A. Sellen, C. Cousins, A. Criminisi, 2011, Exploring the potential for touchless interaction in image-guided interventional radiology, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Volume , pp.
  4. J. Wachs, H. Stern, Y. Edan, M. Gillam, C. Feied, M. Smith, J. Handler, 2008, Real-time hand-gesture interface for browsing medical images, International Journal of Intelligent Computing in Medical Sciences & Image Processing, Volume 2, pp. pp. 15–25
  5. L. Ebert, G. Hatch, G. Ampanozi, M. Thali, S. Ross, 2013, Invisible touch: Control of a DICOM viewer with finger gestures using the Kinect depth camera, Journal of Forensic Radiology and Imaging, Volume 1, pp. pp. 10–14
  6. C. MacGregor, 2012, Kinect imaging lets surgeons keep their focus, New Scientist, Magazine, Volume 2865, pp.

9th International Conference on Communications, Electromagnetics and Medical Applications, vol. 1, pp. 113-116, 2014, Bulgaria, ISSN 1314-2100

Full text of the publication

Вид: пленарен доклад в международен форум

Въведена от: доц. д-р Агата Христова Манолова