AR for IGT

Team: Philips Design + Research
Role: Interaction Design Lead
Design Process: Presentation here

Project Background:

Image Guided Therapy provides surgeons with the ability to perform minimally invasive surgeries through the use of data rich images derived from x-ray, fluoroscopy and ultrasound imaging techniques. During this type of surgery, operations are performed by passing catheters through a patient’s vasculature to target specific sites, as opposed to traditional surgery where large incisions are made and organs are exposed. As these surgeries rely primarily on images, providing access to this information in the most efficient way is critical.

The current method for delivering these images is on physical screens placed within the operating room. Using physical screens poses a number of issues including lack of sterility, need for ergonomic placement in densely populated rooms, and requiring surgeons to give verbal instructions to staff members to maneuver the screens for more visibility and the appropriate views.

By using the Microsoft HoloLens, we have developed an application that puts surgeons in the drivers seat, giving them access and control of the information they need, when the need it.

Leading the interaction design for this project, we have carried out in-depth research into IGT surgeries to understand accessibility needs and behaviors, developing solutions for system-wide voice control, gestures and direct touch interactions. The outcome being the development of a surgeon-led ‘cockpit’ with intuitive, affordance guided interactions that a surgeon can use effectively during clinical cases.