Feasibility of using a low-cost head-mounted augmented reality device in the operating room.

Pieter L Kubben, Remir S N Sinlae
Author Information
  1. Pieter L Kubben: Department of Neurosurgery, Maastricht University Medical Center, Maastricht, The Netherlands.
  2. Remir S N Sinlae: Faculty of Health, Medicine and Life Sciences, Maastricht University, Maastricht, The Netherlands.

Abstract

BACKGROUND: Augmented reality (AR) has great potential for improving image-guided neurosurgical procedures, but until recently, hardware was mostly custom-made and difficult to distribute. Currently, commercially available low-cost AR devices offer great potential for neurosurgery, but reports on technical feasibility are lacking. The goal of this pilot study is to evaluate the feasibility of using a low-cost commercially available head-mounted holographic AR device (the Microsoft Hololens) in the operating room. The Hololens is operated by performing specific hand gestures, which are recognized by the built-in camera of the device. This would allow the neurosurgeon to control the device "touch free" even while wearing a sterile surgical outfit.
METHODS: The Hololens was tested in an operating room under two lighting conditions (general background theatre lighting only; and general background theatre lighting and operating lights) and wearing different surgical gloves (both bright and dark). All required hand gestures were performed, and voice recognition was evaluated against background noise consisting of two nurses talking at conversational speech level.
RESULTS: Wearing comfort was sufficient, with and without regular glasses. All gestures were correctly classified regardless of lighting conditions or the sort of sterile gloves. voice recognition was good. The visibility of the holograms was good if the device was configured to use high brightness for display.
CONCLUSIONS: We demonstrate that using a commercially available low-cost head-mounted holographic AR device is feasible in a sterile surgical setting, under different lighting conditions and using different surgical gloves. Given the availability of freely available software for application development, neurosurgery can benefit from new opportunities for image-guided surgery.

Keywords

References

  1. Comput Aided Surg. 1998;3(5):239-47 [PMID: 10207648]
  2. Neurosurgery. 2003 Mar;52(3):489-97; discussion 496-7 [PMID: 12590672]
  3. J Neurosurg. 2008 Feb;108(2):382-94 [PMID: 18240940]
  4. Neurosurgery. 2011 Mar;68(1 Suppl Operative):200-7; discussion 207 [PMID: 21304333]
  5. Neurosurgery. 2013 Jan;72 Suppl 1:107-14 [PMID: 23254798]
  6. Neurosurgery. 2013 Jan;72 Suppl 1:154-64 [PMID: 23254804]
  7. Acta Neurochir (Wien). 2013 May;155(5):943-7 [PMID: 23494133]
  8. Childs Nerv Syst. 2013 Aug;29(8):1235-44 [PMID: 23702736]
  9. J Neurosurg. 2015 Jul;123(1):206-11 [PMID: 25748303]
  10. Neurosurg Rev. 2017 Oct;40(4):537-548 [PMID: 27154018]
  11. J Clin Neurosci. 2017 Jan;35:1-4 [PMID: 28137372]

Word Cloud

Created with Highcharts 10.0.0devicelightingrealityARavailablelow-costusingoperatingsurgicalcommerciallyhead-mountedHololensroomgesturessterileconditionsbackgrounddifferentglovesAugmentedgreatpotentialimage-guidedneurosurgeryfeasibilityholographichandwearingtwogeneraltheatrerecognitiongoodBACKGROUND:improvingneurosurgicalproceduresrecentlyhardwaremostlycustom-madedifficultdistributeCurrentlydevicesofferreportstechnicallackinggoalpilotstudyevaluateMicrosoftoperatedperformingspecificrecognizedbuilt-incameraallowneurosurgeoncontrol"touchfree"evenoutfitMETHODS:testedlightsbrightdarkrequiredperformedvoiceevaluatednoiseconsistingnursestalkingconversationalspeechlevelRESULTS:WearingcomfortsufficientwithoutregularglassescorrectlyclassifiedregardlesssortVoicevisibilityhologramsconfiguredusehighbrightnessdisplayCONCLUSIONS:demonstratefeasiblesettingGivenavailabilityfreelysoftwareapplicationdevelopmentcanbenefitnewopportunitiessurgeryFeasibilityaugmentedmobilehealthneuronavigationsimulationvirtual

Similar Articles

Cited By (14)