How different augmented reality visualizations for drilling affect trajectory deviation, visual attention, and user experience.

Julian Wolf, Dietmar Luchmann, Quentin Lohmeyer, Mazda Farshad, Philipp Fürnstahl, Mirko Meboldt
Author Information
  1. Julian Wolf: PDZ, Department of Mechanical and Process Engineering, ETH Zurich, Zurich, Switzerland. wolfju@ethz.ch. ORCID
  2. Dietmar Luchmann: ROCS, Balgrist University Hospital, University of Zurich, Zurich, Switzerland.
  3. Quentin Lohmeyer: PDZ, Department of Mechanical and Process Engineering, ETH Zurich, Zurich, Switzerland. ORCID
  4. Mazda Farshad: Department of Orthopaedics, Balgrist University Hospital, Zurich, Switzerland. ORCID
  5. Philipp Fürnstahl: ROCS, Balgrist University Hospital, University of Zurich, Zurich, Switzerland. ORCID
  6. Mirko Meboldt: PDZ, Department of Mechanical and Process Engineering, ETH Zurich, Zurich, Switzerland. ORCID

Abstract

PURPOSE: Previous work has demonstrated the high accuracy of augmented reality (AR) head-mounted displays for pedicle screw placement in spinal fusion surgery. An important question that remains unanswered is how pedicle screw trajectories should be visualized in AR to best assist the surgeon.
METHODOLOGY: We compared five AR visualizations displaying the drill trajectory via Microsoft HoloLens 2 with different configurations of abstraction level (abstract or anatomical), position (overlay or small offset), and dimensionality (2D or 3D) against standard navigation on an external screen. We tested these visualizations in a study with 4 expert surgeons and 10 novices (residents in orthopedic surgery) on lumbar spine models covered by Plasticine. We assessed trajectory deviations ([Formula: see text]) from the preoperative plan, dwell times (%) on areas of interest, and the user experience.
RESULTS: Two AR visualizations resulted in significantly lower trajectory deviations (mixed-effects ANOVA, p<0.0001 and p<0.05) compared to standard navigation, whereas no significant differences were found between participant groups. The best ratings for ease of use and cognitive load were obtained with an abstract visualization displayed peripherally around the entry point and with a 3D anatomical visualization displayed with some offset. For visualizations displayed with some offset, participants spent on average only 20% of their time examining the entry point area.
CONCLUSION: Our results show that real-time feedback provided by navigation can level task performance between experts and novices, and that the design of a visualization has a significant impact on task performance, visual attention, and user experience. Both abstract and anatomical visualizations can be suitable for navigation when not directly occluding the execution area. Our results shed light on how AR visualizations guide visual attention and the benefits of anchoring information in the peripheral field around the entry point.

Keywords

References

  1. J Spine Surg. 2020 Dec;6(4):752-761 [PMID: 33447679]
  2. BMC Musculoskelet Disord. 2020 Feb 15;21(1):103 [PMID: 32061248]
  3. Int J Comput Assist Radiol Surg. 2019 Jul;14(7):1157-1165 [PMID: 30993519]
  4. Healthc Technol Lett. 2017 Sep 18;4(5):188-192 [PMID: 29184663]
  5. J Neurosurg Spine. 2014 Feb;20(2):196-203 [PMID: 24358998]
  6. Spine (Phila Pa 1976). 2007 Nov 15;32(24):2679-84 [PMID: 18007244]
  7. World Neurosurg. 2013 Jan;79(1):162-72 [PMID: 22469525]
  8. Int J Comput Assist Radiol Surg. 2017 Jan;12(1):69-76 [PMID: 27503119]
  9. Int J Med Robot. 2017 Sep;13(3): [PMID: 27569781]
  10. JMIR Mhealth Uhealth. 2019 Apr 26;7(4):e10967 [PMID: 31025950]
  11. Spine (Phila Pa 1976). 2019 Mar 1;44(5):369-376 [PMID: 30074971]
  12. Eur Spine J. 2010 Jan;19(1):91-5 [PMID: 19882179]
  13. N Am Spine Soc J. 2021 May 01;6:100065 [PMID: 35141630]
  14. Spine J. 2020 Apr;20(4):621-628 [PMID: 31669611]

MeSH Term

Humans
Augmented Reality
Surgery, Computer-Assisted
Lumbar Vertebrae
Pedicle Screws
Spinal Fusion

Word Cloud

Created with Highcharts 10.0.0visualizationsARnavigationtrajectoryrealityabstractanatomicaloffsetuserexperiencevisualizationdisplayedentrypointvisualattentionaugmentedpediclescrewsurgerybestcompareddifferentlevel3Dstandardnovicesdeviationsp<0significantloadaroundarearesultscantaskperformancePURPOSE:Previousworkdemonstratedhighaccuracyhead-mounteddisplaysplacementspinalfusionimportantquestionremainsunansweredtrajectoriesvisualizedassistsurgeonMETHODOLOGY:fivedisplayingdrillviaMicrosoftHoloLens2configurationsabstractionpositionoverlaysmalldimensionality2Dexternalscreentestedstudy4expertsurgeons10residentsorthopediclumbarspinemodelscoveredPlasticineassessed[Formula:seetext]preoperativeplandwelltimes%areasinterestRESULTS:Tworesultedsignificantlylowermixed-effectsANOVA000105whereasdifferencesfoundparticipantgroupsratingseaseusecognitiveobtainedperipherallyparticipantsspentaverage20%timeexaminingCONCLUSION:showreal-timefeedbackprovidedexpertsdesignimpactsuitabledirectlyoccludingexecutionshedlightguidebenefitsanchoringinformationperipheralfielddrillingaffectdeviationCognitiveEyetrackingMixedSurgicalUsability

Similar Articles

Cited By