Pattern-Based Behavioural Analysis on Neurosurgical Simulation Data

Scott Buffett, Catherine Pagiatakis, Di Jiang
Proceedings of the 3rd Machine Learning for Healthcare Conference, PMLR 85:514-533, 2018.

Abstract

This paper presents the results of an analytics-based study to determine key differences in junior resident level and expert level surgical skill when engaging with a neurosurgical simulator. Window-based time series discretization and sequential pattern analysis were used on positional data to identify frequent movement patterns and instrumentation techniques associated with each skill class. Cross-validation confirmed that a Bayesian classification model constructed using these patterns can be used to predict skill level with a high degree of confidence and accuracy on a small sample of neurosurgeons who engaged with the simulator. An analysis of movement speed also revealed that the junior residents exhibited a high degree of very slow and very fast movements, whereas the expert surgeons displayed a significantly more consistent technique of moderate-speed movements. Finally, the analysis was integrated within a cloud-based learning framework, helping to provide beneficial feedback on movement proficiency to resident surgeons in training. The presented work makes two key contributions to the field of machine learning in the medical field: the study 1) employs a low-level behaviour-based analysis of surgical technique, as opposed to high-level summary metrics such as blood loss and average force, and 2) avoids the use of expert information on neurosurgical skill within the AI engine, and thus employs an analysis that is entirely uninformed.

Cite this Paper

BibTeX
@InProceedings{pmlr-v85-buffett18a, title = {Pattern-Based Behavioural Analysis on Neurosurgical Simulation Data}, author = {Buffett, Scott and Pagiatakis, Catherine and Jiang, Di}, booktitle = {Proceedings of the 3rd Machine Learning for Healthcare Conference}, pages = {514--533}, year = {2018}, editor = {Doshi-Velez, Finale and Fackler, Jim and Jung, Ken and Kale, David and Ranganath, Rajesh and Wallace, Byron and Wiens, Jenna}, volume = {85}, series = {Proceedings of Machine Learning Research}, month = {17--18 Aug}, publisher = {PMLR}, pdf = {http://proceedings.mlr.press/v85/buffett18a/buffett18a.pdf}, url = {https://proceedings.mlr.press/v85/buffett18a.html}, abstract = {This paper presents the results of an analytics-based study to determine key differences in junior resident level and expert level surgical skill when engaging with a neurosurgical simulator. Window-based time series discretization and sequential pattern analysis were used on positional data to identify frequent movement patterns and instrumentation techniques associated with each skill class. Cross-validation confirmed that a Bayesian classification model constructed using these patterns can be used to predict skill level with a high degree of confidence and accuracy on a small sample of neurosurgeons who engaged with the simulator. An analysis of movement speed also revealed that the junior residents exhibited a high degree of very slow and very fast movements, whereas the expert surgeons displayed a significantly more consistent technique of moderate-speed movements. Finally, the analysis was integrated within a cloud-based learning framework, helping to provide beneficial feedback on movement proficiency to resident surgeons in training. The presented work makes two key contributions to the field of machine learning in the medical field: the study 1) employs a low-level behaviour-based analysis of surgical technique, as opposed to high-level summary metrics such as blood loss and average force, and 2) avoids the use of expert information on neurosurgical skill within the AI engine, and thus employs an analysis that is entirely uninformed.} }
Endnote
%0 Conference Paper %T Pattern-Based Behavioural Analysis on Neurosurgical Simulation Data %A Scott Buffett %A Catherine Pagiatakis %A Di Jiang %B Proceedings of the 3rd Machine Learning for Healthcare Conference %C Proceedings of Machine Learning Research %D 2018 %E Finale Doshi-Velez %E Jim Fackler %E Ken Jung %E David Kale %E Rajesh Ranganath %E Byron Wallace %E Jenna Wiens %F pmlr-v85-buffett18a %I PMLR %P 514--533 %U https://proceedings.mlr.press/v85/buffett18a.html %V 85 %X This paper presents the results of an analytics-based study to determine key differences in junior resident level and expert level surgical skill when engaging with a neurosurgical simulator. Window-based time series discretization and sequential pattern analysis were used on positional data to identify frequent movement patterns and instrumentation techniques associated with each skill class. Cross-validation confirmed that a Bayesian classification model constructed using these patterns can be used to predict skill level with a high degree of confidence and accuracy on a small sample of neurosurgeons who engaged with the simulator. An analysis of movement speed also revealed that the junior residents exhibited a high degree of very slow and very fast movements, whereas the expert surgeons displayed a significantly more consistent technique of moderate-speed movements. Finally, the analysis was integrated within a cloud-based learning framework, helping to provide beneficial feedback on movement proficiency to resident surgeons in training. The presented work makes two key contributions to the field of machine learning in the medical field: the study 1) employs a low-level behaviour-based analysis of surgical technique, as opposed to high-level summary metrics such as blood loss and average force, and 2) avoids the use of expert information on neurosurgical skill within the AI engine, and thus employs an analysis that is entirely uninformed.
APA
Buffett, S., Pagiatakis, C. & Jiang, D.. (2018). Pattern-Based Behavioural Analysis on Neurosurgical Simulation Data. Proceedings of the 3rd Machine Learning for Healthcare Conference, in Proceedings of Machine Learning Research 85:514-533 Available from https://proceedings.mlr.press/v85/buffett18a.html.

Related Material