Novel evaluation of surgical activity recognition models using task-based efficiency metrics

07/03/2019
by   Aneeq Zia, et al.
1

Purpose: Surgical task-based metrics (rather than entire procedure metrics) can be used to improve surgeon training and, ultimately, patient care through focused training interventions. Machine learning models to automatically recognize individual tasks or activities are needed to overcome the otherwise manual effort of video review. Traditionally, these models have been evaluated using frame-level accuracy. Here, we propose evaluating surgical activity recognition models by their effect on task-based efficiency metrics. In this way, we can determine when models have achieved adequate performance for providing surgeon feedback via metrics from individual tasks. Methods: We propose a new CNN-LSTM model, RP-Net-V2, to recognize the 12 steps of robotic-assisted radical prostatectomies (RARP). We evaluated our model both in terms of conventional methods (e.g. Jaccard Index, task boundary accuracy) as well as novel ways, such as the accuracy of efficiency metrics computed from instrument movements and system events. Results: Our proposed model achieves a Jaccard Index of 0.85 thereby outperforming previous models on robotic-assisted radical prostatectomies. Additionally, we show that metrics computed from tasks automatically identified using RP-Net-V2 correlate well with metrics from tasks labeled by clinical experts. Conclusions: We demonstrate that metrics-based evaluation of surgical activity recognition models is a viable approach to determine when models can be used to quantify surgical efficiencies. We believe this approach and our results illustrate the potential for fully automated, post-operative efficiency reports.

READ FULL TEXT

page 3

page 5

page 7

page 8

research
06/01/2018

Surgical Activity Recognition in Robot-Assisted Radical Prostatectomy using Deep Learning

Adverse surgical outcomes are costly to patients and hospitals. Approach...
research
07/07/2022

Adaptation of Surgical Activity Recognition Models Across Operating Rooms

Automatic surgical activity recognition enables more intelligent surgica...
research
03/09/2022

Using Human Gaze For Surgical Activity Recognition

Automatically recognizing surgical activities plays an important role in...
research
02/24/2021

Multi-Task Temporal Convolutional Networks for Joint Recognition of Surgical Phases and Steps in Gastric Bypass Procedures

Purpose: Automatic segmentation and classification of surgical activity ...
research
11/15/2017

Analyzing Before Solving: Which Parameters Influence Low-Level Surgical Activity Recognition

Automatic low-level surgical activity recognition is today well-known te...
research
05/06/2022

Quantification of Robotic Surgeries with Vision-Based Deep Learning

Surgery is a high-stakes domain where surgeons must navigate critical an...
research
07/20/2019

Automated Surgical Activity Recognition with One Labeled Sequence

Prior work has demonstrated the feasibility of automated activity recogn...

Please sign up or login with your details

Forgot password? Click here to reset