Deep Selection: A Fully Supervised Camera Selection Network for Surgery Recordings

03/28/2023
by   Ryo Hachiuma, et al.
0

Recording surgery in operating rooms is an essential task for education and evaluation of medical treatment. However, recording the desired targets, such as the surgery field, surgical tools, or doctor's hands, is difficult because the targets are heavily occluded during surgery. We use a recording system in which multiple cameras are embedded in the surgical lamp, and we assume that at least one camera is recording the target without occlusion at any given time. As the embedded cameras obtain multiple video sequences, we address the task of selecting the camera with the best view of the surgery. Unlike the conventional method, which selects the camera based on the area size of the surgery field, we propose a deep neural network that predicts the camera selection probability from multiple video sequences by learning the supervision of the expert annotation. We created a dataset in which six different types of plastic surgery are recorded, and we provided the annotation of camera switching. Our experiments show that our approach successfully switched between cameras and outperformed three baseline methods.

READ FULL TEXT
research
12/04/2020

Orientation Matters: 6-DoF Autonomous Camera Movement for Minimally Invasive Surgery

We propose a new method for six-degree-of-freedom (6-DoF) autonomous cam...
research
05/01/2020

Multi-Camera Trajectory Forecasting: Pedestrian Trajectory Prediction in a Network of Cameras

We introduce the task of multi-camera trajectory forecasting (MCTF), whe...
research
10/09/2020

A Reactive Autonomous Camera System for the RAVEN II Surgical Robot

The endoscopic camera of a surgical robot provides surgeons with a magni...
research
04/03/2019

Automatic alignment of surgical videos using kinematic data

Over the past one hundred years, the classic teaching methodology of "se...
research
07/26/2023

DisguisOR: Holistic Face Anonymization for the Operating Room

Purpose: Recent advances in Surgical Data Science (SDS) have contributed...
research
01/09/2019

Do You See What I See? Detecting Hidden Streaming Cameras Through Similarity of Simultaneous Observation

Small, low-cost, wireless cameras are becoming increasingly commonplace ...
research
11/11/2021

Open surgery tool classification and hand utilization using a multi-camera system

Purpose: The goal of this work is to use multi-camera video to classify ...

Please sign up or login with your details

Forgot password? Click here to reset