Fast 5DOF Needle Tracking in iOCT

by   Jakob Weiss, et al.

Purpose. Intraoperative Optical Coherence Tomography (iOCT) is an increasingly available imaging technique for ophthalmic microsurgery that provides high-resolution cross-sectional information of the surgical scene. We propose to build on its desirable qualities and present a method for tracking the orientation and location of a surgical needle. Thereby, we enable direct analysis of instrument-tissue interaction directly in OCT space without complex multimodal calibration that would be required with traditional instrument tracking methods. Method. The intersection of the needle with the iOCT scan is detected by a peculiar multi-step ellipse fitting that takes advantage of the directionality of the modality. The geometric modelling allows us to use the ellipse parameters and provide them into a latency aware estimator to infer the 5DOF pose during needle movement. Results. Experiments on phantom data and ex-vivo porcine eyes indicate that the algorithm retains angular precision especially during lateral needle movement and provides a more robust and consistent estimation than baseline methods. Conclusion. Using solely crosssectional iOCT information, we are able to successfully and robustly estimate a 5DOF pose of the instrument in less than 5.5 ms on a CPU.


page 3

page 5

page 11

page 12


i3PosNet: Instrument Pose Estimation from X-Ray

Performing delicate Minimally Invasive Surgeries (MIS) forces surgeons t...

Self-Supervised Surgical Instrument 3D Reconstruction from a Single Camera Image

Surgical instrument tracking is an active research area that can provide...

Concurrent Segmentation and Localization for Tracking of Surgical Instruments

Real-time instrument tracking is a crucial requirement for various compu...

MBAPose: Mask and Bounding-Box Aware Pose Estimation of Surgical Instruments with Photorealistic Domain Randomization

Surgical robots are controlled using a priori models based on robots' ge...

HMD-EgoPose: Head-Mounted Display-Based Egocentric Marker-Less Tool and Hand Pose Estimation for Augmented Surgical Guidance

The success or failure of modern computer-assisted surgery procedures hi...

Learning How To Robustly Estimate Camera Pose in Endoscopic Videos

Purpose: Surgical scene understanding plays a critical role in the techn...

Effect of Timing Error: A Case Study of Navigation Camera

We focus on the problem of timing errors in navigation camera as a case ...

Please sign up or login with your details

Forgot password? Click here to reset