Joint Optical Neuroimaging Denoising with Semantic Tasks

by   Tianfang Zhu, et al.

Optical neuroimaging is a vital tool for understanding the brain structure and the connection between regions and nuclei. However, the image noise introduced in the sample preparation and the imaging system hinders the extraction of the possible knowlege from the dataset, thus denoising for the optical neuroimaging is usually necessary. The supervised denoisng methods often outperform the unsupervised ones, but the training of the supervised denoising models needs the corresponding clean labels, which is not always avaiable due to the high labeling cost. On the other hand, those semantic labels, such as the located soma positions, the reconstructed neuronal fibers, and the nuclei segmentation result, are generally available and accumulated from everyday neuroscience research. This work connects a supervised denoising and a semantic segmentation model together to form a end-to-end model, which can make use of the semantic labels while still provides a denoised image as an intermediate product. We use both the supervised and the self-supervised models for the denoising and introduce a new cost term for the joint denoising and the segmentation setup. We test the proposed approach on both the synthetic data and the real-world data, including the optical neuroimaing dataset and the electron microscope dataset. The result shows that the joint denoising result outperforms the one using the denoising method alone and the joint model benefits the segmentation and other downstream task as well.


page 10

page 11

page 12

page 13


Single-Image based unsupervised joint segmentation and denoising

In this work, we develop an unsupervised method for the joint segmentati...

RADU: Ray-Aligned Depth Update Convolutions for ToF Data Denoising

Time-of-Flight (ToF) cameras are subject to high levels of noise and dis...

A First Derivative Potts Model for Segmentation and Denoising Using MILP

Unsupervised image segmentation and denoising are two fundamental tasks ...

One-Pot Multi-Frame Denoising

The performance of learning-based denoising largely depends on clean sup...

DenoiSeg: Joint Denoising and Segmentation

Microscopy image analysis often requires the segmentation of objects, bu...

Self-supervised Denoising via Diffeomorphic Template Estimation: Application to Optical Coherence Tomography

Optical Coherence Tomography (OCT) is pervasive in both the research and...

Deep Semantic Statistics Matching (D2SM) Denoising Network

The ultimate aim of image restoration like denoising is to find an exact...

Please sign up or login with your details

Forgot password? Click here to reset