Advanced Underwater Image Restoration in Complex Illumination Conditions

by   Yifan Song, et al.

Underwater image restoration has been a challenging problem for decades since the advent of underwater photography. Most solutions focus on shallow water scenarios, where the scene is uniformly illuminated by the sunlight. However, the vast majority of uncharted underwater terrain is located beyond 200 meters depth where natural light is scarce and artificial illumination is needed. In such cases, light sources co-moving with the camera, dynamically change the scene appearance, which make shallow water restoration methods inadequate. In particular for multi-light source systems (composed of dozens of LEDs nowadays), calibrating each light is time-consuming, error-prone and tedious, and we observe that only the integrated illumination within the viewing volume of the camera is critical, rather than the individual light sources. The key idea of this paper is therefore to exploit the appearance changes of objects or the seafloor, when traversing the viewing frustum of the camera. Through new constraints assuming Lambertian surfaces, corresponding image pixels constrain the light field in front of the camera, and for each voxel a signal factor and a backscatter value are stored in a volumetric grid that can be used for very efficient image restoration of camera-light platforms, which facilitates consistently texturing large 3D models and maps that would otherwise be dominated by lighting and medium artifacts. To validate the effectiveness of our approach, we conducted extensive experiments on simulated and real-world datasets. The results of these experiments demonstrate the robustness of our approach in restoring the true albedo of objects, while mitigating the influence of lighting and medium effects. Furthermore, we demonstrate our approach can be readily extended to other scenarios, including in-air imaging with artificial illumination or other similar cases.


Underwater 3D Reconstruction Using Light Fields

Underwater 3D reconstruction is challenging due to the refraction of lig...

Robustly Removing Deep Sea Lighting Effects for Visual Mapping of Abyssal Plains

The majority of Earth's surface lies deep in the oceans, where no surfac...

The Next Best Underwater View

To image in high resolution large and occlusion-prone scenes, a camera m...

Underwater image filtering: methods, datasets and evaluation

Underwater images are degraded by the selective attenuation of light tha...

Beyond NeRF Underwater: Learning Neural Reflectance Fields for True Color Correction of Marine Imagery

Underwater imagery often exhibits distorted coloration as a result of li...

SeaThru-NeRF: Neural Radiance Fields in Scattering Media

Research on neural radiance fields (NeRFs) for novel view generation is ...

Weakly Supervised Caveline Detection For AUV Navigation Inside Underwater Caves

Underwater caves are challenging environments that are crucial for water...

Please sign up or login with your details

Forgot password? Click here to reset