Computational Optics for Mobile Terminals in Mass Production

by   Shiqi Chen, et al.
Zhejiang University

Correcting the optical aberrations and the manufacturing deviations of cameras is a challenging task. Due to the limitation on volume and the demand for mass production, existing mobile terminals cannot rectify optical degradation. In this work, we systematically construct the perturbed lens system model to illustrate the relationship between the deviated system parameters and the spatial frequency response measured from photographs. To further address this issue, an optimization framework is proposed based on this model to build proxy cameras from the machining samples' SFRs. Engaging with the proxy cameras, we synthetic data pairs, which encode the optical aberrations and the random manufacturing biases, for training the learning-based algorithms. In correcting aberration, although promising results have been shown recently with convolutional neural networks, they are hard to generalize to stochastic machining biases. Therefore, we propose a dilated Omni-dimensional dynamic convolution and implement it in post-processing to account for the manufacturing degradation. Extensive experiments which evaluate multiple samples of two representative devices demonstrate that the proposed optimization framework accurately constructs the proxy camera. And the dynamic processing model is well-adapted to manufacturing deviations of different cameras, realizing perfect computational photography. The evaluation shows that the proposed method bridges the gap between optical design, system machining, and post-processing pipeline, shedding light on the joint of image signal reception (lens and sensor) and image signal processing.


page 2

page 4

page 8

page 9

page 10

page 11

page 12

page 13


Revealing the preference for correcting separated aberrations in joint optic-image design

The joint design of the optical system and the downstream algorithm is a...

Optical Aberration Correction in Postprocessing using Imaging Simulation

As the popularity of mobile photography continues to grow, considerable ...

Neural Invertible Variable-degree Optical Aberrations Correction

Optical aberrations of optical systems cause significant degradation of ...

Optimal design of photonic nanojets under uncertainty

Photonic nanojets (PNJs) have promising applications as optical probes i...

Mobile Image Restoration via Prior Quantization

In digital images, the performance of optical aberration is a multivaria...

Learning rich optical embeddings for privacy-preserving lensless image classification

By replacing the lens with a thin optical element, lensless imaging enab...

Thin On-Sensor Nanophotonic Array Cameras

Today's commodity camera systems rely on compound optics to map light or...

Please sign up or login with your details

Forgot password? Click here to reset