Real-Time Refocusing using an FPGA-based Standard Plenoptic Camera

by   Christopher Hahne, et al.

Plenoptic cameras are receiving increasing attention in scientific and commercial applications because they capture the entire structure of light in a scene, enabling optical transforms (such as focusing) to be applied computationally after the fact, rather than once and for all at the time a picture is taken. In many settings, real-time interactive performance is also desired, which in turn requires significant computational power due to the large amount of data required to represent a plenoptic image. Although GPUs have been shown to provide acceptable performance for real-time plenoptic rendering, their cost and power requirements make them prohibitive for embedded uses (such as in-camera). On the other hand, the computation to accomplish plenoptic rendering is well-structured, suggesting the use of specialized hardware. Accordingly, this paper presents an array of switch-driven Finite Impulse Response (FIR) filters, implemented with FPGA to accomplish high-throughput spatial-domain rendering. The proposed architecture provides a power-efficient rendering hardware design suitable for full-video applications as required in broadcasting or cinematography. A benchmark assessment of the proposed hardware implementation shows that real-time performance can readily be achieved, with a one order of magnitude performance improvement over a GPU implementation and three orders of magnitude performance improvement over a general-purpose CPU implementation.


page 1

page 5

page 6

page 7

page 8

page 10


Real Time Implementation of Spatial Filtering On FPGA

Field Programmable Gate Array (FPGA) technology has gained vital importa...

Automatic Generation of Application-Specific FPGA Overlays with RapidWright

Overlay architectures implemented on FPGA devices have been proposed as ...

ICARUS: A Specialized Architecture for Neural Radiance Field Rendering

The practical deployment of Neural Radiance Field (NeRF) in rendering ap...

Hardware Acceleration of Neural Graphics

Rendering and inverse-rendering algorithms that drive conventional compu...

Efficient Computation of Map-scale Continuous Mutual Information on Chip in Real Time

Exploration tasks are essential to many emerging robotics applications, ...

LumiPath - Towards Real-time Physically-based Rendering on Embedded Devices

As the computational power of toady's devices increases, real-time physi...

Hardware Implementation of Adaptive Watermarking Based on Local Spatial Disorder Analysis

With the increasing use of the internet and the ease of exchange of mult...

Please sign up or login with your details

Forgot password? Click here to reset