Kernel Foveated Rendering
Xiaoxu Meng, Ruofei Du, Matthias Zwicker, and Amitabh Varshney
In: Proceedings of the ACM on Computer Graphics and Interactive Techniques (May 2018), 1:1(5:1-5:20)
Abstract
Foveated rendering coupled with eye-tracking has the potential to dramatically accelerate interactive 3D graphics with minimal loss of perceptual detail. In this paper, we parameterize foveated rendering by embedding polynomial kernel functions in the classic log-polar mapping. Our GPU-driven technique uses closed-form, parameterized foveation that mimics the distribution of photoreceptors in the human retina. We present a simple two-pass kernel foveated rendering (KFR) pipeline that maps well onto modern GPUs. In the first pass, we compute the kernel log-polar transformation and render to a reduced-resolution buffer. In the second pass, we carry out the inverse-log-polar transformation withanti-aliasing to map the reduced-resolution rendering to the full resolution screen. We have carried out pilot and formal user studies to empirically identify the KFR parameters. We observe a 2.8X - 3.2X speedup in rendering on 4K UHD (2160p) displays with minimal perceptual loss of detail. The relevance of eye-tracking-guided kernel foveated rendering can only increase as the anticipated rise of display resolution makes it ever more difficult to resolve the mutually conflicting goals of interactive rendering and perceptual realism.
Images
original ray-marching scene
10 FPS
original 3D geometries
31 FPS
foveated ray-marching scene (σ = 1.8, α = 4)
30 FPS
foveated 3D geometries (σ = 1.8, α = 4)
67 FPS
Shadertoy Demo
https://www.shadertoy.com/view/lsdfWn
BibTeX
@article{Meng2018Kernel,
title = "Kernel Foveated Rendering",
author = {Xiaoxu Meng and Ruofei Du and Matthias Zwicker and Amitabh Varshney},
journal = {Proceedings of the ACM on Computer Graphics and Interactive Techniques (I3D)},
year = {2018},
month = {May},
day = {15 - 18},
volume = {1},
number = {5},
location = {Montreal, Quebec, Canada},
publisher = {ACM},
series = {I3D},
keywords = {foveated rendering, perception, log-polar mapping, eye-tracking, virtual reality, head-mounted displays},
doi = {10.1145/3203199},
pages = {1--20}
}