Kernel Foveated Rendering

Xiaoxu Meng, Ruofei Du, Matthias Zwicker, and Amitabh Varshney

In: Proceedings of the ACM on Computer Graphics and Interactive Techniques (May 2018), 1:1(5:1-5:20)


Foveated rendering coupled with eye-tracking has the potential to dramatically accelerate interactive 3D graphics with minimal loss of perceptual detail. In this paper, we parameterize foveated rendering by embedding polynomial kernel functions in the classic log-polar mapping. Our GPU-driven technique uses closed-form, parameterized foveation that mimics the distribution of photoreceptors in the human retina. We present a simple two-pass kernel foveated rendering (KFR) pipeline that maps well onto modern GPUs. In the first pass, we compute the kernel log-polar transformation and render to a reduced-resolution buffer. In the second pass, we carry out the inverse-log-polar transformation withanti-aliasing to map the reduced-resolution rendering to the full resolution screen. We have carried out pilot and formal user studies to empirically identify the KFR parameters. We observe a 2.8X - 3.2X speedup in rendering on 4K UHD (2160p) displays with minimal perceptual loss of detail. The relevance of eye-tracking-guided kernel foveated rendering can only increase as the anticipated rise of display resolution makes it ever more difficult to resolve the mutually conflicting goals of interactive rendering and perceptual realism.


original ray-marching scene

10 FPS

original 3D geometries

31 FPS

foveated ray-marching scene (σ = 1.8, α = 4)

30 FPS

foveated 3D geometries (σ = 1.8, α = 4)

67 FPS

Shadertoy Demo

    title = "Kernel Foveated Rendering",
    author = {Xiaoxu Meng and Ruofei Du and Matthias Zwicker and Amitabh Varshney},
    journal = {Proceedings of the ACM on Computer Graphics and Interactive Techniques (I3D)},
    year = {2018},
    month = {May},
    day = {15 - 18},
    volume = {1},
    number = {5},
    location = {Montreal, Quebec, Canada},
    publisher = {ACM},
    series = {I3D},
    keywords = {foveated rendering, perception, log-polar mapping, eye-tracking, virtual reality, head-mounted displays},
    doi = {10.1145/3203199},
    pages = {1--20}