Temporally Reliable Motion Vectors for Real-time Ray Tracing

Zheng Zeng, Shiqiu (Edward) Liu, Jinglei Yang, Lu Wang, Ling-Qi Yan
Computer Graphics Forum (Proceedings of Eurographics 2021)
project teaser

Abstract

Real-time ray tracing (RTRT) is being pervasively applied. The key to RTRT is a reliable denoising scheme that reconstructs clean images from significantly undersampled noisy inputs, usually at 1 sample per pixel as limited by current hardware’s computing power. The state of the art reconstruction methods all rely on temporal filtering to find correspondences of current pixels in the previous frame, described using per-pixel screen-space motion vectors. While these approaches are demonstrated powerful, they suffer from a common issue that the temporal information cannot be used when the motion vectors are not valid, i.e. when temporal correspondences are not obviously available or do not exist in theory. We introduce temporally reliable motion vectors that aim at deeper exploration of temporal coherence, especially for the generally-believed difficult applications on shadows, glossy reflections and occlusions, with the key idea to detect and track the cause of each effect. We show that our temporally reliable motion vectors produce significantly better temporal results on a variety of dynamic scenes when compared to the state of the art methods, but with negligible performance overhead.

Downloads

Paper (37MB) Slides (PPT, 24MB) Supplemental video (629MB)

Videos

Supplemental video

Cite

@inproceedings{zeng2021temporally,
  title={Temporally Reliable Motion Vectors for Real-time Ray Tracing},
  author={Zeng, Zheng and Liu, Shiqiu and Yang, Jinglei and Wang, Lu and Yan, Ling-Qi},
  booktitle={Computer Graphics Forum},
  volume={40},
  number={2},
  pages={79--90},
  year={2021},
  organization={Wiley Online Library}
}

© The Author(s). This is the author’s version of the work. It is posted here for your personal use. Not for redistribution. The definitive version of record is available at DOI.