TY - GEN
T1 - Real-time Illumination Estimation for Mixed Reality on Mobile Devices
AU - Xu, Di
AU - Li, Zhen
AU - Zhang, Yanning
N1 - Publisher Copyright:
© 2020 IEEE.
PY - 2020/3
Y1 - 2020/3
N2 - We present a lightweight lighting estimation method for the purpose of realistic mixed reality (MR) on mobile devices. Given a single RGB image, our method estimates the environment lighting and renders the virtual object in real-time. While previous works tackled this problem by reconstructing the complicated high dynamic range (HDR) environment maps, our deep neural network directly infers the corresponding spherical harmonics in extensive environments. Compared to previous approaches, our method is more robust and efficient as it works for both indoor and outdoor scenes in real-time. Experiments show that our approach achieves realistic rendering in various MR scenarios.
AB - We present a lightweight lighting estimation method for the purpose of realistic mixed reality (MR) on mobile devices. Given a single RGB image, our method estimates the environment lighting and renders the virtual object in real-time. While previous works tackled this problem by reconstructing the complicated high dynamic range (HDR) environment maps, our deep neural network directly infers the corresponding spherical harmonics in extensive environments. Compared to previous approaches, our method is more robust and efficient as it works for both indoor and outdoor scenes in real-time. Experiments show that our approach achieves realistic rendering in various MR scenarios.
KW - Computer Graphics
KW - Computing methodologies
KW - Graphics systems and interface
KW - Mixed / augmented reality
UR - http://www.scopus.com/inward/record.url?scp=85085361854&partnerID=8YFLogxK
U2 - 10.1109/VRW50115.2020.00202
DO - 10.1109/VRW50115.2020.00202
M3 - 会议稿件
AN - SCOPUS:85085361854
T3 - Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020
SP - 703
EP - 704
BT - Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020
Y2 - 22 March 2020 through 26 March 2020
ER -