NeuSample: Neural Sample Field for Efficient View Synthesis
Jiemin Fang1, Lingxi Xie2, Xinggang Wang1, Xiaopeng Zhang2, Wenyu Liu1, Qi Tian2
1 HUST, 2 Huawei Cloud
Neural radiance fields (NeRF) have shown great potentials in representing 3D scenes and synthesizing novel views, but the computational overhead of NeRF at the inference stage is still heavy. To alleviate the burden, we delve into the coarse-to-fine, hierarchical sampling procedure of NeRF and point out that the coarse stage can be replaced by a lightweight module which we name a neural sample field. The proposed sample field maps rays into sample distributions, which can be transformed into point coordinates and fed into radiance fields for volume rendering. The overall framework is named as NeuSample. We perform experiments on Realistic Synthetic 360° and Real Forward-Facing, two popular 3D scene sets, and show that NeuSample achieves better rendering quality than NeRF while enjoying a faster inference speed. NeuSample is further compressed with a proposed sample field extraction method towards a better trade-off between quality and speed.
- Oct. 2022 - A preliminary version of code is released.
- Code will be released here in the future.
Train NeuSample by running
python -m torch.distributed.launch --nproc_per_node=1 train.py --config configs/"config file"
This repository is partially based on vcnerf. Thanks for Liangchen's awesome code!
If you find this project helpful in your research, welcome to cite the paper.
@article{fang2021neusample,
title={NeuSample: Neural Sample Field for Efficient View Synthesis},
author={Jiemin Fang and Lingxi Xie and Xinggang Wang and Xiaopeng Zhang and Wenyu Liu and Qi Tian},
journal={arXiv:2111.15552},
year={2021}
}