Nerf
Baselines
NerfBaselines is a framework for evaluating and comparing existing NeRF methods. Currently, most official implementations use different dataset loaders, evaluation protocols, and metrics which renders the comparison of methods difficult. Therefore, this project aims to provide a unified interface for running and evaluating methods on different datasets in a consistent way using the same metrics. But instead of reimplementing the methods, we use the official implementations and wrap them so that they can be run easily using the same interface.
Mip-NeRF 360
Mip-NeRF 360 is a collection of four indoor and five outdoor object-centric scenes. The camera trajectory is an orbit around the object with fixed elevation and radius. The test set takes each n-th frame of the trajectory as test views.
Method | PSNR | SSIM | LPIPS | Time | GPU Mem. | |
---|---|---|---|---|---|---|
Zip-NeRF | 5h 30m 49s | 26.19 GB | ||||
Mip-NeRF 360 | 7h 29m 42s | 126.99 GB | ||||
Mip-Splatting | 25m 1s | 10.96 GB | ||||
Gaussian Splatting | 22m 45s | 11.12 GB | ||||
NerfStudio | 19m 50s | 3.80 GB | ||||
Tetra-NeRF | 17h 32m 35s | 13.37 GB | ||||
Instant NGP | 4m 16s | 5.62 GB |
Blender
Blender (nerf-synthetic) is a synthetic dataset used to benchmark NeRF methods. It consists of 8 scenes of an object placed on a white background. Cameras are placed on a semi-sphere around the object.
Method | PSNR | SSIM | LPIPS | Time | GPU Mem. | |
---|---|---|---|---|---|---|
Zip-NeRF | 5h 21m 57s | 26.20 GB | ||||
Mip-Splatting | 6m 49s | 2.65 GB | ||||
Gaussian Splatting | 6m 6s | 3.08 GB | ||||
Instant NGP | 2m 23s | 2.57 GB | ||||
Tetra-NeRF | 6h 53m 20s | 29.57 GB | ||||
TensoRF | 8m 9s | 16.86 GB | ||||
Mip-NeRF 360 | 3h 29m 39s | 114.80 GB | ||||
NerfStudio | 9m 38s | 3.65 GB |
Nerfstudio
Nerfstudio Dataset includes 10 in-the-wild captures obtained using either a mobile phone or a mirror-less camera with a fisheye lens. We processed the data using either COLMAP or the Polycam app to obtain camera poses and intrinsic parameters.
Method | PSNR | SSIM | LPIPS | Time | GPU Mem. | |
---|---|---|---|---|---|---|
Zip-NeRF | 5h 21m 41s | 26.19 GB | ||||
Instant NGP | 4m 33s | 4.22 GB | ||||
NerfStudio | 13m 30s | 4.77 GB | ||||
Gaussian Splatting | N/A | N/A | ||||
Mip-Splatting | N/A | N/A |