NoPe-NeRF: optimising neural radiance field with no pose prior
Training a Neural Radiance Field (NeRF) without precomputed camera poses is challenging. Recent advances in this direction demonstrate the possibility of jointly optimising a NeRF and camera poses in forward-facing scenes. However, these methods still face difficulties during dramatic camera movemen...
| Main Authors: | , , , , |
|---|---|
| Format: | Conference item |
| Language: | English |
| Published: |
IEEE
2023
|
| _version_ | 1797111969281474560 |
|---|---|
| author | Bian, W Wang, Z Li, K Bian, J-W Prisacariu, VA |
| author_facet | Bian, W Wang, Z Li, K Bian, J-W Prisacariu, VA |
| author_sort | Bian, W |
| collection | OXFORD |
| description | Training a Neural Radiance Field (NeRF) without precomputed camera poses is challenging. Recent advances in this direction demonstrate the possibility of jointly optimising a NeRF and camera poses in forward-facing scenes. However, these methods still face difficulties during dramatic camera movement. We tackle this challenging problem by incorporating undistorted monocular depth priors. These priors are generated by correcting scale and shift parameters during training, with which we are then able to constrain the relative poses between consecutive frames. This constraint is achieved using our proposed novel loss functions. Experiments on real-world indoor and outdoor scenes show that our method can handle challenging camera trajectories and outperforms existing methods in terms of novel view rendering quality and pose estimation accuracy. |
| first_indexed | 2024-03-07T08:17:45Z |
| format | Conference item |
| id | oxford-uuid:d2ddbfdd-a8aa-496c-aea5-07c5f69cd996 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T08:17:45Z |
| publishDate | 2023 |
| publisher | IEEE |
| record_format | dspace |
| spelling | oxford-uuid:d2ddbfdd-a8aa-496c-aea5-07c5f69cd9962024-01-11T14:03:27ZNoPe-NeRF: optimising neural radiance field with no pose priorConference itemhttp://purl.org/coar/resource_type/c_5794uuid:d2ddbfdd-a8aa-496c-aea5-07c5f69cd996EnglishSymplectic ElementsIEEE2023Bian, WWang, ZLi, KBian, J-WPrisacariu, VATraining a Neural Radiance Field (NeRF) without precomputed camera poses is challenging. Recent advances in this direction demonstrate the possibility of jointly optimising a NeRF and camera poses in forward-facing scenes. However, these methods still face difficulties during dramatic camera movement. We tackle this challenging problem by incorporating undistorted monocular depth priors. These priors are generated by correcting scale and shift parameters during training, with which we are then able to constrain the relative poses between consecutive frames. This constraint is achieved using our proposed novel loss functions. Experiments on real-world indoor and outdoor scenes show that our method can handle challenging camera trajectories and outperforms existing methods in terms of novel view rendering quality and pose estimation accuracy. |
| spellingShingle | Bian, W Wang, Z Li, K Bian, J-W Prisacariu, VA NoPe-NeRF: optimising neural radiance field with no pose prior |
| title | NoPe-NeRF: optimising neural radiance field with no pose prior |
| title_full | NoPe-NeRF: optimising neural radiance field with no pose prior |
| title_fullStr | NoPe-NeRF: optimising neural radiance field with no pose prior |
| title_full_unstemmed | NoPe-NeRF: optimising neural radiance field with no pose prior |
| title_short | NoPe-NeRF: optimising neural radiance field with no pose prior |
| title_sort | nope nerf optimising neural radiance field with no pose prior |
| work_keys_str_mv | AT bianw nopenerfoptimisingneuralradiancefieldwithnoposeprior AT wangz nopenerfoptimisingneuralradiancefieldwithnoposeprior AT lik nopenerfoptimisingneuralradiancefieldwithnoposeprior AT bianjw nopenerfoptimisingneuralradiancefieldwithnoposeprior AT prisacariuva nopenerfoptimisingneuralradiancefieldwithnoposeprior |