NEURAL RADIANCE FIELDS (NERF): REVIEW AND POTENTIAL APPLICATIONS TO DIGITAL CULTURAL HERITAGE
Neural Radiance Fields (NeRF or NeRFs) are to date emerging as a novel method for synthesizing novel views of complex 3D scenes, leveraging an artificial neural network to optimize a volumetric scene function using a set of input views. We conduct a preliminary critical review of the scientific and...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2023-06-01
|
| Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | https://isprs-archives.copernicus.org/articles/XLVIII-M-2-2023/453/2023/isprs-archives-XLVIII-M-2-2023-453-2023.pdf |
| _version_ | 1797796176754376704 |
|---|---|
| author | V. Croce G. Caroti L. De Luca A. Piemonte P. Véron |
| author_facet | V. Croce G. Caroti L. De Luca A. Piemonte P. Véron |
| author_sort | V. Croce |
| collection | DOAJ |
| description | Neural Radiance Fields (NeRF or NeRFs) are to date emerging as a novel method for synthesizing novel views of complex 3D scenes, leveraging an artificial neural network to optimize a volumetric scene function using a set of input views. We conduct a preliminary critical review of the scientific and technical literature on NeRFs, and we highlight possible applications of the latter in the Cultural Heritage domain, for the image-based reconstruction of 3D models of real, multi-scale objects, even in combination with the more well-established photogrammetric techniques. A comparison is made between NeRFs and photogrammetry in terms of operating procedures and outputs (volumetric renderings vs. point clouds or meshes). It is demonstrated that NeRFs could be conveniently used for rendering objects (sculptures, archaeological remains, sites, paintings etc.) that are challenging for photogrammetry, typically: i) metallic, translucent, and/or transparent surfaces; ii) objects that present homogeneous textures; iii) occlusions, vegetation, and elements of very fine detail. |
| first_indexed | 2024-03-13T03:29:07Z |
| format | Article |
| id | doaj.art-279c12311e5d4c62989f959a7a5af4b4 |
| institution | Directory Open Access Journal |
| issn | 1682-1750 2194-9034 |
| language | English |
| last_indexed | 2024-03-13T03:29:07Z |
| publishDate | 2023-06-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj.art-279c12311e5d4c62989f959a7a5af4b42023-06-24T17:13:17ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342023-06-01XLVIII-M-2-202345346010.5194/isprs-archives-XLVIII-M-2-2023-453-2023NEURAL RADIANCE FIELDS (NERF): REVIEW AND POTENTIAL APPLICATIONS TO DIGITAL CULTURAL HERITAGEV. Croce0G. Caroti1L. De Luca2A. Piemonte3P. Véron4Dept. of Energy, Systems, Land and Construction Engineering, University of Pisa, 56122 Pisa, ItalyDept. of Civil and Industrial Engineering, University of Pisa, 56122 Pisa, ItalyUMR MAP 3495 CNRS/MC, Campus CNRS Joseph-Aiguier, 13402 Marseille, FranceDept. of Civil and Industrial Engineering, University of Pisa, 56122 Pisa, ItalyLISPEN EA 7515, Arts et Métiers Institute of Technology, 13100 Aix-en-Provence, FranceNeural Radiance Fields (NeRF or NeRFs) are to date emerging as a novel method for synthesizing novel views of complex 3D scenes, leveraging an artificial neural network to optimize a volumetric scene function using a set of input views. We conduct a preliminary critical review of the scientific and technical literature on NeRFs, and we highlight possible applications of the latter in the Cultural Heritage domain, for the image-based reconstruction of 3D models of real, multi-scale objects, even in combination with the more well-established photogrammetric techniques. A comparison is made between NeRFs and photogrammetry in terms of operating procedures and outputs (volumetric renderings vs. point clouds or meshes). It is demonstrated that NeRFs could be conveniently used for rendering objects (sculptures, archaeological remains, sites, paintings etc.) that are challenging for photogrammetry, typically: i) metallic, translucent, and/or transparent surfaces; ii) objects that present homogeneous textures; iii) occlusions, vegetation, and elements of very fine detail.https://isprs-archives.copernicus.org/articles/XLVIII-M-2-2023/453/2023/isprs-archives-XLVIII-M-2-2023-453-2023.pdf |
| spellingShingle | V. Croce G. Caroti L. De Luca A. Piemonte P. Véron NEURAL RADIANCE FIELDS (NERF): REVIEW AND POTENTIAL APPLICATIONS TO DIGITAL CULTURAL HERITAGE The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | NEURAL RADIANCE FIELDS (NERF): REVIEW AND POTENTIAL APPLICATIONS TO DIGITAL CULTURAL HERITAGE |
| title_full | NEURAL RADIANCE FIELDS (NERF): REVIEW AND POTENTIAL APPLICATIONS TO DIGITAL CULTURAL HERITAGE |
| title_fullStr | NEURAL RADIANCE FIELDS (NERF): REVIEW AND POTENTIAL APPLICATIONS TO DIGITAL CULTURAL HERITAGE |
| title_full_unstemmed | NEURAL RADIANCE FIELDS (NERF): REVIEW AND POTENTIAL APPLICATIONS TO DIGITAL CULTURAL HERITAGE |
| title_short | NEURAL RADIANCE FIELDS (NERF): REVIEW AND POTENTIAL APPLICATIONS TO DIGITAL CULTURAL HERITAGE |
| title_sort | neural radiance fields nerf review and potential applications to digital cultural heritage |
| url | https://isprs-archives.copernicus.org/articles/XLVIII-M-2-2023/453/2023/isprs-archives-XLVIII-M-2-2023-453-2023.pdf |
| work_keys_str_mv | AT vcroce neuralradiancefieldsnerfreviewandpotentialapplicationstodigitalculturalheritage AT gcaroti neuralradiancefieldsnerfreviewandpotentialapplicationstodigitalculturalheritage AT ldeluca neuralradiancefieldsnerfreviewandpotentialapplicationstodigitalculturalheritage AT apiemonte neuralradiancefieldsnerfreviewandpotentialapplicationstodigitalculturalheritage AT pveron neuralradiancefieldsnerfreviewandpotentialapplicationstodigitalculturalheritage |