Multi-Resolution 3D Rendering for High-Performance Web AR
In the context of web augmented reality (AR), 3D rendering that maintains visual quality and frame rate requirements remains a challenge. The lack of a dedicated and efficient 3D format often results in the degraded visual quality of the original data and compromises the user experience. This paper...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-08-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/23/15/6885 |
| _version_ | 1797585959787692032 |
|---|---|
| author | Argyro-Maria Boutsi Charalabos Ioannidis Styliani Verykokou |
| author_facet | Argyro-Maria Boutsi Charalabos Ioannidis Styliani Verykokou |
| author_sort | Argyro-Maria Boutsi |
| collection | DOAJ |
| description | In the context of web augmented reality (AR), 3D rendering that maintains visual quality and frame rate requirements remains a challenge. The lack of a dedicated and efficient 3D format often results in the degraded visual quality of the original data and compromises the user experience. This paper examines the integration of web-streamable view-dependent representations of large-sized and high-resolution 3D models in web AR applications. The developed cross-platform prototype exploits the batched multi-resolution structures of the Nexus.js library as a dedicated lightweight web AR format and tests it against common formats and compression techniques. Built with AR.js and Three.js open-source libraries, it allows the overlay of the multi-resolution models by interactively adjusting the position, rotation and scale parameters. The proposed method includes real-time view-dependent rendering, geometric instancing and 3D pose regression for two types of AR: natural feature tracking (NFT) and location-based positioning for large and textured 3D overlays. The prototype achieves up to a 46% speedup in rendering time compared to optimized glTF models, while a 34 M vertices 3D model is visible in less than 4 s without degraded visual quality in slow 3D networks. The evaluation under various scenes and devices offers insights into how a multi-resolution scheme can be adopted in web AR for high-quality visualization and real-time performance. |
| first_indexed | 2024-03-11T00:16:23Z |
| format | Article |
| id | doaj.art-53b4f1851f024a1f841c0c9f507497d1 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-11T00:16:23Z |
| publishDate | 2023-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-53b4f1851f024a1f841c0c9f507497d12023-11-18T23:35:45ZengMDPI AGSensors1424-82202023-08-012315688510.3390/s23156885Multi-Resolution 3D Rendering for High-Performance Web ARArgyro-Maria Boutsi0Charalabos Ioannidis1Styliani Verykokou2Laboratory of Photogrammetry, School of Rural, Surveying and Geoinformatics Engineering, National Technical University of Athens, 15780 Athens, GreeceLaboratory of Photogrammetry, School of Rural, Surveying and Geoinformatics Engineering, National Technical University of Athens, 15780 Athens, GreeceLaboratory of Photogrammetry, School of Rural, Surveying and Geoinformatics Engineering, National Technical University of Athens, 15780 Athens, GreeceIn the context of web augmented reality (AR), 3D rendering that maintains visual quality and frame rate requirements remains a challenge. The lack of a dedicated and efficient 3D format often results in the degraded visual quality of the original data and compromises the user experience. This paper examines the integration of web-streamable view-dependent representations of large-sized and high-resolution 3D models in web AR applications. The developed cross-platform prototype exploits the batched multi-resolution structures of the Nexus.js library as a dedicated lightweight web AR format and tests it against common formats and compression techniques. Built with AR.js and Three.js open-source libraries, it allows the overlay of the multi-resolution models by interactively adjusting the position, rotation and scale parameters. The proposed method includes real-time view-dependent rendering, geometric instancing and 3D pose regression for two types of AR: natural feature tracking (NFT) and location-based positioning for large and textured 3D overlays. The prototype achieves up to a 46% speedup in rendering time compared to optimized glTF models, while a 34 M vertices 3D model is visible in less than 4 s without degraded visual quality in slow 3D networks. The evaluation under various scenes and devices offers insights into how a multi-resolution scheme can be adopted in web AR for high-quality visualization and real-time performance.https://www.mdpi.com/1424-8220/23/15/6885augmented realitymulti-resolutionAR.jsThree.jsweb visualization |
| spellingShingle | Argyro-Maria Boutsi Charalabos Ioannidis Styliani Verykokou Multi-Resolution 3D Rendering for High-Performance Web AR Sensors augmented reality multi-resolution AR.js Three.js web visualization |
| title | Multi-Resolution 3D Rendering for High-Performance Web AR |
| title_full | Multi-Resolution 3D Rendering for High-Performance Web AR |
| title_fullStr | Multi-Resolution 3D Rendering for High-Performance Web AR |
| title_full_unstemmed | Multi-Resolution 3D Rendering for High-Performance Web AR |
| title_short | Multi-Resolution 3D Rendering for High-Performance Web AR |
| title_sort | multi resolution 3d rendering for high performance web ar |
| topic | augmented reality multi-resolution AR.js Three.js web visualization |
| url | https://www.mdpi.com/1424-8220/23/15/6885 |
| work_keys_str_mv | AT argyromariaboutsi multiresolution3drenderingforhighperformancewebar AT charalabosioannidis multiresolution3drenderingforhighperformancewebar AT stylianiverykokou multiresolution3drenderingforhighperformancewebar |