Image-Based Rendering of LOD1 3D City Models for traffic-augmented Immersive Street-view Navigation
It may be argued that urban areas may now be modeled with sufficient details for realistic fly-through over the cities at a reasonable price point. Modeling cities at the street level for immersive street-view navigation is however still a very expensive (or even impossible) operation if one tries t...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2013-10-01
|
| Series: | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | http://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/II-3-W3/7/2013/isprsannals-II-3-W3-7-2013.pdf |
| _version_ | 1811314733130711040 |
|---|---|
| author | M. Brédif |
| author_facet | M. Brédif |
| author_sort | M. Brédif |
| collection | DOAJ |
| description | It may be argued that urban areas may now be modeled with sufficient details for realistic fly-through over the cities at a reasonable price
point. Modeling cities at the street level for immersive street-view navigation is however still a very expensive (or even impossible)
operation if one tries to match the level of detail acquired by street-view mobile mapping imagery. This paper proposes to leverage
the richness of these street-view images with the common availability of nation-wide LOD1 3D city models, using an image-based
rendering technique : projective multi-texturing. Such a coarse 3D city model may be used as a lightweight scene proxy of approximate
coarse geometry. The images neighboring the interpolated viewpoint are projected onto this scene proxy using their estimated poses and
calibrations and blended together according to their relative distance. This enables an immersive navigation within the image dataset that
is perfectly equal to – and thus as rich as – original images when viewed from their viewpoint location, and which degrades gracefully
in between viewpoint locations. Beyond proving the applicability of this preprocessing-free computer graphics technique to mobile
mapping images and LOD1 3D city models, our contributions are three-fold. Firstly, image distortion is corrected online in the GPU,
preventing an extra image resampling step. Secondly, externally-computed binary masks may be used to discard pixels corresponding
to moving objects. Thirdly, we propose a shadowmap-inspired technique that prevents, at marginal cost, the projective texturing of
surfaces beyond the first, as seen from the projected image viewpoint location. Finally, an augmented visualization application is
introduced to showcase the proposed immersive navigation: images are unpopulated from vehicles using externally-computed binary
masks and repopulated using a 3D visualization of a 2D traffic simulation. |
| first_indexed | 2024-04-13T11:16:39Z |
| format | Article |
| id | doaj.art-7b9813ee83e4414bb0fa34821e42b2e4 |
| institution | Directory Open Access Journal |
| issn | 2194-9042 2194-9050 |
| language | English |
| last_indexed | 2024-04-13T11:16:39Z |
| publishDate | 2013-10-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj.art-7b9813ee83e4414bb0fa34821e42b2e42022-12-22T02:48:56ZengCopernicus PublicationsISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences2194-90422194-90502013-10-01II-3/W371110.5194/isprsannals-II-3-W3-7-2013Image-Based Rendering of LOD1 3D City Models for traffic-augmented Immersive Street-view NavigationM. Brédif0Université Paris-Est, IGN/SR, MATIS, 73 avenue de Paris, 94160 Saint Mandé, FranceIt may be argued that urban areas may now be modeled with sufficient details for realistic fly-through over the cities at a reasonable price point. Modeling cities at the street level for immersive street-view navigation is however still a very expensive (or even impossible) operation if one tries to match the level of detail acquired by street-view mobile mapping imagery. This paper proposes to leverage the richness of these street-view images with the common availability of nation-wide LOD1 3D city models, using an image-based rendering technique : projective multi-texturing. Such a coarse 3D city model may be used as a lightweight scene proxy of approximate coarse geometry. The images neighboring the interpolated viewpoint are projected onto this scene proxy using their estimated poses and calibrations and blended together according to their relative distance. This enables an immersive navigation within the image dataset that is perfectly equal to – and thus as rich as – original images when viewed from their viewpoint location, and which degrades gracefully in between viewpoint locations. Beyond proving the applicability of this preprocessing-free computer graphics technique to mobile mapping images and LOD1 3D city models, our contributions are three-fold. Firstly, image distortion is corrected online in the GPU, preventing an extra image resampling step. Secondly, externally-computed binary masks may be used to discard pixels corresponding to moving objects. Thirdly, we propose a shadowmap-inspired technique that prevents, at marginal cost, the projective texturing of surfaces beyond the first, as seen from the projected image viewpoint location. Finally, an augmented visualization application is introduced to showcase the proposed immersive navigation: images are unpopulated from vehicles using externally-computed binary masks and repopulated using a 3D visualization of a 2D traffic simulation.http://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/II-3-W3/7/2013/isprsannals-II-3-W3-7-2013.pdf |
| spellingShingle | M. Brédif Image-Based Rendering of LOD1 3D City Models for traffic-augmented Immersive Street-view Navigation ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | Image-Based Rendering of LOD1 3D City Models for traffic-augmented Immersive Street-view Navigation |
| title_full | Image-Based Rendering of LOD1 3D City Models for traffic-augmented Immersive Street-view Navigation |
| title_fullStr | Image-Based Rendering of LOD1 3D City Models for traffic-augmented Immersive Street-view Navigation |
| title_full_unstemmed | Image-Based Rendering of LOD1 3D City Models for traffic-augmented Immersive Street-view Navigation |
| title_short | Image-Based Rendering of LOD1 3D City Models for traffic-augmented Immersive Street-view Navigation |
| title_sort | image based rendering of lod1 3d city models for traffic augmented immersive street view navigation |
| url | http://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/II-3-W3/7/2013/isprsannals-II-3-W3-7-2013.pdf |
| work_keys_str_mv | AT mbredif imagebasedrenderingoflod13dcitymodelsfortrafficaugmentedimmersivestreetviewnavigation |