A SMARTPHONE-BASED 3D PIPELINE FOR THE CREATIVE INDUSTRY – THE REPLICATE EU PROJECT
During the last two decades we have witnessed great improvements in ICT hardware and software technologies. Three-dimensional content is starting to become commonplace now in many applications. Although for many years 3D technologies have been used in the generation of assets by researchers and expe...
| Main Authors: | , , , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2017-02-01
|
| Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | http://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2-W3/535/2017/isprs-archives-XLII-2-W3-535-2017.pdf |
| _version_ | 1818515330298806272 |
|---|---|
| author | E. Nocerino F. Lago D. Morabito F. Remondino L. Porzi F. Poiesi S. Rota Bulo P. Chippendale A. Locher M. Havlena L. Van Gool M. Eder A. Fötschl A. Hilsmann L. Kausch P. Eisert |
| author_facet | E. Nocerino F. Lago D. Morabito F. Remondino L. Porzi F. Poiesi S. Rota Bulo P. Chippendale A. Locher M. Havlena L. Van Gool M. Eder A. Fötschl A. Hilsmann L. Kausch P. Eisert |
| author_sort | E. Nocerino |
| collection | DOAJ |
| description | During the last two decades we have witnessed great improvements in ICT hardware and software technologies. Three-dimensional
content is starting to become commonplace now in many applications. Although for many years 3D technologies have been used in
the generation of assets by researchers and experts, nowadays these tools are starting to become commercially available to every
citizen. This is especially the case for smartphones, that are powerful enough and sufficiently widespread to perform a huge variety of
activities (e.g. paying, calling, communication, photography, navigation, localization, etc.), including just very recently the possibility
of running 3D reconstruction pipelines. The REPLICATE project is tackling this particular issue, and it has an ambitious vision to
enable ubiquitous 3D creativity via the development of tools for mobile 3D-assets generation on smartphones/tablets. This article
presents the REPLICATE project’s concept and some of the ongoing activities, with particular attention being paid to advances made
in the first year of work. Thus the article focuses on the system architecture definition, selection of optimal frames for 3D cloud
reconstruction, automated generation of sparse and dense point clouds, mesh modelling techniques and post-processing actions.
Experiments so far were concentrated on indoor objects and some simple heritage artefacts, however, in the long term we will be
targeting a larger variety of scenarios and communities. |
| first_indexed | 2024-12-11T00:27:33Z |
| format | Article |
| id | doaj.art-00ffc0fbfc5f426987671cc34611161c |
| institution | Directory Open Access Journal |
| issn | 1682-1750 2194-9034 |
| language | English |
| last_indexed | 2024-12-11T00:27:33Z |
| publishDate | 2017-02-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj.art-00ffc0fbfc5f426987671cc34611161c2022-12-22T01:27:28ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342017-02-01XLII-2/W353554110.5194/isprs-archives-XLII-2-W3-535-2017A SMARTPHONE-BASED 3D PIPELINE FOR THE CREATIVE INDUSTRY – THE REPLICATE EU PROJECTE. Nocerino0F. Lago1D. Morabito2F. Remondino3L. Porzi4F. Poiesi5S. Rota Bulo6P. Chippendale7A. Locher8M. Havlena9L. Van Gool10M. Eder11A. Fötschl12A. Hilsmann13L. Kausch14P. Eisert153D Optical Metrology (3DOM) unit, Bruno Kessler Foundation (FBK), Trento, Italy3D Optical Metrology (3DOM) unit, Bruno Kessler Foundation (FBK), Trento, Italy3D Optical Metrology (3DOM) unit, Bruno Kessler Foundation (FBK), Trento, Italy3D Optical Metrology (3DOM) unit, Bruno Kessler Foundation (FBK), Trento, ItalyTechnology of Vision unit, Bruno Kessler Foundation (FBK), Trento, ItalyTechnology of Vision unit, Bruno Kessler Foundation (FBK), Trento, ItalyTechnology of Vision unit, Bruno Kessler Foundation (FBK), Trento, ItalyTechnology of Vision unit, Bruno Kessler Foundation (FBK), Trento, ItalyComputer Vision Lab, ETH Zurich, SwitzerlandComputer Vision Lab, ETH Zurich, SwitzerlandComputer Vision Lab, ETH Zurich, SwitzerlandWikitude GmbH, Salzburg, AustriaWikitude GmbH, Salzburg, AustriaHHI Fraunhofer, Berlin, GermanyHHI Fraunhofer, Berlin, GermanyHHI Fraunhofer, Berlin, GermanyDuring the last two decades we have witnessed great improvements in ICT hardware and software technologies. Three-dimensional content is starting to become commonplace now in many applications. Although for many years 3D technologies have been used in the generation of assets by researchers and experts, nowadays these tools are starting to become commercially available to every citizen. This is especially the case for smartphones, that are powerful enough and sufficiently widespread to perform a huge variety of activities (e.g. paying, calling, communication, photography, navigation, localization, etc.), including just very recently the possibility of running 3D reconstruction pipelines. The REPLICATE project is tackling this particular issue, and it has an ambitious vision to enable ubiquitous 3D creativity via the development of tools for mobile 3D-assets generation on smartphones/tablets. This article presents the REPLICATE project’s concept and some of the ongoing activities, with particular attention being paid to advances made in the first year of work. Thus the article focuses on the system architecture definition, selection of optimal frames for 3D cloud reconstruction, automated generation of sparse and dense point clouds, mesh modelling techniques and post-processing actions. Experiments so far were concentrated on indoor objects and some simple heritage artefacts, however, in the long term we will be targeting a larger variety of scenarios and communities.http://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2-W3/535/2017/isprs-archives-XLII-2-W3-535-2017.pdf |
| spellingShingle | E. Nocerino F. Lago D. Morabito F. Remondino L. Porzi F. Poiesi S. Rota Bulo P. Chippendale A. Locher M. Havlena L. Van Gool M. Eder A. Fötschl A. Hilsmann L. Kausch P. Eisert A SMARTPHONE-BASED 3D PIPELINE FOR THE CREATIVE INDUSTRY – THE REPLICATE EU PROJECT The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | A SMARTPHONE-BASED 3D PIPELINE FOR THE CREATIVE INDUSTRY
– THE REPLICATE EU PROJECT |
| title_full | A SMARTPHONE-BASED 3D PIPELINE FOR THE CREATIVE INDUSTRY
– THE REPLICATE EU PROJECT |
| title_fullStr | A SMARTPHONE-BASED 3D PIPELINE FOR THE CREATIVE INDUSTRY
– THE REPLICATE EU PROJECT |
| title_full_unstemmed | A SMARTPHONE-BASED 3D PIPELINE FOR THE CREATIVE INDUSTRY
– THE REPLICATE EU PROJECT |
| title_short | A SMARTPHONE-BASED 3D PIPELINE FOR THE CREATIVE INDUSTRY
– THE REPLICATE EU PROJECT |
| title_sort | smartphone based 3d pipeline for the creative industry ndash the replicate eu project |
| url | http://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2-W3/535/2017/isprs-archives-XLII-2-W3-535-2017.pdf |
| work_keys_str_mv | AT enocerino asmartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT flago asmartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT dmorabito asmartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT fremondino asmartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT lporzi asmartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT fpoiesi asmartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT srotabulo asmartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT pchippendale asmartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT alocher asmartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT mhavlena asmartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT lvangool asmartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT meder asmartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT afotschl asmartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT ahilsmann asmartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT lkausch asmartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT peisert asmartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT enocerino smartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT flago smartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT dmorabito smartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT fremondino smartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT lporzi smartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT fpoiesi smartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT srotabulo smartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT pchippendale smartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT alocher smartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT mhavlena smartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT lvangool smartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT meder smartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT afotschl smartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT ahilsmann smartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT lkausch smartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject AT peisert smartphonebased3dpipelineforthecreativeindustryndashthereplicateeuproject |