MODULAR BUNDLE ADJUSTMENT FOR PHOTOGRAMMETRIC COMPUTATIONS
In this paper we investigate how the residuals in bundle adjustment can be split into a composition of simple functions. According to the chain rule, the Jacobian (linearisation) of the residual can be formed as a product of the Jacobians of the individual steps. When implemented, this enables a mod...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2018-05-01
|
| Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2/133/2018/isprs-archives-XLII-2-133-2018.pdf |
| _version_ | 1811327975504740352 |
|---|---|
| author | N. Börlin A. Murtiyoso P. Grussenmeyer F. Menna E. Nocerino |
| author_facet | N. Börlin A. Murtiyoso P. Grussenmeyer F. Menna E. Nocerino |
| author_sort | N. Börlin |
| collection | DOAJ |
| description | In this paper we investigate how the residuals in bundle adjustment can be split into a composition of simple functions. According to the chain rule, the Jacobian (linearisation) of the residual can be formed as a product of the Jacobians of the individual steps. When implemented, this enables a modularisation of the computation of the bundle adjustment residuals and Jacobians where each component has limited responsibility. This enables simple replacement of components to e.g. implement different projection or rotation models by exchanging a module.<br>
The technique has previously been used to implement bundle adjustment in the open-source package DBAT (Börlin and Grussenmeyer, 2013) based on the Photogrammetric and Computer Vision interpretations of Brown (1971) lens distortion model. In this paper, we applied the technique to investigate how affine distortions can be used to model the projection of a tilt-shift lens. Two extended distortion models were implemented to test the hypothesis that the ordering of the affine and lens distortion steps can be changed to reduce the size of the residuals of a tilt-shift lens calibration.<br>
Results on synthetic data confirm that the ordering of the affine and lens distortion steps matter and is detectable by DBAT. However, when applied to a real camera calibration data set of a tilt-shift lens, no difference between the extended models was seen. This suggests that the tested hypothesis is false and that other effects need to be modelled to better explain the projection. The relatively low implementation effort that was needed to generate the models suggest that the technique can be used to investigate other novel projection models in photogrammetry, including modelling changes in the 3D geometry to better understand the tilt-shift lens. |
| first_indexed | 2024-04-13T15:18:32Z |
| format | Article |
| id | doaj.art-091e80401a314c8cad42327080f3cc9d |
| institution | Directory Open Access Journal |
| issn | 1682-1750 2194-9034 |
| language | English |
| last_indexed | 2024-04-13T15:18:32Z |
| publishDate | 2018-05-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj.art-091e80401a314c8cad42327080f3cc9d2022-12-22T02:41:46ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342018-05-01XLII-213314010.5194/isprs-archives-XLII-2-133-2018MODULAR BUNDLE ADJUSTMENT FOR PHOTOGRAMMETRIC COMPUTATIONSN. Börlin0A. Murtiyoso1P. Grussenmeyer2F. Menna3E. Nocerino4Department of Computing Science, Umeå University, SwedenPhotogrammetry and Geomatics Group, ICube Laboratory UMR 7357, INSA Strasbourg, FrancePhotogrammetry and Geomatics Group, ICube Laboratory UMR 7357, INSA Strasbourg, France3D Optical Metrology (3DOM) unit, Bruno Kessler Foundation (FBK), Trento, Italy3D Optical Metrology (3DOM) unit, Bruno Kessler Foundation (FBK), Trento, ItalyIn this paper we investigate how the residuals in bundle adjustment can be split into a composition of simple functions. According to the chain rule, the Jacobian (linearisation) of the residual can be formed as a product of the Jacobians of the individual steps. When implemented, this enables a modularisation of the computation of the bundle adjustment residuals and Jacobians where each component has limited responsibility. This enables simple replacement of components to e.g. implement different projection or rotation models by exchanging a module.<br> The technique has previously been used to implement bundle adjustment in the open-source package DBAT (Börlin and Grussenmeyer, 2013) based on the Photogrammetric and Computer Vision interpretations of Brown (1971) lens distortion model. In this paper, we applied the technique to investigate how affine distortions can be used to model the projection of a tilt-shift lens. Two extended distortion models were implemented to test the hypothesis that the ordering of the affine and lens distortion steps can be changed to reduce the size of the residuals of a tilt-shift lens calibration.<br> Results on synthetic data confirm that the ordering of the affine and lens distortion steps matter and is detectable by DBAT. However, when applied to a real camera calibration data set of a tilt-shift lens, no difference between the extended models was seen. This suggests that the tested hypothesis is false and that other effects need to be modelled to better explain the projection. The relatively low implementation effort that was needed to generate the models suggest that the technique can be used to investigate other novel projection models in photogrammetry, including modelling changes in the 3D geometry to better understand the tilt-shift lens.https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2/133/2018/isprs-archives-XLII-2-133-2018.pdf |
| spellingShingle | N. Börlin A. Murtiyoso P. Grussenmeyer F. Menna E. Nocerino MODULAR BUNDLE ADJUSTMENT FOR PHOTOGRAMMETRIC COMPUTATIONS The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | MODULAR BUNDLE ADJUSTMENT FOR PHOTOGRAMMETRIC COMPUTATIONS |
| title_full | MODULAR BUNDLE ADJUSTMENT FOR PHOTOGRAMMETRIC COMPUTATIONS |
| title_fullStr | MODULAR BUNDLE ADJUSTMENT FOR PHOTOGRAMMETRIC COMPUTATIONS |
| title_full_unstemmed | MODULAR BUNDLE ADJUSTMENT FOR PHOTOGRAMMETRIC COMPUTATIONS |
| title_short | MODULAR BUNDLE ADJUSTMENT FOR PHOTOGRAMMETRIC COMPUTATIONS |
| title_sort | modular bundle adjustment for photogrammetric computations |
| url | https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2/133/2018/isprs-archives-XLII-2-133-2018.pdf |
| work_keys_str_mv | AT nborlin modularbundleadjustmentforphotogrammetriccomputations AT amurtiyoso modularbundleadjustmentforphotogrammetriccomputations AT pgrussenmeyer modularbundleadjustmentforphotogrammetriccomputations AT fmenna modularbundleadjustmentforphotogrammetriccomputations AT enocerino modularbundleadjustmentforphotogrammetriccomputations |