Priors for new view synthesis
New view synthesis (NVS) is the problem of generating a novel image of a scene, given a set of calibrated input images of the scene, i.e. their viewpoints, and also that of the output image, are known. The problem is generally ill-posed---a large number of scenes can generate a given set of images,...
| मुख्य लेखकों: | , |
|---|---|
| अन्य लेखक: | |
| स्वरूप: | थीसिस |
| भाषा: | English |
| प्रकाशित: |
2009
|
| विषय: |
| _version_ | 1826316322672214016 |
|---|---|
| author | Woodford, O Oliver Woodford |
| author2 | Reid, I |
| author_facet | Reid, I Woodford, O Oliver Woodford |
| author_sort | Woodford, O |
| collection | OXFORD |
| description | New view synthesis (NVS) is the problem of generating a novel image of a scene, given a set of calibrated input images of the scene, i.e. their viewpoints, and also that of the output image, are known. The problem is generally ill-posed---a large number of scenes can generate a given set of images, therefore there may be many equally likely (given the input data) output views. Some of these views will look less natural to a human observer than others, so prior knowledge of natural scenes is required to ensure that the result is visually plausible. The aim of this thesis is to compare and improve upon the various Markov random field} and conditional random field prior models, and their associated maximum a posteriori optimization frameworks, that are currently the state of the art for NVS and stereo (itself a means to NVS). A hierarchical example-based image prior is introduced which, when combined with a multi-resolution framework, accelerates inference by an order of magnitude, whilst also improving the quality of rendering. A parametric image prior is tested using a number of novel discrete optimization algorithms. This general prior is found to be less well suited to the NVS problem than sequence-specific priors, generating two forms of undesirable artifact, which are discussed. A novel pairwise clique image prior is developed, allowing inference using powerful optimizers. The prior is shown to perform better than a range of other pairwise image priors, distinguishing as it does between natural and artificial texture discontinuities. A dense stereo algorithm with geometrical occlusion model is converted to the task of NVS. In doing so, a number of challenges are novelly addressed; in particular, the new pairwise image prior is employed to align depth discontinuities with genuine texture edges in the output image. The resulting joint prior over smoothness and texture is shown to produce cutting edge rendering performance. Finally, a powerful new inference framework for stereo that allows the tractable optimization of second order smoothness priors is introduced. The second order priors are shown to improve reconstruction over first order priors in a number of situations. |
| first_indexed | 2024-03-06T20:54:06Z |
| format | Thesis |
| id | oxford-uuid:38962bda-6f0f-4158-89cf-8c641ebac486 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-12-09T03:43:02Z |
| publishDate | 2009 |
| record_format | dspace |
| spelling | oxford-uuid:38962bda-6f0f-4158-89cf-8c641ebac4862024-12-07T14:09:43ZPriors for new view synthesisThesishttp://purl.org/coar/resource_type/c_db06uuid:38962bda-6f0f-4158-89cf-8c641ebac486Image understandingInformation engineeringRoboticsEnglishOxford University Research Archive - Valet2009Woodford, OOliver WoodfordReid, IFitzgibbon, ATorr, PNew view synthesis (NVS) is the problem of generating a novel image of a scene, given a set of calibrated input images of the scene, i.e. their viewpoints, and also that of the output image, are known. The problem is generally ill-posed---a large number of scenes can generate a given set of images, therefore there may be many equally likely (given the input data) output views. Some of these views will look less natural to a human observer than others, so prior knowledge of natural scenes is required to ensure that the result is visually plausible. The aim of this thesis is to compare and improve upon the various Markov random field} and conditional random field prior models, and their associated maximum a posteriori optimization frameworks, that are currently the state of the art for NVS and stereo (itself a means to NVS). A hierarchical example-based image prior is introduced which, when combined with a multi-resolution framework, accelerates inference by an order of magnitude, whilst also improving the quality of rendering. A parametric image prior is tested using a number of novel discrete optimization algorithms. This general prior is found to be less well suited to the NVS problem than sequence-specific priors, generating two forms of undesirable artifact, which are discussed. A novel pairwise clique image prior is developed, allowing inference using powerful optimizers. The prior is shown to perform better than a range of other pairwise image priors, distinguishing as it does between natural and artificial texture discontinuities. A dense stereo algorithm with geometrical occlusion model is converted to the task of NVS. In doing so, a number of challenges are novelly addressed; in particular, the new pairwise image prior is employed to align depth discontinuities with genuine texture edges in the output image. The resulting joint prior over smoothness and texture is shown to produce cutting edge rendering performance. Finally, a powerful new inference framework for stereo that allows the tractable optimization of second order smoothness priors is introduced. The second order priors are shown to improve reconstruction over first order priors in a number of situations. |
| spellingShingle | Image understanding Information engineering Robotics Woodford, O Oliver Woodford Priors for new view synthesis |
| title | Priors for new view synthesis |
| title_full | Priors for new view synthesis |
| title_fullStr | Priors for new view synthesis |
| title_full_unstemmed | Priors for new view synthesis |
| title_short | Priors for new view synthesis |
| title_sort | priors for new view synthesis |
| topic | Image understanding Information engineering Robotics |
| work_keys_str_mv | AT woodfordo priorsfornewviewsynthesis AT oliverwoodford priorsfornewviewsynthesis |