Model Based Design of a Real Time FPGA-Based Lens Undistortion and Image Rectification Algorithm for Stereo Imaging
Low cost imaging sensors and powerful embedded computers have taken the field of computer vision to new heights. One of the challenges that remains is to shorten the development time that it takes to target one’s algorithm to hardware. This work details the steps necessary to use Model Ba...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10050520/ |
| _version_ | 1811162048225083392 |
|---|---|
| author | Daniel S. Kaputa Krystian A. Derhak |
| author_facet | Daniel S. Kaputa Krystian A. Derhak |
| author_sort | Daniel S. Kaputa |
| collection | DOAJ |
| description | Low cost imaging sensors and powerful embedded computers have taken the field of computer vision to new heights. One of the challenges that remains is to shorten the development time that it takes to target one’s algorithm to hardware. This work details the steps necessary to use Model Based Design to first simulate and then to target a stereo rectification and undistortion algorithm to an embedded FPGA system on chip hardware target. In short, Model Based Design provides a mathematical and visual approach to simulating complex systems as well as the capability to generate executable code from those simulations. This work demonstrates what the future of FPGA-based algorithm development might look like by making use of closed loop design techniques with the aid of novel Model Based Design tool flows. We present the use of hardware-abstracted constructs such as ’virtual cameras’ and the capability of pulling images off the target system and feeding them back into the simulation model to help minimize discrepancies between simulation and hardware domains, ultimately reducing the total development time. The developed system is a deterministic real time and low latency implementation as it does not rely on external off chip memory as all necessary buffering is done in the internal FPGA block RAM structures. The design is capable of processing <inline-formula> <tex-math notation="LaTeX">$752\times 480$ </tex-math></inline-formula> images at pixel line rates and is easily expandable to high resolution images. The algorithm being developed is not being touted as novel, rather that it is sufficiently complex in order to demonstrate the power of the Model Based Design tool flows. |
| first_indexed | 2024-04-10T06:23:20Z |
| format | Article |
| id | doaj.art-eda274f235434e738799d71bc765e1ba |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-10T06:23:20Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-eda274f235434e738799d71bc765e1ba2023-03-02T00:00:47ZengIEEEIEEE Access2169-35362023-01-0111189721898210.1109/ACCESS.2023.324807010050520Model Based Design of a Real Time FPGA-Based Lens Undistortion and Image Rectification Algorithm for Stereo ImagingDaniel S. Kaputa0https://orcid.org/0000-0002-5620-6193Krystian A. Derhak1Rochester Institute of Technology, Rochester, NY, USARochester Institute of Technology, Rochester, NY, USALow cost imaging sensors and powerful embedded computers have taken the field of computer vision to new heights. One of the challenges that remains is to shorten the development time that it takes to target one’s algorithm to hardware. This work details the steps necessary to use Model Based Design to first simulate and then to target a stereo rectification and undistortion algorithm to an embedded FPGA system on chip hardware target. In short, Model Based Design provides a mathematical and visual approach to simulating complex systems as well as the capability to generate executable code from those simulations. This work demonstrates what the future of FPGA-based algorithm development might look like by making use of closed loop design techniques with the aid of novel Model Based Design tool flows. We present the use of hardware-abstracted constructs such as ’virtual cameras’ and the capability of pulling images off the target system and feeding them back into the simulation model to help minimize discrepancies between simulation and hardware domains, ultimately reducing the total development time. The developed system is a deterministic real time and low latency implementation as it does not rely on external off chip memory as all necessary buffering is done in the internal FPGA block RAM structures. The design is capable of processing <inline-formula> <tex-math notation="LaTeX">$752\times 480$ </tex-math></inline-formula> images at pixel line rates and is easily expandable to high resolution images. The algorithm being developed is not being touted as novel, rather that it is sufficiently complex in order to demonstrate the power of the Model Based Design tool flows.https://ieeexplore.ieee.org/document/10050520/Stereo visionFPGAlens undistortionrectificationmodel based design |
| spellingShingle | Daniel S. Kaputa Krystian A. Derhak Model Based Design of a Real Time FPGA-Based Lens Undistortion and Image Rectification Algorithm for Stereo Imaging IEEE Access Stereo vision FPGA lens undistortion rectification model based design |
| title | Model Based Design of a Real Time FPGA-Based Lens Undistortion and Image Rectification Algorithm for Stereo Imaging |
| title_full | Model Based Design of a Real Time FPGA-Based Lens Undistortion and Image Rectification Algorithm for Stereo Imaging |
| title_fullStr | Model Based Design of a Real Time FPGA-Based Lens Undistortion and Image Rectification Algorithm for Stereo Imaging |
| title_full_unstemmed | Model Based Design of a Real Time FPGA-Based Lens Undistortion and Image Rectification Algorithm for Stereo Imaging |
| title_short | Model Based Design of a Real Time FPGA-Based Lens Undistortion and Image Rectification Algorithm for Stereo Imaging |
| title_sort | model based design of a real time fpga based lens undistortion and image rectification algorithm for stereo imaging |
| topic | Stereo vision FPGA lens undistortion rectification model based design |
| url | https://ieeexplore.ieee.org/document/10050520/ |
| work_keys_str_mv | AT danielskaputa modelbaseddesignofarealtimefpgabasedlensundistortionandimagerectificationalgorithmforstereoimaging AT krystianaderhak modelbaseddesignofarealtimefpgabasedlensundistortionandimagerectificationalgorithmforstereoimaging |