End-to-end baggage damage detection system with photogrammetry
Handling damaged baggage cases is a highly frustrating experience for not only passengers but also airline staff. Beyond frustration, damaged baggage cases give rise to a significant cost to airlines every single year. In 2019 alone, there were more than 5 million damaged baggage cases worldwide and...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2021
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/149571 |
| _version_ | 1811681292212764672 |
|---|---|
| author | Gracia, Stella |
| author2 | Yap Kim Hui |
| author_facet | Yap Kim Hui Gracia, Stella |
| author_sort | Gracia, Stella |
| collection | NTU |
| description | Handling damaged baggage cases is a highly frustrating experience for not only passengers but also airline staff. Beyond frustration, damaged baggage cases give rise to a significant cost to airlines every single year. In 2019 alone, there were more than 5 million damaged baggage cases worldwide and these cases cost more than $500 million of compensation cost.
Currently, damaged baggage cases are handled manually by airline staff. This process is highly subjective as staff often are not sure if the damage is claimable. Some airlines also adopt technology-based solutions which include performing image classification on damaged baggage. While this solution allows the identification of damage to be automated, it is challenging to capture the full body of the baggage and thus some damage might not be captured. To address these issues, this project proposes an end-to-end baggage damage detection system with photogrammetry, named CheckBox.
In the CheckBox system, two sets of videos of baggage are taken – one at departure and one at arrival. Images of the baggage will then be sampled from the videos. These images will then be stitched together with the photogrammetry technique to produce two 3D models of the baggage – one from departure and one from arrival. With a comparison algorithm, the Hausdorff distance of the two 3D models will then be computed and a damage heatmap will be generated. This metric will also be used to classify if the baggage is heavily damaged, slightly damaged, or not damaged. This classification serves as a preliminary precursor for staff to identify and prioritize urgent cases. With this approach, the damages detected are only the ones that are caused by the airline in between departure and arrival. After the backend computation is done, the information of the baggage is then passed to a web application developed with React framework. This is where airline staff can access the baggage database.
The CheckBox system advances current solutions to baggage damage detection by providing a fully automated system that is able to detect damages on the full body of the baggage. The unique selling propositions of this system include its nature to be fully automated while using deterministic approaches as well as its ability to be seamlessly integrated with the current airport ecosystem. |
| first_indexed | 2024-10-01T03:38:37Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/149571 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T03:38:37Z |
| publishDate | 2021 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1495712023-07-07T18:30:47Z End-to-end baggage damage detection system with photogrammetry Gracia, Stella Yap Kim Hui School of Electrical and Electronic Engineering EKHYap@ntu.edu.sg Engineering::Electrical and electronic engineering::Computer hardware, software and systems Handling damaged baggage cases is a highly frustrating experience for not only passengers but also airline staff. Beyond frustration, damaged baggage cases give rise to a significant cost to airlines every single year. In 2019 alone, there were more than 5 million damaged baggage cases worldwide and these cases cost more than $500 million of compensation cost. Currently, damaged baggage cases are handled manually by airline staff. This process is highly subjective as staff often are not sure if the damage is claimable. Some airlines also adopt technology-based solutions which include performing image classification on damaged baggage. While this solution allows the identification of damage to be automated, it is challenging to capture the full body of the baggage and thus some damage might not be captured. To address these issues, this project proposes an end-to-end baggage damage detection system with photogrammetry, named CheckBox. In the CheckBox system, two sets of videos of baggage are taken – one at departure and one at arrival. Images of the baggage will then be sampled from the videos. These images will then be stitched together with the photogrammetry technique to produce two 3D models of the baggage – one from departure and one from arrival. With a comparison algorithm, the Hausdorff distance of the two 3D models will then be computed and a damage heatmap will be generated. This metric will also be used to classify if the baggage is heavily damaged, slightly damaged, or not damaged. This classification serves as a preliminary precursor for staff to identify and prioritize urgent cases. With this approach, the damages detected are only the ones that are caused by the airline in between departure and arrival. After the backend computation is done, the information of the baggage is then passed to a web application developed with React framework. This is where airline staff can access the baggage database. The CheckBox system advances current solutions to baggage damage detection by providing a fully automated system that is able to detect damages on the full body of the baggage. The unique selling propositions of this system include its nature to be fully automated while using deterministic approaches as well as its ability to be seamlessly integrated with the current airport ecosystem. Bachelor of Engineering (Electrical and Electronic Engineering) 2021-05-31T01:43:23Z 2021-05-31T01:43:23Z 2021 Final Year Project (FYP) Gracia, S. (2021). End-to-end baggage damage detection system with photogrammetry. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/149571 https://hdl.handle.net/10356/149571 en A3304-201 application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Electrical and electronic engineering::Computer hardware, software and systems Gracia, Stella End-to-end baggage damage detection system with photogrammetry |
| title | End-to-end baggage damage detection system with photogrammetry |
| title_full | End-to-end baggage damage detection system with photogrammetry |
| title_fullStr | End-to-end baggage damage detection system with photogrammetry |
| title_full_unstemmed | End-to-end baggage damage detection system with photogrammetry |
| title_short | End-to-end baggage damage detection system with photogrammetry |
| title_sort | end to end baggage damage detection system with photogrammetry |
| topic | Engineering::Electrical and electronic engineering::Computer hardware, software and systems |
| url | https://hdl.handle.net/10356/149571 |
| work_keys_str_mv | AT graciastella endtoendbaggagedamagedetectionsystemwithphotogrammetry |