Visual-Based Children and Pet Rescue from Suffocation and Incidence of Hyperthermia Death in Enclosed Vehicles
Over the past several years, many children have died from suffocation due to being left inside a closed vehicle on a sunny day. Various vehicle manufacturers have proposed a variety of technologies to locate an unattended child in a vehicle, including pressure sensors, passive infrared motion sensor...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-08-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/23/16/7025 |
| _version_ | 1827728736388120576 |
|---|---|
| author | Mona M. Moussa Rasha Shoitan Young-Im Cho Mohamed S. Abdallah |
| author_facet | Mona M. Moussa Rasha Shoitan Young-Im Cho Mohamed S. Abdallah |
| author_sort | Mona M. Moussa |
| collection | DOAJ |
| description | Over the past several years, many children have died from suffocation due to being left inside a closed vehicle on a sunny day. Various vehicle manufacturers have proposed a variety of technologies to locate an unattended child in a vehicle, including pressure sensors, passive infrared motion sensors, temperature sensors, and microwave sensors. However, these methods have not yet reliably located forgotten children in the vehicle. Recently, visual-based methods have taken the attention of manufacturers after the emergence of deep learning technology. However, the existing methods focus only on the forgotten child and neglect a forgotten pet. Furthermore, their systems only detect the presence of a child in the car with or without their parents. Therefore, this research introduces a visual-based framework to reduce hyperthermia deaths in enclosed vehicles. This visual-based system detects objects inside a vehicle; if the child or pet are without an adult, a notification is sent to the parents. First, a dataset is constructed for vehicle interiors containing children, pets, and adults. The proposed dataset is collected from different online sources, considering varying illumination, skin color, pet type, clothes, and car brands for guaranteed model robustness. Second, blurring, sharpening, brightness, contrast, noise, perspective transform, and fog effect augmentation algorithms are applied to these images to increase the training data. The augmented images are annotated with three classes: child, pet, and adult. This research concentrates on fine-tuning different state-of-the-art real-time detection models to detect objects inside the vehicle: NanoDet, YOLOv6_1, YOLOv6_3, and YOLO7. The simulation results demonstrate that YOLOv6_1 presents significant values with 96% recall, 95% precision, and 95% F1. |
| first_indexed | 2024-03-10T23:37:08Z |
| format | Article |
| id | doaj.art-f890d133a7da403b88eb5ef2b77b827b |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-10T23:37:08Z |
| publishDate | 2023-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-f890d133a7da403b88eb5ef2b77b827b2023-11-19T02:55:43ZengMDPI AGSensors1424-82202023-08-012316702510.3390/s23167025Visual-Based Children and Pet Rescue from Suffocation and Incidence of Hyperthermia Death in Enclosed VehiclesMona M. Moussa0Rasha Shoitan1Young-Im Cho2Mohamed S. Abdallah3Computer and Systems Department, Electronics Research Institute (ERI), Cairo 11843, EgyptComputer and Systems Department, Electronics Research Institute (ERI), Cairo 11843, EgyptDepartment of Computer Engineering, Gachon University, 1342 Seongnam-daero, Sujeong-gu, Seongnam 13415, Republic of KoreaInformatics Department, Electronics Research Institute (ERI), Cairo 11843, EgyptOver the past several years, many children have died from suffocation due to being left inside a closed vehicle on a sunny day. Various vehicle manufacturers have proposed a variety of technologies to locate an unattended child in a vehicle, including pressure sensors, passive infrared motion sensors, temperature sensors, and microwave sensors. However, these methods have not yet reliably located forgotten children in the vehicle. Recently, visual-based methods have taken the attention of manufacturers after the emergence of deep learning technology. However, the existing methods focus only on the forgotten child and neglect a forgotten pet. Furthermore, their systems only detect the presence of a child in the car with or without their parents. Therefore, this research introduces a visual-based framework to reduce hyperthermia deaths in enclosed vehicles. This visual-based system detects objects inside a vehicle; if the child or pet are without an adult, a notification is sent to the parents. First, a dataset is constructed for vehicle interiors containing children, pets, and adults. The proposed dataset is collected from different online sources, considering varying illumination, skin color, pet type, clothes, and car brands for guaranteed model robustness. Second, blurring, sharpening, brightness, contrast, noise, perspective transform, and fog effect augmentation algorithms are applied to these images to increase the training data. The augmented images are annotated with three classes: child, pet, and adult. This research concentrates on fine-tuning different state-of-the-art real-time detection models to detect objects inside the vehicle: NanoDet, YOLOv6_1, YOLOv6_3, and YOLO7. The simulation results demonstrate that YOLOv6_1 presents significant values with 96% recall, 95% precision, and 95% F1.https://www.mdpi.com/1424-8220/23/16/7025in-cabin monitoringchild in vehiclehyperthermiaNanoDetYOLO |
| spellingShingle | Mona M. Moussa Rasha Shoitan Young-Im Cho Mohamed S. Abdallah Visual-Based Children and Pet Rescue from Suffocation and Incidence of Hyperthermia Death in Enclosed Vehicles Sensors in-cabin monitoring child in vehicle hyperthermia NanoDet YOLO |
| title | Visual-Based Children and Pet Rescue from Suffocation and Incidence of Hyperthermia Death in Enclosed Vehicles |
| title_full | Visual-Based Children and Pet Rescue from Suffocation and Incidence of Hyperthermia Death in Enclosed Vehicles |
| title_fullStr | Visual-Based Children and Pet Rescue from Suffocation and Incidence of Hyperthermia Death in Enclosed Vehicles |
| title_full_unstemmed | Visual-Based Children and Pet Rescue from Suffocation and Incidence of Hyperthermia Death in Enclosed Vehicles |
| title_short | Visual-Based Children and Pet Rescue from Suffocation and Incidence of Hyperthermia Death in Enclosed Vehicles |
| title_sort | visual based children and pet rescue from suffocation and incidence of hyperthermia death in enclosed vehicles |
| topic | in-cabin monitoring child in vehicle hyperthermia NanoDet YOLO |
| url | https://www.mdpi.com/1424-8220/23/16/7025 |
| work_keys_str_mv | AT monammoussa visualbasedchildrenandpetrescuefromsuffocationandincidenceofhyperthermiadeathinenclosedvehicles AT rashashoitan visualbasedchildrenandpetrescuefromsuffocationandincidenceofhyperthermiadeathinenclosedvehicles AT youngimcho visualbasedchildrenandpetrescuefromsuffocationandincidenceofhyperthermiadeathinenclosedvehicles AT mohamedsabdallah visualbasedchildrenandpetrescuefromsuffocationandincidenceofhyperthermiadeathinenclosedvehicles |