Dimensionality reduction to improve search time and memory footprint in content-retrieval tasks: Application to semiconductor inspection images
Quality control in semiconductors is a crucial step to produce high quality microchips. During the last years, advances in artificial vision have significantly improved image quality control techniques. In the semiconductor industry, automated visual inspection is fundamental to avoid human interven...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2022-11-01
|
| Series: | Advances in Industrial and Manufacturing Engineering |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2666912922000241 |
| _version_ | 1798033020058337280 |
|---|---|
| author | Thomas Vial Farah Dhouib Louison Roger Annabelle Blangero Frédéric Duvivier Karim Sayadi Marisa N. Faraggi |
| author_facet | Thomas Vial Farah Dhouib Louison Roger Annabelle Blangero Frédéric Duvivier Karim Sayadi Marisa N. Faraggi |
| author_sort | Thomas Vial |
| collection | DOAJ |
| description | Quality control in semiconductors is a crucial step to produce high quality microchips. During the last years, advances in artificial vision have significantly improved image quality control techniques. In the semiconductor industry, automated visual inspection is fundamental to avoid human intervention and keep the pipeline sanitized. Different types of images are collected during this process, feeding image databases that continually grow and cannot be labelled by humans in an exhaustive manner. Advances in image retrieval search methods are fundamental to develop more efficient techniques that meet user requirements.In this work we propose a dimensionality reduction approach on the feature vectors computed by a classifying deep learning model, while keeping a high retrieval performance. To validate this technique, we evaluate four well-known reduction algorithms on a subset of the full database: Principal Component Analysis (PCA), Sparse Random Projection (SRP), Isomap, Locally Linear Embedding (LLE), in combination with three similarity metrics: Euclidian (L2), cosine and inner product. As the number of components of the vectors is reduced, the performance of the image retrieval is measured by recall, time to search, and memory footprint of the database.PCA offers the best results, allowing a significant reduction in search time and memory usage, while SRP becomes an option only when the cosine distance is used. With PCA, we were able to divide the memory footprint by a factor of 16, the search time by 6, while maintaining an average recall of 0.96. |
| first_indexed | 2024-04-11T20:22:27Z |
| format | Article |
| id | doaj.art-1dbb7eafe99548a893cbe794d1921fad |
| institution | Directory Open Access Journal |
| issn | 2666-9129 |
| language | English |
| last_indexed | 2024-04-11T20:22:27Z |
| publishDate | 2022-11-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Advances in Industrial and Manufacturing Engineering |
| spelling | doaj.art-1dbb7eafe99548a893cbe794d1921fad2022-12-22T04:04:46ZengElsevierAdvances in Industrial and Manufacturing Engineering2666-91292022-11-015100097Dimensionality reduction to improve search time and memory footprint in content-retrieval tasks: Application to semiconductor inspection imagesThomas Vial0Farah Dhouib1Louison Roger2Annabelle Blangero3Frédéric Duvivier4Karim Sayadi5Marisa N. Faraggi6Corresponding author.; OCTO Technology, 34, avenue de l’Opéra, 75002 Paris, FranceOCTO Technology, 34, avenue de l’Opéra, 75002 Paris, FranceOCTO Technology, 34, avenue de l’Opéra, 75002 Paris, FranceOCTO Technology, 34, avenue de l’Opéra, 75002 Paris, FranceOCTO Technology, 34, avenue de l’Opéra, 75002 Paris, FranceOCTO Technology, 34, avenue de l’Opéra, 75002 Paris, FranceOCTO Technology, 34, avenue de l’Opéra, 75002 Paris, FranceQuality control in semiconductors is a crucial step to produce high quality microchips. During the last years, advances in artificial vision have significantly improved image quality control techniques. In the semiconductor industry, automated visual inspection is fundamental to avoid human intervention and keep the pipeline sanitized. Different types of images are collected during this process, feeding image databases that continually grow and cannot be labelled by humans in an exhaustive manner. Advances in image retrieval search methods are fundamental to develop more efficient techniques that meet user requirements.In this work we propose a dimensionality reduction approach on the feature vectors computed by a classifying deep learning model, while keeping a high retrieval performance. To validate this technique, we evaluate four well-known reduction algorithms on a subset of the full database: Principal Component Analysis (PCA), Sparse Random Projection (SRP), Isomap, Locally Linear Embedding (LLE), in combination with three similarity metrics: Euclidian (L2), cosine and inner product. As the number of components of the vectors is reduced, the performance of the image retrieval is measured by recall, time to search, and memory footprint of the database.PCA offers the best results, allowing a significant reduction in search time and memory usage, while SRP becomes an option only when the cosine distance is used. With PCA, we were able to divide the memory footprint by a factor of 16, the search time by 6, while maintaining an average recall of 0.96.http://www.sciencedirect.com/science/article/pii/S2666912922000241Semiconductor manufacturingDefectivity analysisImage retrievalSimilarity searchDimensionality ReductionPrincipal Component Analysis (PCA) |
| spellingShingle | Thomas Vial Farah Dhouib Louison Roger Annabelle Blangero Frédéric Duvivier Karim Sayadi Marisa N. Faraggi Dimensionality reduction to improve search time and memory footprint in content-retrieval tasks: Application to semiconductor inspection images Advances in Industrial and Manufacturing Engineering Semiconductor manufacturing Defectivity analysis Image retrieval Similarity search Dimensionality Reduction Principal Component Analysis (PCA) |
| title | Dimensionality reduction to improve search time and memory footprint in content-retrieval tasks: Application to semiconductor inspection images |
| title_full | Dimensionality reduction to improve search time and memory footprint in content-retrieval tasks: Application to semiconductor inspection images |
| title_fullStr | Dimensionality reduction to improve search time and memory footprint in content-retrieval tasks: Application to semiconductor inspection images |
| title_full_unstemmed | Dimensionality reduction to improve search time and memory footprint in content-retrieval tasks: Application to semiconductor inspection images |
| title_short | Dimensionality reduction to improve search time and memory footprint in content-retrieval tasks: Application to semiconductor inspection images |
| title_sort | dimensionality reduction to improve search time and memory footprint in content retrieval tasks application to semiconductor inspection images |
| topic | Semiconductor manufacturing Defectivity analysis Image retrieval Similarity search Dimensionality Reduction Principal Component Analysis (PCA) |
| url | http://www.sciencedirect.com/science/article/pii/S2666912922000241 |
| work_keys_str_mv | AT thomasvial dimensionalityreductiontoimprovesearchtimeandmemoryfootprintincontentretrievaltasksapplicationtosemiconductorinspectionimages AT farahdhouib dimensionalityreductiontoimprovesearchtimeandmemoryfootprintincontentretrievaltasksapplicationtosemiconductorinspectionimages AT louisonroger dimensionalityreductiontoimprovesearchtimeandmemoryfootprintincontentretrievaltasksapplicationtosemiconductorinspectionimages AT annabelleblangero dimensionalityreductiontoimprovesearchtimeandmemoryfootprintincontentretrievaltasksapplicationtosemiconductorinspectionimages AT fredericduvivier dimensionalityreductiontoimprovesearchtimeandmemoryfootprintincontentretrievaltasksapplicationtosemiconductorinspectionimages AT karimsayadi dimensionalityreductiontoimprovesearchtimeandmemoryfootprintincontentretrievaltasksapplicationtosemiconductorinspectionimages AT marisanfaraggi dimensionalityreductiontoimprovesearchtimeandmemoryfootprintincontentretrievaltasksapplicationtosemiconductorinspectionimages |