Enabling Actionable Maintenance Analytics with Ontology-driven Natural Language Processing
Asset maintenance is a crucial aspect of biomanufacturing operations, with significant associated costs. To mitigate these expenses, companies are increasingly adopting predictive maintenance approaches that leverage data to identify potential equipment issues before they arise. Maintenance work ord...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2023
|
| Online Access: | https://hdl.handle.net/1721.1/151708 https://orcid.org/0009-0009-1455-7153 |
| _version_ | 1826190992943874048 |
|---|---|
| author | Pascualy, Gabriel |
| author2 | Hardt, David |
| author_facet | Hardt, David Pascualy, Gabriel |
| author_sort | Pascualy, Gabriel |
| collection | MIT |
| description | Asset maintenance is a crucial aspect of biomanufacturing operations, with significant associated costs. To mitigate these expenses, companies are increasingly adopting predictive maintenance approaches that leverage data to identify potential equipment issues before they arise. Maintenance work orders (MWOs) are essential tools for planning, scheduling, and tracking maintenance tasks. Although MWOs contain explicit ontologies with structured fields for information like costs, identifiers, and dates, valuable maintenance details are often stored in unstructured text fields. These fields include work descriptions, troubleshooting information, and completed work summaries. While the unstructured text generally contains an implicit ontology, such as a shared vocabulary and references to externally documented system hierarchies, automatically extracting insights is currently infeasible, necessitating manual analysis by engineers—a process that is not cost-effective at scale.
This project aims to develop an ontology that integrates the explicit and implicit maintenance ontologies found at Amgen, as well as a natural language processing (NLP) tool for reconstructing this unified ontology from MWOs' structured and unstructured fields. By utilizing this unified ontology and NLP tool, we seek to explore the limitations of a post-processing NLP solution and pinpoint future research areas with the potential to enhance downstream analytics.
For each MWO, our tool identifies the maintained assets and their corresponding components, classifies the rationale behind the work order generation, and assigns the problem, cause, and remedy associated with each component.
Tested on a sample of 50 manually labeled MWOs covering maintenance of 188 assets, our tool achieved the following F1 scores across each category: 0.83 for failed assets, 0.46 for rationale, 0.62 for failed components, 0.58 for problems, 0.76 for causes, and 0.62 for remedies. The low F1 scores in some categories can be attributed to the missing context that is normally inferred by a reliability engineer during manual analysis. Despite these limitations, we provided recommendations for extending the explicit ontology to enhance performance and identified maintenance documentation enhancements as a potential area of future research.
Furthermore, we employed the tool to examine 1000 leak records, showcasing the significance of a unified ontology in generating accurate baselines. Overall, our findings suggest that the analytics generated by this tool could substantially reduce the time engineers spend analyzing work order data, offering unprecedented insights into plant maintenance operations. |
| first_indexed | 2024-09-23T08:48:44Z |
| format | Thesis |
| id | mit-1721.1/151708 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T08:48:44Z |
| publishDate | 2023 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1517082023-08-01T04:16:58Z Enabling Actionable Maintenance Analytics with Ontology-driven Natural Language Processing Pascualy, Gabriel Hardt, David Welsch, Roy E. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Sloan School of Management Asset maintenance is a crucial aspect of biomanufacturing operations, with significant associated costs. To mitigate these expenses, companies are increasingly adopting predictive maintenance approaches that leverage data to identify potential equipment issues before they arise. Maintenance work orders (MWOs) are essential tools for planning, scheduling, and tracking maintenance tasks. Although MWOs contain explicit ontologies with structured fields for information like costs, identifiers, and dates, valuable maintenance details are often stored in unstructured text fields. These fields include work descriptions, troubleshooting information, and completed work summaries. While the unstructured text generally contains an implicit ontology, such as a shared vocabulary and references to externally documented system hierarchies, automatically extracting insights is currently infeasible, necessitating manual analysis by engineers—a process that is not cost-effective at scale. This project aims to develop an ontology that integrates the explicit and implicit maintenance ontologies found at Amgen, as well as a natural language processing (NLP) tool for reconstructing this unified ontology from MWOs' structured and unstructured fields. By utilizing this unified ontology and NLP tool, we seek to explore the limitations of a post-processing NLP solution and pinpoint future research areas with the potential to enhance downstream analytics. For each MWO, our tool identifies the maintained assets and their corresponding components, classifies the rationale behind the work order generation, and assigns the problem, cause, and remedy associated with each component. Tested on a sample of 50 manually labeled MWOs covering maintenance of 188 assets, our tool achieved the following F1 scores across each category: 0.83 for failed assets, 0.46 for rationale, 0.62 for failed components, 0.58 for problems, 0.76 for causes, and 0.62 for remedies. The low F1 scores in some categories can be attributed to the missing context that is normally inferred by a reliability engineer during manual analysis. Despite these limitations, we provided recommendations for extending the explicit ontology to enhance performance and identified maintenance documentation enhancements as a potential area of future research. Furthermore, we employed the tool to examine 1000 leak records, showcasing the significance of a unified ontology in generating accurate baselines. Overall, our findings suggest that the analytics generated by this tool could substantially reduce the time engineers spend analyzing work order data, offering unprecedented insights into plant maintenance operations. M.B.A. S.M. 2023-07-31T20:00:52Z 2023-07-31T20:00:52Z 2023-06 2023-07-14T20:00:01.459Z Thesis https://hdl.handle.net/1721.1/151708 https://orcid.org/0009-0009-1455-7153 In Copyright - Educational Use Permitted Copyright retained by author(s) https://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | Pascualy, Gabriel Enabling Actionable Maintenance Analytics with Ontology-driven Natural Language Processing |
| title | Enabling Actionable Maintenance Analytics with Ontology-driven Natural Language Processing |
| title_full | Enabling Actionable Maintenance Analytics with Ontology-driven Natural Language Processing |
| title_fullStr | Enabling Actionable Maintenance Analytics with Ontology-driven Natural Language Processing |
| title_full_unstemmed | Enabling Actionable Maintenance Analytics with Ontology-driven Natural Language Processing |
| title_short | Enabling Actionable Maintenance Analytics with Ontology-driven Natural Language Processing |
| title_sort | enabling actionable maintenance analytics with ontology driven natural language processing |
| url | https://hdl.handle.net/1721.1/151708 https://orcid.org/0009-0009-1455-7153 |
| work_keys_str_mv | AT pascualygabriel enablingactionablemaintenanceanalyticswithontologydrivennaturallanguageprocessing |