Conquering the challenge of reliability: text mining to map trends in reliability engineering literature

Reliability engineering faces many of the same challenges in 2023 that it did at its inception in the 1950s. The fundamental issue remains uncertainty in system representation, specifically related to performance model structure and parametrization. Details of a design are unavailable early in the d...

Full description

Bibliographic Details
Main Author: Brown, Charles K.
Other Authors: Cameron, Bruce G.
Format: Thesis
Published: Massachusetts Institute of Technology 2023
Online Access:https://hdl.handle.net/1721.1/151303
_version_ 1826204401959698432
author Brown, Charles K.
author2 Cameron, Bruce G.
author_facet Cameron, Bruce G.
Brown, Charles K.
author_sort Brown, Charles K.
collection MIT
description Reliability engineering faces many of the same challenges in 2023 that it did at its inception in the 1950s. The fundamental issue remains uncertainty in system representation, specifically related to performance model structure and parametrization. Details of a design are unavailable early in the development process and therefore performance models must either account for the range of possibilities or be wrong. Increasing system complexity has compounded this uncertainty. In this work, we seek to understand how reliability engineering literature has changed over time with the assumption that the focus of literature shifts in part due to challenges in the field. Illuminating this change provides reliability practitioners guidance for what they can do in the face of growing complexity. We build this understanding by executing a systematic literature review of 30,543 reliability engineering papers. Topic modeling was performed on the abstracts of those papers to identify 279 topics. Hierarchical topic reduction resulted in the identification of 8 top-level method topics (prognostics, statistics, maintenance, quality control, management, physics of failure, modeling, and risk assessment) as well as 3 domain-specific topics (nuclear, infrastructure, and software). We found that topics more associated with later phases in the development process (such as prognostics, maintenance, and quality control) have increased in popularity over time relative to other topics. We propose that this is a response to the challenges posed by the previously-discussed model uncertainty and increasing complexity. Through zero-shot classification by a large language model, we also found that papers are including more practical examples or case studies and that those topics associated with later phases typically include more practical examples. Thus, while reliability remains fundamentally difficult to predict early in the development process, the field has shifted focus to later-stage and more applicable activities.
first_indexed 2024-09-23T12:54:30Z
format Thesis
id mit-1721.1/151303
institution Massachusetts Institute of Technology
last_indexed 2024-09-23T12:54:30Z
publishDate 2023
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/1513032023-08-01T03:42:52Z Conquering the challenge of reliability: text mining to map trends in reliability engineering literature Brown, Charles K. Cameron, Bruce G. System Design and Management Program. Reliability engineering faces many of the same challenges in 2023 that it did at its inception in the 1950s. The fundamental issue remains uncertainty in system representation, specifically related to performance model structure and parametrization. Details of a design are unavailable early in the development process and therefore performance models must either account for the range of possibilities or be wrong. Increasing system complexity has compounded this uncertainty. In this work, we seek to understand how reliability engineering literature has changed over time with the assumption that the focus of literature shifts in part due to challenges in the field. Illuminating this change provides reliability practitioners guidance for what they can do in the face of growing complexity. We build this understanding by executing a systematic literature review of 30,543 reliability engineering papers. Topic modeling was performed on the abstracts of those papers to identify 279 topics. Hierarchical topic reduction resulted in the identification of 8 top-level method topics (prognostics, statistics, maintenance, quality control, management, physics of failure, modeling, and risk assessment) as well as 3 domain-specific topics (nuclear, infrastructure, and software). We found that topics more associated with later phases in the development process (such as prognostics, maintenance, and quality control) have increased in popularity over time relative to other topics. We propose that this is a response to the challenges posed by the previously-discussed model uncertainty and increasing complexity. Through zero-shot classification by a large language model, we also found that papers are including more practical examples or case studies and that those topics associated with later phases typically include more practical examples. Thus, while reliability remains fundamentally difficult to predict early in the development process, the field has shifted focus to later-stage and more applicable activities. S.M. 2023-07-31T19:29:55Z 2023-07-31T19:29:55Z 2023-06 2023-06-23T19:53:50.489Z Thesis https://hdl.handle.net/1721.1/151303 Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) Copyright retained by author(s) https://creativecommons.org/licenses/by-sa/4.0/ application/pdf Massachusetts Institute of Technology
spellingShingle Brown, Charles K.
Conquering the challenge of reliability: text mining to map trends in reliability engineering literature
title Conquering the challenge of reliability: text mining to map trends in reliability engineering literature
title_full Conquering the challenge of reliability: text mining to map trends in reliability engineering literature
title_fullStr Conquering the challenge of reliability: text mining to map trends in reliability engineering literature
title_full_unstemmed Conquering the challenge of reliability: text mining to map trends in reliability engineering literature
title_short Conquering the challenge of reliability: text mining to map trends in reliability engineering literature
title_sort conquering the challenge of reliability text mining to map trends in reliability engineering literature
url https://hdl.handle.net/1721.1/151303
work_keys_str_mv AT browncharlesk conqueringthechallengeofreliabilitytextminingtomaptrendsinreliabilityengineeringliterature