Natural language processing for automatically creating radiological reports
Radiologists examine Computerised Tomography (CT) and Magnetic Resonance Imaging (MRI) scans to synthesise radiology reports. The process involves manual scrutiny of the scans and although TTS software is available, dictating them is strenuous. Additionally, the radiology reports produced may be sub...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2024
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/177378 |
| _version_ | 1826117615836200960 |
|---|---|
| author | Lim, Hermes HongJun |
| author2 | Jagath C Rajapakse |
| author_facet | Jagath C Rajapakse Lim, Hermes HongJun |
| author_sort | Lim, Hermes HongJun |
| collection | NTU |
| description | Radiologists examine Computerised Tomography (CT) and Magnetic Resonance Imaging (MRI) scans to synthesise radiology reports. The process involves manual scrutiny of the scans and although TTS software is available, dictating them is strenuous. Additionally, the radiology reports produced may be subjective depending on the radiologist’s findings. By leveraging existing computer vision models that offer segmentation results for brain volume, we can utilise them to enhance radiological reports by incorporating objective quantification of lesion volumes of the brain.
We introduce RadMix, a large language model for radiology that automatically generates the finding section of a radiological report alongside volumetric values of the brain. Through fine tuning of our dataset obtained from MIMIC-III alongside brain volumetric data from HCP, RadMix demonstrates the ability to automatically generate the findings section of a radiology report. It displays how the integration of Natural Language Processing and Computer Vision can further enhance the future of radiology. The successful implementation of RadMix can greatly aid radiologists in the daily tasks of generating a report as the process of writing a radiology report can be labour intensive. The development of a simple toolkit built alongside RadMix provides an avenue for medical professionals to have access to such models to cater to their needs. RadMix aims to simplify the process of writing radiology reports by providing an automated generation of the report to aid junior radiologists during their crafting of the radiology reports. Furthermore, RadMix is a novel model that adds in relevant volumetric brain data in the CT brain scan radiology reports which is a feature of RadMix that is not offered currently. The synthesis of our toolkit and RadMix seeks to cultivate the prospects of AI in healthcare and directly benefit the radiologists’ work. |
| first_indexed | 2024-10-01T04:30:11Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/177378 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T04:30:11Z |
| publishDate | 2024 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1773782024-05-31T15:38:24Z Natural language processing for automatically creating radiological reports Lim, Hermes HongJun Jagath C Rajapakse School of Computer Science and Engineering ASJagath@ntu.edu.sg Computer and Information Science Radiologists examine Computerised Tomography (CT) and Magnetic Resonance Imaging (MRI) scans to synthesise radiology reports. The process involves manual scrutiny of the scans and although TTS software is available, dictating them is strenuous. Additionally, the radiology reports produced may be subjective depending on the radiologist’s findings. By leveraging existing computer vision models that offer segmentation results for brain volume, we can utilise them to enhance radiological reports by incorporating objective quantification of lesion volumes of the brain. We introduce RadMix, a large language model for radiology that automatically generates the finding section of a radiological report alongside volumetric values of the brain. Through fine tuning of our dataset obtained from MIMIC-III alongside brain volumetric data from HCP, RadMix demonstrates the ability to automatically generate the findings section of a radiology report. It displays how the integration of Natural Language Processing and Computer Vision can further enhance the future of radiology. The successful implementation of RadMix can greatly aid radiologists in the daily tasks of generating a report as the process of writing a radiology report can be labour intensive. The development of a simple toolkit built alongside RadMix provides an avenue for medical professionals to have access to such models to cater to their needs. RadMix aims to simplify the process of writing radiology reports by providing an automated generation of the report to aid junior radiologists during their crafting of the radiology reports. Furthermore, RadMix is a novel model that adds in relevant volumetric brain data in the CT brain scan radiology reports which is a feature of RadMix that is not offered currently. The synthesis of our toolkit and RadMix seeks to cultivate the prospects of AI in healthcare and directly benefit the radiologists’ work. Bachelor's degree 2024-05-28T11:24:03Z 2024-05-28T11:24:03Z 2024 Final Year Project (FYP) Lim, H. H. (2024). Natural language processing for automatically creating radiological reports. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/177378 https://hdl.handle.net/10356/177378 en 0552 application/pdf Nanyang Technological University |
| spellingShingle | Computer and Information Science Lim, Hermes HongJun Natural language processing for automatically creating radiological reports |
| title | Natural language processing for automatically creating radiological reports |
| title_full | Natural language processing for automatically creating radiological reports |
| title_fullStr | Natural language processing for automatically creating radiological reports |
| title_full_unstemmed | Natural language processing for automatically creating radiological reports |
| title_short | Natural language processing for automatically creating radiological reports |
| title_sort | natural language processing for automatically creating radiological reports |
| topic | Computer and Information Science |
| url | https://hdl.handle.net/10356/177378 |
| work_keys_str_mv | AT limhermeshongjun naturallanguageprocessingforautomaticallycreatingradiologicalreports |