Automated determination of bubble grades from Doppler ultrasound recordings.

INTRODUCTION: One of the difficulties in the development of automated algorithms for the detection of bubbles in Doppler ultrasound recordings is that expert labels are only available on an aggregate basis, i.e., the expert provides a single label for a recording which may contain many bubbles. It...

Full description

Bibliographic Details
Main Authors: Payne, S, Chappell, M
Format: Journal article
Language:English
Published: 2005
_version_ 1797081824543899648
author Payne, S
Chappell, M
author_facet Payne, S
Chappell, M
author_sort Payne, S
collection OXFORD
description INTRODUCTION: One of the difficulties in the development of automated algorithms for the detection of bubbles in Doppler ultrasound recordings is that expert labels are only available on an aggregate basis, i.e., the expert provides a single label for a recording which may contain many bubbles. It is thus very difficult to determine whether an algorithm is correctly identifying the actual bubbles or simply identifying the correct number of events, but mislabeling some events that are not due to bubbles. METHODS: The analysis presented here shows that the classification probabilities for the detection of bubble events and other artifacts can be determined if a large number of recordings are available. DISCUSSION: Using a half-integer scoring system from 0-4 gives a bias of approximately 1-2% and a standard deviation that varies with the number of event sequences available, dropping from approximately 7.5% for 100 60-s recordings to 3% for 1000 60-s recordings. These values are larger if an integer scoring system is used, but using a scale finer than half-integers confers no extra benefit due to the fact that the expert labels the whole recording rather than individual bubbles. CONCLUSIONS: It is thus possible to estimate the classification probabilities with a reasonably high degree of accuracy, but difficult to show that one bubble detection algorithm is superior to another to any degree of statistical significance. Expert labels can be used to validate, but not to compare the performance of bubble detection algorithms.
first_indexed 2024-03-07T01:19:30Z
format Journal article
id oxford-uuid:8fdc67a1-096c-4f27-82b2-2472d541c944
institution University of Oxford
language English
last_indexed 2024-03-07T01:19:30Z
publishDate 2005
record_format dspace
spelling oxford-uuid:8fdc67a1-096c-4f27-82b2-2472d541c9442022-03-26T23:07:19ZAutomated determination of bubble grades from Doppler ultrasound recordings.Journal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:8fdc67a1-096c-4f27-82b2-2472d541c944EnglishSymplectic Elements at Oxford2005Payne, SChappell, M INTRODUCTION: One of the difficulties in the development of automated algorithms for the detection of bubbles in Doppler ultrasound recordings is that expert labels are only available on an aggregate basis, i.e., the expert provides a single label for a recording which may contain many bubbles. It is thus very difficult to determine whether an algorithm is correctly identifying the actual bubbles or simply identifying the correct number of events, but mislabeling some events that are not due to bubbles. METHODS: The analysis presented here shows that the classification probabilities for the detection of bubble events and other artifacts can be determined if a large number of recordings are available. DISCUSSION: Using a half-integer scoring system from 0-4 gives a bias of approximately 1-2% and a standard deviation that varies with the number of event sequences available, dropping from approximately 7.5% for 100 60-s recordings to 3% for 1000 60-s recordings. These values are larger if an integer scoring system is used, but using a scale finer than half-integers confers no extra benefit due to the fact that the expert labels the whole recording rather than individual bubbles. CONCLUSIONS: It is thus possible to estimate the classification probabilities with a reasonably high degree of accuracy, but difficult to show that one bubble detection algorithm is superior to another to any degree of statistical significance. Expert labels can be used to validate, but not to compare the performance of bubble detection algorithms.
spellingShingle Payne, S
Chappell, M
Automated determination of bubble grades from Doppler ultrasound recordings.
title Automated determination of bubble grades from Doppler ultrasound recordings.
title_full Automated determination of bubble grades from Doppler ultrasound recordings.
title_fullStr Automated determination of bubble grades from Doppler ultrasound recordings.
title_full_unstemmed Automated determination of bubble grades from Doppler ultrasound recordings.
title_short Automated determination of bubble grades from Doppler ultrasound recordings.
title_sort automated determination of bubble grades from doppler ultrasound recordings
work_keys_str_mv AT paynes automateddeterminationofbubblegradesfromdopplerultrasoundrecordings
AT chappellm automateddeterminationofbubblegradesfromdopplerultrasoundrecordings