Towards scale and position invariant task classification using normalised visual scanpaths in clinical fetal ultrasound
We present a method for classifying tasks in fetal ultrasound scans using the eye-tracking data of sonographers. The visual attention of a sonographer captured by eye-tracking data over time is defined by a scanpath. In routine fetal ultrasound, the captured standard imaging planes are visually inco...
| Main Authors: | , , , , |
|---|---|
| Format: | Conference item |
| Language: | English |
| Published: |
Springer
2021
|
| _version_ | 1797106925130743808 |
|---|---|
| author | Teng, C Sharma, H Drukker, L Papageorghiou, AT Noble, JA |
| author_facet | Teng, C Sharma, H Drukker, L Papageorghiou, AT Noble, JA |
| author_sort | Teng, C |
| collection | OXFORD |
| description | We present a method for classifying tasks in fetal ultrasound scans using the eye-tracking data of sonographers. The visual attention of a sonographer captured by eye-tracking data over time is defined by a scanpath. In routine fetal ultrasound, the captured standard imaging planes are visually inconsistent due to fetal position, movements, and sonographer scanning experience. To address this challenge, we propose a scale and position invariant task classification method using normalised visual scanpaths. We describe a normalisation method that uses bounding boxes to provide the gaze with a reference to the position and scale of the imaging plane and use the normalised scanpath sequences to train machine learning models for discriminating between ultrasound tasks. We compare the proposed method to existing work considering raw eye-tracking data. The best performing model achieves the F1-score of 84% and outperforms existing models. |
| first_indexed | 2024-03-07T07:09:25Z |
| format | Conference item |
| id | oxford-uuid:90be8f9c-0bd0-45d8-b532-d146b2de5a2f |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T07:09:25Z |
| publishDate | 2021 |
| publisher | Springer |
| record_format | dspace |
| spelling | oxford-uuid:90be8f9c-0bd0-45d8-b532-d146b2de5a2f2022-06-06T11:04:47ZTowards scale and position invariant task classification using normalised visual scanpaths in clinical fetal ultrasoundConference itemhttp://purl.org/coar/resource_type/c_5794uuid:90be8f9c-0bd0-45d8-b532-d146b2de5a2fEnglishSymplectic ElementsSpringer2021Teng, CSharma, HDrukker, LPapageorghiou, ATNoble, JAWe present a method for classifying tasks in fetal ultrasound scans using the eye-tracking data of sonographers. The visual attention of a sonographer captured by eye-tracking data over time is defined by a scanpath. In routine fetal ultrasound, the captured standard imaging planes are visually inconsistent due to fetal position, movements, and sonographer scanning experience. To address this challenge, we propose a scale and position invariant task classification method using normalised visual scanpaths. We describe a normalisation method that uses bounding boxes to provide the gaze with a reference to the position and scale of the imaging plane and use the normalised scanpath sequences to train machine learning models for discriminating between ultrasound tasks. We compare the proposed method to existing work considering raw eye-tracking data. The best performing model achieves the F1-score of 84% and outperforms existing models. |
| spellingShingle | Teng, C Sharma, H Drukker, L Papageorghiou, AT Noble, JA Towards scale and position invariant task classification using normalised visual scanpaths in clinical fetal ultrasound |
| title | Towards scale and position invariant task classification using normalised visual scanpaths in clinical fetal ultrasound |
| title_full | Towards scale and position invariant task classification using normalised visual scanpaths in clinical fetal ultrasound |
| title_fullStr | Towards scale and position invariant task classification using normalised visual scanpaths in clinical fetal ultrasound |
| title_full_unstemmed | Towards scale and position invariant task classification using normalised visual scanpaths in clinical fetal ultrasound |
| title_short | Towards scale and position invariant task classification using normalised visual scanpaths in clinical fetal ultrasound |
| title_sort | towards scale and position invariant task classification using normalised visual scanpaths in clinical fetal ultrasound |
| work_keys_str_mv | AT tengc towardsscaleandpositioninvarianttaskclassificationusingnormalisedvisualscanpathsinclinicalfetalultrasound AT sharmah towardsscaleandpositioninvarianttaskclassificationusingnormalisedvisualscanpathsinclinicalfetalultrasound AT drukkerl towardsscaleandpositioninvarianttaskclassificationusingnormalisedvisualscanpathsinclinicalfetalultrasound AT papageorghiouat towardsscaleandpositioninvarianttaskclassificationusingnormalisedvisualscanpathsinclinicalfetalultrasound AT nobleja towardsscaleandpositioninvarianttaskclassificationusingnormalisedvisualscanpathsinclinicalfetalultrasound |