Beta Upper Confidence Bound Policy for the Design of Clinical Trials
The multi-armed bandit problem is a classic example of the exploration-exploitation trade-off well suited to model sequential resource allocation under uncertainty. One of its typical motivating applications is the adaptive designs in clinical trials which modify the trial's course in accordan...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
Austrian Statistical Society
2023-08-01
|
Series: | Austrian Journal of Statistics |
Online Access: | https://www.ajs.or.at/index.php/ajs/article/view/1751 |
_version_ | 1797735747529211904 |
---|---|
author | Andrii Dzhoha Iryna Rozora |
author_facet | Andrii Dzhoha Iryna Rozora |
author_sort | Andrii Dzhoha |
collection | DOAJ |
description |
The multi-armed bandit problem is a classic example of the exploration-exploitation trade-off well suited to model sequential resource allocation under uncertainty. One of its typical motivating applications is the adaptive designs in clinical trials which modify the trial's course in accordance with the pre-specified objective by utilizing results accumulating in the trial. Since the response to a procedure in clinical trials is not immediate, the multi-armed bandit policies require adaptation to delays to retain their theoretical guarantees. In this work, we show the importance of such adaptation by evaluating policies using the publicly available dataset
The International Stroke Trial of a randomized trial of aspirin and subcutaneous heparin among 19,435 patients with acute ischaemic stroke. In addition to adapted policies, we analyze the Upper Confidence Bound policy with the beta feedback to mitigate delays when the certainty evidence of successful treatment is available in a relatively short-term period after the procedure.
|
first_indexed | 2024-03-12T13:03:35Z |
format | Article |
id | doaj.art-8231b40ad7a64bed9fb49c2e25344659 |
institution | Directory Open Access Journal |
issn | 1026-597X |
language | English |
last_indexed | 2024-03-12T13:03:35Z |
publishDate | 2023-08-01 |
publisher | Austrian Statistical Society |
record_format | Article |
series | Austrian Journal of Statistics |
spelling | doaj.art-8231b40ad7a64bed9fb49c2e253446592023-08-28T18:34:39ZengAustrian Statistical SocietyAustrian Journal of Statistics1026-597X2023-08-0152SI10.17713/ajs.v52iSI.1751Beta Upper Confidence Bound Policy for the Design of Clinical TrialsAndrii DzhohaIryna Rozora The multi-armed bandit problem is a classic example of the exploration-exploitation trade-off well suited to model sequential resource allocation under uncertainty. One of its typical motivating applications is the adaptive designs in clinical trials which modify the trial's course in accordance with the pre-specified objective by utilizing results accumulating in the trial. Since the response to a procedure in clinical trials is not immediate, the multi-armed bandit policies require adaptation to delays to retain their theoretical guarantees. In this work, we show the importance of such adaptation by evaluating policies using the publicly available dataset The International Stroke Trial of a randomized trial of aspirin and subcutaneous heparin among 19,435 patients with acute ischaemic stroke. In addition to adapted policies, we analyze the Upper Confidence Bound policy with the beta feedback to mitigate delays when the certainty evidence of successful treatment is available in a relatively short-term period after the procedure. https://www.ajs.or.at/index.php/ajs/article/view/1751 |
spellingShingle | Andrii Dzhoha Iryna Rozora Beta Upper Confidence Bound Policy for the Design of Clinical Trials Austrian Journal of Statistics |
title | Beta Upper Confidence Bound Policy for the Design of Clinical Trials |
title_full | Beta Upper Confidence Bound Policy for the Design of Clinical Trials |
title_fullStr | Beta Upper Confidence Bound Policy for the Design of Clinical Trials |
title_full_unstemmed | Beta Upper Confidence Bound Policy for the Design of Clinical Trials |
title_short | Beta Upper Confidence Bound Policy for the Design of Clinical Trials |
title_sort | beta upper confidence bound policy for the design of clinical trials |
url | https://www.ajs.or.at/index.php/ajs/article/view/1751 |
work_keys_str_mv | AT andriidzhoha betaupperconfidenceboundpolicyforthedesignofclinicaltrials AT irynarozora betaupperconfidenceboundpolicyforthedesignofclinicaltrials |