Trends and quality of randomized controlled trials on acupuncture conducted in Japan by decade from the 1960s to the 2010s: a systematic review

Abstract Background More new randomized controlled trials (RCTs) on acupuncture have been published in Japan since our last updated systematic review (2010). This systematic review aimed to evaluate the quality of RCTs on acupuncture conducted in Japan and understand the decade-wise changes in the m...

Full description

Bibliographic Details
Main Authors: Shoko Masuyama, Hitoshi Yamashita
Format: Article
Language:English
Published: BMC 2023-03-01
Series:BMC Complementary Medicine and Therapies
Subjects:
Online Access:https://doi.org/10.1186/s12906-023-03910-3
_version_ 1797854066140774400
author Shoko Masuyama
Hitoshi Yamashita
author_facet Shoko Masuyama
Hitoshi Yamashita
author_sort Shoko Masuyama
collection DOAJ
description Abstract Background More new randomized controlled trials (RCTs) on acupuncture have been published in Japan since our last updated systematic review (2010). This systematic review aimed to evaluate the quality of RCTs on acupuncture conducted in Japan and understand the decade-wise changes in the methodological characteristics of the relevant RCTs. Methods The literature search was performed using Ichushi Web, the Cochrane Central Register of Controlled Trials (CENTRAL), PubMed and our team’s compilation of relevant papers. We included full-length papers reporting RCTs that examined the clinical effects of acupuncture on patients in Japan published in or before 2019. We assessed the risk of bias (RoB), sample size, control setting, negative trial reporting, informed consent, ethics approval, trial registration, and adverse event reporting. Results A total of 99 articles reporting 108 eligible RCTs were identified. The number of RCTs published in each decade was 1, 6, 9, 5, 40, and 47 in the 1960s, 1970s, 1980s, 1990s, 2000s, and 2010s, respectively. Quality assessment using the Cochrane RoB tool revealed that “sequence generation” improved in and after 1990 (73%–80% of RCTs were rated as “low”) and “blinding of outcome assessors” slightly improved in and after the 2000s (40%–50% judged as “low”). However, “high” or “unclear” remained the dominant grades in other domains. Clinical trial registration and adverse events were reported only in 9% and 28% of the included RCTs even in the 2010s, respectively. A different acupuncture method or different point selection (e.g., deep vs. shallow insertion) was the most dominant control setting before 1990, while sham (or “placebo”) needling and/or sham acupoints became the most dominant in the 2000s. The proportion of RCTs with positive results was 80% in the 2000s and 69% in the 2010s. Conclusions The quality of RCTs on acupuncture conducted in Japan did not appear to have improved over the decades except for “sequence generation.” While the culture of submitting negative trial reports was prevalent in the Japanese acupuncture research milieu as late as the 1990s, the overall quality of the relevant trials needs to be further improved.
first_indexed 2024-04-09T19:59:51Z
format Article
id doaj.art-91af286e408b4665b75ca7c0e404fc5e
institution Directory Open Access Journal
issn 2662-7671
language English
last_indexed 2024-04-09T19:59:51Z
publishDate 2023-03-01
publisher BMC
record_format Article
series BMC Complementary Medicine and Therapies
spelling doaj.art-91af286e408b4665b75ca7c0e404fc5e2023-04-03T05:16:18ZengBMCBMC Complementary Medicine and Therapies2662-76712023-03-0123111210.1186/s12906-023-03910-3Trends and quality of randomized controlled trials on acupuncture conducted in Japan by decade from the 1960s to the 2010s: a systematic reviewShoko Masuyama0Hitoshi Yamashita1Graduate School of Health Sciences, Morinomiya University of Medical SciencesGraduate School of Health Sciences, Morinomiya University of Medical SciencesAbstract Background More new randomized controlled trials (RCTs) on acupuncture have been published in Japan since our last updated systematic review (2010). This systematic review aimed to evaluate the quality of RCTs on acupuncture conducted in Japan and understand the decade-wise changes in the methodological characteristics of the relevant RCTs. Methods The literature search was performed using Ichushi Web, the Cochrane Central Register of Controlled Trials (CENTRAL), PubMed and our team’s compilation of relevant papers. We included full-length papers reporting RCTs that examined the clinical effects of acupuncture on patients in Japan published in or before 2019. We assessed the risk of bias (RoB), sample size, control setting, negative trial reporting, informed consent, ethics approval, trial registration, and adverse event reporting. Results A total of 99 articles reporting 108 eligible RCTs were identified. The number of RCTs published in each decade was 1, 6, 9, 5, 40, and 47 in the 1960s, 1970s, 1980s, 1990s, 2000s, and 2010s, respectively. Quality assessment using the Cochrane RoB tool revealed that “sequence generation” improved in and after 1990 (73%–80% of RCTs were rated as “low”) and “blinding of outcome assessors” slightly improved in and after the 2000s (40%–50% judged as “low”). However, “high” or “unclear” remained the dominant grades in other domains. Clinical trial registration and adverse events were reported only in 9% and 28% of the included RCTs even in the 2010s, respectively. A different acupuncture method or different point selection (e.g., deep vs. shallow insertion) was the most dominant control setting before 1990, while sham (or “placebo”) needling and/or sham acupoints became the most dominant in the 2000s. The proportion of RCTs with positive results was 80% in the 2000s and 69% in the 2010s. Conclusions The quality of RCTs on acupuncture conducted in Japan did not appear to have improved over the decades except for “sequence generation.” While the culture of submitting negative trial reports was prevalent in the Japanese acupuncture research milieu as late as the 1990s, the overall quality of the relevant trials needs to be further improved.https://doi.org/10.1186/s12906-023-03910-3Randomized controlled trialAcupunctureJapanQualitySystematic reviewDecade-wise trends
spellingShingle Shoko Masuyama
Hitoshi Yamashita
Trends and quality of randomized controlled trials on acupuncture conducted in Japan by decade from the 1960s to the 2010s: a systematic review
BMC Complementary Medicine and Therapies
Randomized controlled trial
Acupuncture
Japan
Quality
Systematic review
Decade-wise trends
title Trends and quality of randomized controlled trials on acupuncture conducted in Japan by decade from the 1960s to the 2010s: a systematic review
title_full Trends and quality of randomized controlled trials on acupuncture conducted in Japan by decade from the 1960s to the 2010s: a systematic review
title_fullStr Trends and quality of randomized controlled trials on acupuncture conducted in Japan by decade from the 1960s to the 2010s: a systematic review
title_full_unstemmed Trends and quality of randomized controlled trials on acupuncture conducted in Japan by decade from the 1960s to the 2010s: a systematic review
title_short Trends and quality of randomized controlled trials on acupuncture conducted in Japan by decade from the 1960s to the 2010s: a systematic review
title_sort trends and quality of randomized controlled trials on acupuncture conducted in japan by decade from the 1960s to the 2010s a systematic review
topic Randomized controlled trial
Acupuncture
Japan
Quality
Systematic review
Decade-wise trends
url https://doi.org/10.1186/s12906-023-03910-3
work_keys_str_mv AT shokomasuyama trendsandqualityofrandomizedcontrolledtrialsonacupunctureconductedinjapanbydecadefromthe1960stothe2010sasystematicreview
AT hitoshiyamashita trendsandqualityofrandomizedcontrolledtrialsonacupunctureconductedinjapanbydecadefromthe1960stothe2010sasystematicreview