Creation of standardized tools to evaluate reporting in health research: Population Reporting Of Gender, Race, Ethnicity & Sex (PROGRES).
Despite increasing diversity in research recruitment, research finding reporting by gender, race, ethnicity, and sex has remained up to the discretion of authors. This study developped and piloted tools to standardize the inclusive reporting of gender, race, ethnicity, and sex in health research. A...
| Main Authors: | , , , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2023-01-01
|
| Series: | PLOS Global Public Health |
| Online Access: | https://doi.org/10.1371/journal.pgph.0002227 |
| _version_ | 1827768983707713536 |
|---|---|
| author | Anne M Stey Mira Ghneim Onaona Gurney Ariel P Santos Rishi Rattan Egide Abahuje Archit Baskaran Jeffry Nahmias Joseph Richardson Tanya L Zakrison Zinzi D Baily Elliott R Haut Mihir Chaudhary Bellal Joseph Ben Zarzaur Kimberly Hendershot |
| author_facet | Anne M Stey Mira Ghneim Onaona Gurney Ariel P Santos Rishi Rattan Egide Abahuje Archit Baskaran Jeffry Nahmias Joseph Richardson Tanya L Zakrison Zinzi D Baily Elliott R Haut Mihir Chaudhary Bellal Joseph Ben Zarzaur Kimberly Hendershot |
| author_sort | Anne M Stey |
| collection | DOAJ |
| description | Despite increasing diversity in research recruitment, research finding reporting by gender, race, ethnicity, and sex has remained up to the discretion of authors. This study developped and piloted tools to standardize the inclusive reporting of gender, race, ethnicity, and sex in health research. A modified Delphi approach was used to develop standardized tools for the inclusive reporting of gender, race, ethnicity, and sex in health research. Health research, social epidemiology, sociology, and medical anthropology experts from 11 different universities participated in the Delphi process. The tools were pilot tested on 85 health research manuscripts in top health research journals to determine inter-rater reliability of the tools. The tools each spanned five dimensions for both sex and gender as well as race and ethnicity: Author inclusiveness, Participant inclusiveness, Nomenclature reporting, Descriptive reporting, and Outcomes reporting for each subpopulation. The sex and gender tool had a median score of 6 and a range of 1-15 out of 16 possible points. The percent agreement between reviewers piloting the sex and gender tool was 82%. The interrater reliability or average Cohen's Kappa was 0.54 with a standard deviation of 0.33 demonstrating moderate agreement. The race and ethnicity tool had a median score of 1 and a range of 0-15 out of 16 possible points. Race and ethnicity were both reported in only 25.8% of studies evaluated. Most studies that reported race reported only the largest subgroups; White, Black, and Latinx. The percent agreement between reviewers piloting the race and ethnicity tool was 84 and average Cohen's Kappa was 0.61 with a standard deviation of 0.38 demonstrating substantial agreement. While the overall dimension scores were low (indicating low inclusivity), the interrater reliability measures indicated moderate to substantial agreement for the respective tools. Efforts in recruitment alone will not provide more inclusive literature without improving reporting. |
| first_indexed | 2024-03-11T12:17:50Z |
| format | Article |
| id | doaj.art-9fc8ebde574b4fe7b3769406d6a0e227 |
| institution | Directory Open Access Journal |
| issn | 2767-3375 |
| language | English |
| last_indexed | 2024-03-11T12:17:50Z |
| publishDate | 2023-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLOS Global Public Health |
| spelling | doaj.art-9fc8ebde574b4fe7b3769406d6a0e2272023-11-07T06:09:03ZengPublic Library of Science (PLoS)PLOS Global Public Health2767-33752023-01-0139e000222710.1371/journal.pgph.0002227Creation of standardized tools to evaluate reporting in health research: Population Reporting Of Gender, Race, Ethnicity & Sex (PROGRES).Anne M SteyMira GhneimOnaona GurneyAriel P SantosRishi RattanEgide AbahujeArchit BaskaranJeffry NahmiasJoseph RichardsonTanya L ZakrisonZinzi D BailyElliott R HautMihir ChaudharyBellal JosephBen ZarzaurKimberly HendershotDespite increasing diversity in research recruitment, research finding reporting by gender, race, ethnicity, and sex has remained up to the discretion of authors. This study developped and piloted tools to standardize the inclusive reporting of gender, race, ethnicity, and sex in health research. A modified Delphi approach was used to develop standardized tools for the inclusive reporting of gender, race, ethnicity, and sex in health research. Health research, social epidemiology, sociology, and medical anthropology experts from 11 different universities participated in the Delphi process. The tools were pilot tested on 85 health research manuscripts in top health research journals to determine inter-rater reliability of the tools. The tools each spanned five dimensions for both sex and gender as well as race and ethnicity: Author inclusiveness, Participant inclusiveness, Nomenclature reporting, Descriptive reporting, and Outcomes reporting for each subpopulation. The sex and gender tool had a median score of 6 and a range of 1-15 out of 16 possible points. The percent agreement between reviewers piloting the sex and gender tool was 82%. The interrater reliability or average Cohen's Kappa was 0.54 with a standard deviation of 0.33 demonstrating moderate agreement. The race and ethnicity tool had a median score of 1 and a range of 0-15 out of 16 possible points. Race and ethnicity were both reported in only 25.8% of studies evaluated. Most studies that reported race reported only the largest subgroups; White, Black, and Latinx. The percent agreement between reviewers piloting the race and ethnicity tool was 84 and average Cohen's Kappa was 0.61 with a standard deviation of 0.38 demonstrating substantial agreement. While the overall dimension scores were low (indicating low inclusivity), the interrater reliability measures indicated moderate to substantial agreement for the respective tools. Efforts in recruitment alone will not provide more inclusive literature without improving reporting.https://doi.org/10.1371/journal.pgph.0002227 |
| spellingShingle | Anne M Stey Mira Ghneim Onaona Gurney Ariel P Santos Rishi Rattan Egide Abahuje Archit Baskaran Jeffry Nahmias Joseph Richardson Tanya L Zakrison Zinzi D Baily Elliott R Haut Mihir Chaudhary Bellal Joseph Ben Zarzaur Kimberly Hendershot Creation of standardized tools to evaluate reporting in health research: Population Reporting Of Gender, Race, Ethnicity & Sex (PROGRES). PLOS Global Public Health |
| title | Creation of standardized tools to evaluate reporting in health research: Population Reporting Of Gender, Race, Ethnicity & Sex (PROGRES). |
| title_full | Creation of standardized tools to evaluate reporting in health research: Population Reporting Of Gender, Race, Ethnicity & Sex (PROGRES). |
| title_fullStr | Creation of standardized tools to evaluate reporting in health research: Population Reporting Of Gender, Race, Ethnicity & Sex (PROGRES). |
| title_full_unstemmed | Creation of standardized tools to evaluate reporting in health research: Population Reporting Of Gender, Race, Ethnicity & Sex (PROGRES). |
| title_short | Creation of standardized tools to evaluate reporting in health research: Population Reporting Of Gender, Race, Ethnicity & Sex (PROGRES). |
| title_sort | creation of standardized tools to evaluate reporting in health research population reporting of gender race ethnicity sex progres |
| url | https://doi.org/10.1371/journal.pgph.0002227 |
| work_keys_str_mv | AT annemstey creationofstandardizedtoolstoevaluatereportinginhealthresearchpopulationreportingofgenderraceethnicitysexprogres AT miraghneim creationofstandardizedtoolstoevaluatereportinginhealthresearchpopulationreportingofgenderraceethnicitysexprogres AT onaonagurney creationofstandardizedtoolstoevaluatereportinginhealthresearchpopulationreportingofgenderraceethnicitysexprogres AT arielpsantos creationofstandardizedtoolstoevaluatereportinginhealthresearchpopulationreportingofgenderraceethnicitysexprogres AT rishirattan creationofstandardizedtoolstoevaluatereportinginhealthresearchpopulationreportingofgenderraceethnicitysexprogres AT egideabahuje creationofstandardizedtoolstoevaluatereportinginhealthresearchpopulationreportingofgenderraceethnicitysexprogres AT architbaskaran creationofstandardizedtoolstoevaluatereportinginhealthresearchpopulationreportingofgenderraceethnicitysexprogres AT jeffrynahmias creationofstandardizedtoolstoevaluatereportinginhealthresearchpopulationreportingofgenderraceethnicitysexprogres AT josephrichardson creationofstandardizedtoolstoevaluatereportinginhealthresearchpopulationreportingofgenderraceethnicitysexprogres AT tanyalzakrison creationofstandardizedtoolstoevaluatereportinginhealthresearchpopulationreportingofgenderraceethnicitysexprogres AT zinzidbaily creationofstandardizedtoolstoevaluatereportinginhealthresearchpopulationreportingofgenderraceethnicitysexprogres AT elliottrhaut creationofstandardizedtoolstoevaluatereportinginhealthresearchpopulationreportingofgenderraceethnicitysexprogres AT mihirchaudhary creationofstandardizedtoolstoevaluatereportinginhealthresearchpopulationreportingofgenderraceethnicitysexprogres AT bellaljoseph creationofstandardizedtoolstoevaluatereportinginhealthresearchpopulationreportingofgenderraceethnicitysexprogres AT benzarzaur creationofstandardizedtoolstoevaluatereportinginhealthresearchpopulationreportingofgenderraceethnicitysexprogres AT kimberlyhendershot creationofstandardizedtoolstoevaluatereportinginhealthresearchpopulationreportingofgenderraceethnicitysexprogres |