WikiBuild: A New Online Collaboration Process For Multistakeholder Tool Development and Consensus Building
BackgroundProduction of media such as patient education tools requires methods that can integrate multiple stakeholder perspectives. Existing consensus techniques are poorly suited to design of visual media, can be expensive and logistically demanding, and are subject to caveats arising from group d...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2011-12-01
|
| Series: | Journal of Medical Internet Research |
| Online Access: | http://www.jmir.org/2011/4/e108/ |
| _version_ | 1818566771532103680 |
|---|---|
| author | Gupta, Samir Wan, Flora T Newton, David Bhattacharyya, Onil K Chignell, Mark H Straus, Sharon E |
| author_facet | Gupta, Samir Wan, Flora T Newton, David Bhattacharyya, Onil K Chignell, Mark H Straus, Sharon E |
| author_sort | Gupta, Samir |
| collection | DOAJ |
| description | BackgroundProduction of media such as patient education tools requires methods that can integrate multiple stakeholder perspectives. Existing consensus techniques are poorly suited to design of visual media, can be expensive and logistically demanding, and are subject to caveats arising from group dynamics such as participant hierarchies.
ObjectiveOur objective was to develop a method that enables multistakeholder tool building while averting these difficulties.
MethodsWe developed a wiki-inspired method and tested this through the collaborative design of an asthma action plan (AAP). In the development stage, we developed the Web-based tool by (1) establishing AAP content and format options, (2) building a Web-based application capable of representing each content and format permutation, (3) testing this tool among stakeholders, and (4) revising this tool based on stakeholder feedback. In the wiki stage, groups of participants used the revised tool in three separate 1-week “wiki” periods during which each group collaboratively authored an AAP by making multiple online selections.
ResultsIn the development stage, we recruited 16 participants (9/16 male) (4 pulmonologists, 4 primary care physicians, 3 certified asthma educators, and 5 patients) for system testing. The mean System Usability Scale (SUS) score for the tool used in testing was 72.2 (SD 10.2). In the wiki stage, we recruited 41 participants (15/41 male) (9 pulmonologists, 6 primary care physicians, 5 certified asthma educators, and 21 patients) from diverse locations. The mean SUS score for the revised tool was 75.9 (SD 19.6). Users made 872, 466, and 599 successful changes to the AAP in weeks 1, 2, and 3, respectively. The site was used actively for a mean of 32.0 hours per week, of which 3.1 hours per week (9.7%) constituted synchronous multiuser use (2–4 users at the same time). Participants averaged 23 (SD 33) minutes of login time and made 7.7 (SD 15) changes to the AAP per day. Among participants, 28/35 (80%) were satisfied with the final AAP, and only 3/34 (9%) perceived interstakeholder group hierarchies.
ConclusionUse of a wiki-inspired method allowed for effective collaborative design of content and format aspects of an AAP while minimizing logistical requirements, maximizing geographical representation, and mitigating hierarchical group dynamics. Our method faced unique software and hardware challenges, and raises certain questions regarding its effect on group functioning. Potential uses of our method are broad, and further studies are required. |
| first_indexed | 2024-12-14T01:57:53Z |
| format | Article |
| id | doaj.art-990b3763d8aa492baf120ae4cff79100 |
| institution | Directory Open Access Journal |
| issn | 1438-8871 |
| language | English |
| last_indexed | 2024-12-14T01:57:53Z |
| publishDate | 2011-12-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Medical Internet Research |
| spelling | doaj.art-990b3763d8aa492baf120ae4cff791002022-12-21T23:21:07ZengJMIR PublicationsJournal of Medical Internet Research1438-88712011-12-01134e10810.2196/jmir.1833WikiBuild: A New Online Collaboration Process For Multistakeholder Tool Development and Consensus BuildingGupta, SamirWan, Flora TNewton, DavidBhattacharyya, Onil KChignell, Mark HStraus, Sharon EBackgroundProduction of media such as patient education tools requires methods that can integrate multiple stakeholder perspectives. Existing consensus techniques are poorly suited to design of visual media, can be expensive and logistically demanding, and are subject to caveats arising from group dynamics such as participant hierarchies. ObjectiveOur objective was to develop a method that enables multistakeholder tool building while averting these difficulties. MethodsWe developed a wiki-inspired method and tested this through the collaborative design of an asthma action plan (AAP). In the development stage, we developed the Web-based tool by (1) establishing AAP content and format options, (2) building a Web-based application capable of representing each content and format permutation, (3) testing this tool among stakeholders, and (4) revising this tool based on stakeholder feedback. In the wiki stage, groups of participants used the revised tool in three separate 1-week “wiki” periods during which each group collaboratively authored an AAP by making multiple online selections. ResultsIn the development stage, we recruited 16 participants (9/16 male) (4 pulmonologists, 4 primary care physicians, 3 certified asthma educators, and 5 patients) for system testing. The mean System Usability Scale (SUS) score for the tool used in testing was 72.2 (SD 10.2). In the wiki stage, we recruited 41 participants (15/41 male) (9 pulmonologists, 6 primary care physicians, 5 certified asthma educators, and 21 patients) from diverse locations. The mean SUS score for the revised tool was 75.9 (SD 19.6). Users made 872, 466, and 599 successful changes to the AAP in weeks 1, 2, and 3, respectively. The site was used actively for a mean of 32.0 hours per week, of which 3.1 hours per week (9.7%) constituted synchronous multiuser use (2–4 users at the same time). Participants averaged 23 (SD 33) minutes of login time and made 7.7 (SD 15) changes to the AAP per day. Among participants, 28/35 (80%) were satisfied with the final AAP, and only 3/34 (9%) perceived interstakeholder group hierarchies. ConclusionUse of a wiki-inspired method allowed for effective collaborative design of content and format aspects of an AAP while minimizing logistical requirements, maximizing geographical representation, and mitigating hierarchical group dynamics. Our method faced unique software and hardware challenges, and raises certain questions regarding its effect on group functioning. Potential uses of our method are broad, and further studies are required.http://www.jmir.org/2011/4/e108/ |
| spellingShingle | Gupta, Samir Wan, Flora T Newton, David Bhattacharyya, Onil K Chignell, Mark H Straus, Sharon E WikiBuild: A New Online Collaboration Process For Multistakeholder Tool Development and Consensus Building Journal of Medical Internet Research |
| title | WikiBuild: A New Online Collaboration Process For Multistakeholder Tool Development and Consensus Building |
| title_full | WikiBuild: A New Online Collaboration Process For Multistakeholder Tool Development and Consensus Building |
| title_fullStr | WikiBuild: A New Online Collaboration Process For Multistakeholder Tool Development and Consensus Building |
| title_full_unstemmed | WikiBuild: A New Online Collaboration Process For Multistakeholder Tool Development and Consensus Building |
| title_short | WikiBuild: A New Online Collaboration Process For Multistakeholder Tool Development and Consensus Building |
| title_sort | wikibuild a new online collaboration process for multistakeholder tool development and consensus building |
| url | http://www.jmir.org/2011/4/e108/ |
| work_keys_str_mv | AT guptasamir wikibuildanewonlinecollaborationprocessformultistakeholdertooldevelopmentandconsensusbuilding AT wanflorat wikibuildanewonlinecollaborationprocessformultistakeholdertooldevelopmentandconsensusbuilding AT newtondavid wikibuildanewonlinecollaborationprocessformultistakeholdertooldevelopmentandconsensusbuilding AT bhattacharyyaonilk wikibuildanewonlinecollaborationprocessformultistakeholdertooldevelopmentandconsensusbuilding AT chignellmarkh wikibuildanewonlinecollaborationprocessformultistakeholdertooldevelopmentandconsensusbuilding AT straussharone wikibuildanewonlinecollaborationprocessformultistakeholdertooldevelopmentandconsensusbuilding |