IDEAcology: An interface to streamline and facilitate efficient, rigorous expert elicitation in ecology
Abstract Here, we demonstrate how IDEAcology aids in preparing for and implementing a structured expert elicitation using the IDEA protocol, an iterative quantitative expert elicitation framework. Expert judgement is used to inform decision‐making on environmental assessment and management when immi...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2023-08-01
|
| Series: | Methods in Ecology and Evolution |
| Subjects: | |
| Online Access: | https://doi.org/10.1111/2041-210X.14017 |
| _version_ | 1797760660926365696 |
|---|---|
| author | Stephanie K. Courtney Jones Sonya R. Geange Anca Hanea James Camac Victoria Hemming Ben Doobov Andrea Leigh Adrienne B. Nicotra |
| author_facet | Stephanie K. Courtney Jones Sonya R. Geange Anca Hanea James Camac Victoria Hemming Ben Doobov Andrea Leigh Adrienne B. Nicotra |
| author_sort | Stephanie K. Courtney Jones |
| collection | DOAJ |
| description | Abstract Here, we demonstrate how IDEAcology aids in preparing for and implementing a structured expert elicitation using the IDEA protocol, an iterative quantitative expert elicitation framework. Expert judgement is used to inform decision‐making on environmental assessment and management when imminent decisions are required, and quantitative data are absent or uninformative. Structured elicitation protocols can help improve the final judgements derived from experts, but they can also be administratively heavy and time‐consuming, requiring manual collation of experts' estimates and rationales, construction and dissemination of summary plots for discussion and collating final estimates post‐discussion. These challenges highlight the need for a centralised portal that enables synchronous access by all contributors, real‐time structured facilitation of discussion, whether in person or online, and streamlined data management. To meet this need, we developed the IDEAcology interface (www.ideacology.com) to support data collation, summary, interactions and ultimately the deployment of structured expert elicitation using the IDEA protocol. The IDEAcology interface is designed to be a central portal for scientists and practitioners to easily implement structured expert elicitation projects, while also facilitating data management by providing a reliable and efficient way for elicitation managers to design and run an elicitation, and for experts to input, visualise and cross‐examine estimates. The key advantages that IDEAcology provides include an easy‐to‐use interface with synchronous access to a single platform, reducing logistic difficulties, facilitating transparent discussion, improving the accuracy of estimates, enabling fast and efficient reporting by providing analysis‐ready data outputs and lastly, flexibility in the types of elicitation questions that can be accommodated in the interface. |
| first_indexed | 2024-03-12T19:01:47Z |
| format | Article |
| id | doaj.art-e8b85e8bcca54f5a943d9c706ba98bca |
| institution | Directory Open Access Journal |
| issn | 2041-210X |
| language | English |
| last_indexed | 2024-03-12T19:01:47Z |
| publishDate | 2023-08-01 |
| publisher | Wiley |
| record_format | Article |
| series | Methods in Ecology and Evolution |
| spelling | doaj.art-e8b85e8bcca54f5a943d9c706ba98bca2023-08-02T06:34:44ZengWileyMethods in Ecology and Evolution2041-210X2023-08-011482019202810.1111/2041-210X.14017IDEAcology: An interface to streamline and facilitate efficient, rigorous expert elicitation in ecologyStephanie K. Courtney Jones0Sonya R. Geange1Anca Hanea2James Camac3Victoria Hemming4Ben Doobov5Andrea Leigh6Adrienne B. Nicotra7Division of Ecology and Evolution, Research School of Biology The Australian National University Canberra Australian Capital Territory AustraliaDivision of Ecology and Evolution, Research School of Biology The Australian National University Canberra Australian Capital Territory AustraliaCentre of Excellence for Biosecurity Risk Analysis, School of BioSciences The University of Melbourne Melbourne Victoria AustraliaCentre of Excellence for Biosecurity Risk Analysis, School of BioSciences The University of Melbourne Melbourne Victoria AustraliaThe Martin Conservation Decisions Lab, Department of Forest and Conservation Sciences University of British Columbia Vancouver British Columbia CanadaLightning Rock Mitchell Canberra AustraliaUniversity of Technology Sydney School of Life Sciences Broadway New South Wales AustraliaDivision of Ecology and Evolution, Research School of Biology The Australian National University Canberra Australian Capital Territory AustraliaAbstract Here, we demonstrate how IDEAcology aids in preparing for and implementing a structured expert elicitation using the IDEA protocol, an iterative quantitative expert elicitation framework. Expert judgement is used to inform decision‐making on environmental assessment and management when imminent decisions are required, and quantitative data are absent or uninformative. Structured elicitation protocols can help improve the final judgements derived from experts, but they can also be administratively heavy and time‐consuming, requiring manual collation of experts' estimates and rationales, construction and dissemination of summary plots for discussion and collating final estimates post‐discussion. These challenges highlight the need for a centralised portal that enables synchronous access by all contributors, real‐time structured facilitation of discussion, whether in person or online, and streamlined data management. To meet this need, we developed the IDEAcology interface (www.ideacology.com) to support data collation, summary, interactions and ultimately the deployment of structured expert elicitation using the IDEA protocol. The IDEAcology interface is designed to be a central portal for scientists and practitioners to easily implement structured expert elicitation projects, while also facilitating data management by providing a reliable and efficient way for elicitation managers to design and run an elicitation, and for experts to input, visualise and cross‐examine estimates. The key advantages that IDEAcology provides include an easy‐to‐use interface with synchronous access to a single platform, reducing logistic difficulties, facilitating transparent discussion, improving the accuracy of estimates, enabling fast and efficient reporting by providing analysis‐ready data outputs and lastly, flexibility in the types of elicitation questions that can be accommodated in the interface.https://doi.org/10.1111/2041-210X.14017expert judgementIDEA protocolinterfaceplatformquantitative estimatesstructured expert elicitation |
| spellingShingle | Stephanie K. Courtney Jones Sonya R. Geange Anca Hanea James Camac Victoria Hemming Ben Doobov Andrea Leigh Adrienne B. Nicotra IDEAcology: An interface to streamline and facilitate efficient, rigorous expert elicitation in ecology Methods in Ecology and Evolution expert judgement IDEA protocol interface platform quantitative estimates structured expert elicitation |
| title | IDEAcology: An interface to streamline and facilitate efficient, rigorous expert elicitation in ecology |
| title_full | IDEAcology: An interface to streamline and facilitate efficient, rigorous expert elicitation in ecology |
| title_fullStr | IDEAcology: An interface to streamline and facilitate efficient, rigorous expert elicitation in ecology |
| title_full_unstemmed | IDEAcology: An interface to streamline and facilitate efficient, rigorous expert elicitation in ecology |
| title_short | IDEAcology: An interface to streamline and facilitate efficient, rigorous expert elicitation in ecology |
| title_sort | ideacology an interface to streamline and facilitate efficient rigorous expert elicitation in ecology |
| topic | expert judgement IDEA protocol interface platform quantitative estimates structured expert elicitation |
| url | https://doi.org/10.1111/2041-210X.14017 |
| work_keys_str_mv | AT stephaniekcourtneyjones ideacologyaninterfacetostreamlineandfacilitateefficientrigorousexpertelicitationinecology AT sonyargeange ideacologyaninterfacetostreamlineandfacilitateefficientrigorousexpertelicitationinecology AT ancahanea ideacologyaninterfacetostreamlineandfacilitateefficientrigorousexpertelicitationinecology AT jamescamac ideacologyaninterfacetostreamlineandfacilitateefficientrigorousexpertelicitationinecology AT victoriahemming ideacologyaninterfacetostreamlineandfacilitateefficientrigorousexpertelicitationinecology AT bendoobov ideacologyaninterfacetostreamlineandfacilitateefficientrigorousexpertelicitationinecology AT andrealeigh ideacologyaninterfacetostreamlineandfacilitateefficientrigorousexpertelicitationinecology AT adriennebnicotra ideacologyaninterfacetostreamlineandfacilitateefficientrigorousexpertelicitationinecology |