Question-Driven Methods or Method-Driven Questions? How We Limit What We Learn by Limiting What We Ask
The “methodologically manic-obsessive” evaluation profession and the metrics- and measures-obsessed lay users of evidence have managed to seriously limit the value of what we learn from evaluation. Evaluation questions asked at the front end are limited by the askers’ narrow understanding of what is...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
The Evaluation Center at Western Michigan University
2015-03-01
|
| Series: | Journal of MultiDisciplinary Evaluation |
| Online Access: | https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/414 |
| _version_ | 1797812692938915840 |
|---|---|
| author | E Jane Davidson |
| author_facet | E Jane Davidson |
| author_sort | E Jane Davidson |
| collection | DOAJ |
| description | The “methodologically manic-obsessive” evaluation profession and the metrics- and measures-obsessed lay users of evidence have managed to seriously limit the value of what we learn from evaluation. Evaluation questions asked at the front end are limited by the askers’ narrow understanding of what is possible methodologically at the back end. This, alongside the political and psychological forces working against real evaluation, are major drivers of the single narrative thinking that pervades the formulation and evaluation of national and local government policies and initiatives. This paper provides practical suggestions for asking the big-picture questions that really need to be asked, and suggests how real evaluation can step up to the plate, methodologically and otherwise. |
| first_indexed | 2024-03-13T07:42:16Z |
| format | Article |
| id | doaj.art-e3dcc0b3cdc945e397dd63baeaf79809 |
| institution | Directory Open Access Journal |
| issn | 1556-8180 |
| language | English |
| last_indexed | 2024-03-13T07:42:16Z |
| publishDate | 2015-03-01 |
| publisher | The Evaluation Center at Western Michigan University |
| record_format | Article |
| series | Journal of MultiDisciplinary Evaluation |
| spelling | doaj.art-e3dcc0b3cdc945e397dd63baeaf798092023-06-03T07:02:40ZengThe Evaluation Center at Western Michigan UniversityJournal of MultiDisciplinary Evaluation1556-81802015-03-01112410.56645/jmde.v11i24.414Question-Driven Methods or Method-Driven Questions? How We Limit What We Learn by Limiting What We AskE Jane Davidson0Real Evaluation LtdThe “methodologically manic-obsessive” evaluation profession and the metrics- and measures-obsessed lay users of evidence have managed to seriously limit the value of what we learn from evaluation. Evaluation questions asked at the front end are limited by the askers’ narrow understanding of what is possible methodologically at the back end. This, alongside the political and psychological forces working against real evaluation, are major drivers of the single narrative thinking that pervades the formulation and evaluation of national and local government policies and initiatives. This paper provides practical suggestions for asking the big-picture questions that really need to be asked, and suggests how real evaluation can step up to the plate, methodologically and otherwise.https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/414 |
| spellingShingle | E Jane Davidson Question-Driven Methods or Method-Driven Questions? How We Limit What We Learn by Limiting What We Ask Journal of MultiDisciplinary Evaluation |
| title | Question-Driven Methods or Method-Driven Questions? How We Limit What We Learn by Limiting What We Ask |
| title_full | Question-Driven Methods or Method-Driven Questions? How We Limit What We Learn by Limiting What We Ask |
| title_fullStr | Question-Driven Methods or Method-Driven Questions? How We Limit What We Learn by Limiting What We Ask |
| title_full_unstemmed | Question-Driven Methods or Method-Driven Questions? How We Limit What We Learn by Limiting What We Ask |
| title_short | Question-Driven Methods or Method-Driven Questions? How We Limit What We Learn by Limiting What We Ask |
| title_sort | question driven methods or method driven questions how we limit what we learn by limiting what we ask |
| url | https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/414 |
| work_keys_str_mv | AT ejanedavidson questiondrivenmethodsormethoddrivenquestionshowwelimitwhatwelearnbylimitingwhatweask |