Dr Mark Pearson Mark.Pearson@hull.ac.uk
Reader in Implementation Science
The challenge of external validity in policy-relevant systematic reviews: A case study from the field of substance misuse
Pearson, Mark; Coomber, Ross
Authors
Ross Coomber
Abstract
Aim To critically evaluate the methods utilized in the conduct of a systematic review in the field of substance misuse
Design Participant‐observation in the review process, semi‐structured interviews with review team members and management and structured observation of the process of guidance development.
Setting An ‘arm's‐length’ government body.
Participants Review team members, management and the committee responsible for producing evidence‐based guidance for policy and practice.
Measurements Data from interviews and (participant‐)observation were reflected upon critically in order to increase understanding of the systematic review process.
Findings The application of systematic review methods produced an evidence base that did not inform the development of guidance to the extent that it could have done: (i) an emphasis upon internal research validity produced an evidence base with an emphasis on short‐term interventions at the level of the individual; (ii) criteria for appraising the external validity of studies were not developed sufficiently; and (iii) the systematic review of evidence and development of guidance are strongly reliant upon the judgement of reviewers and committee members.
Conclusions Prioritizing internal validity in a systematic review risks producing an evidence base that is not informed adequately by the wider determinants of health and which does not give sufficient consideration to external validity. The use of appropriate methods requires that commissioners of systematic reviews are clear at the outset how the review is proposed to be utilized. Review methods such as meta‐ethnography and realist synthesis could contribute to making the frameworks within which judgements are made more explicit.
Citation
Pearson, M., & Coomber, R. (2010). The challenge of external validity in policy-relevant systematic reviews: A case study from the field of substance misuse. Addiction, 105(1), 136-145. https://doi.org/10.1111/j.1360-0443.2009.02713.x
Journal Article Type | Review |
---|---|
Acceptance Date | Jun 12, 2009 |
Online Publication Date | Oct 5, 2009 |
Publication Date | Jan 1, 2010 |
Deposit Date | Jul 27, 2018 |
Journal | Addiction |
Print ISSN | 0965-2140 |
Electronic ISSN | 1360-0443 |
Publisher | Wiley |
Peer Reviewed | Peer Reviewed |
Volume | 105 |
Issue | 1 |
Pages | 136-145 |
DOI | https://doi.org/10.1111/j.1360-0443.2009.02713.x |
Keywords | Environmental influences; Guidance development; Policy; Substance misuse in the young; Systematic review methods |
Public URL | https://hull-repository.worktribe.com/output/951758 |
Publisher URL | https://onlinelibrary.wiley.com/doi/abs/10.1111/j.1360-0443.2009.02713.x |
You might also like
Drivers of unprofessional behaviour between staff in acute care hospitals: a realist review
(2023)
Journal Article
Downloadable Citations
About Repository@Hull
Administrator e-mail: repository@hull.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search