Drs Andrew Booth and Chris Carroll Framework for systematic reviews of qualitative research Garside 2010 Stage Typical activities Developing research question Assemble team Consult Agree approach ID: 418484
Download Presentation The PPT/PDF document "9.45 am Introducing Three QES Methods ..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
9.45 am Introducing Three QES Methods – Framework Synthesis, Meta-Ethnography and Realist Synthesis
Drs Andrew Booth and Chris CarrollSlide2
Framework for systematic reviews of qualitative research (Garside, 2010)
Stage
Typical activitiesDeveloping research questionAssemble team; Consult; Agree approachScoping exerciseIdentify relevant research; Refine methodsIdentifying relevant literatureDevelop Inclusion/Exclusion criteria; Focused searches; Citation searchesInitial assessment of study reportsPreliminary reading; Identify theories; Assess utility/relevanceAnalysis and synthesisReading & rereading study reports; Constant comparison; Assess validityPreliminary synthesisCategorising; tabulating; mindmaps; Explore relationshipsFull synthesisThematic analysis; translation of findings; Theory development; rival explanationsDisseminationTarget audiences; Limitations of reviewThroughoutMultiple viewpoints; Reflexivity; Audit trail; Ongoing consultation; revisit review purposeSlide3
Three QES Methods……..Slide4
Best Fit Framework SynthesisSlide5Slide6
A FrameworkSlide7
How do you create a framework?
Develop own framework or themes or concepts for codingOliver S et al: A multidimensional conceptual framework for analysing public involvement in health services research. Health Expectations 2008, 11:72-84.Brunton G, Oliver S, Oliver K, Lorenc T. A Synthesis of Research Addressing Children’s, Young People’s and Parents’ Views of Walking and Cycling for Transport London. London, EPPI-Centre, Social Science Research Unit, Institute of Education, University of London; 2006.Identify or create a thematic framework or conceptual modelCarroll C, Booth A, Cooper K. A worked example of “best-fit” framework synthesis: A systematic review of views concerning the taking of potential chemopreventive agents, BMC Medical Research Methodology 2011; 11: 29Slide8
An existing conceptual framework
Conrad K, et al (1996). The worksite environment as a cue to smoking reduction.
Research in Nursing & Health, 19 21-31.Slide9Slide10
A FrameworkSlide11
Framework synthesis
Thematic synthesisSlide12
Meta-EthnographySlide13
Meta-Ethnography
Why look at meta-ethnography
?Most common and longest established QES methodHannes K, Macaitis K. A move to more systematic and transparent approaches in qualitative evidence synthesis: update on a review of published papers, Qualitative Research, 2012; 12: 402-442.What do we mean by meta-ethnography?How do you complete the stages of meta-ethnography?Slide14
Meta-ethnography
“
... involves taking relevant empirical studies to be synthesised, reading them repeatedly and noting down key concepts (interpretive metaphors). These key concepts are the raw data for the synthesis. Noblit and Hare suggested that the process by which a synthesis is achieved is one of translation. This entails examining the key concepts in relation to others in the original study and across studies ... The purpose of the translation is to try to derive concepts that can encompass more than one of the studies being synthesised. The synthesised concepts may not have been explicitly identified in any of the original empirical studies”Campbell R et al. Evaluating meta-ethnography: systematic analysis and synthesis of qualitative research, HTA 2011; 15: 43Noblit GW, Hare RD. Meta-Ethnography: Synthesising Qualitative Studies. Newbury Park (CA): Sage Publications, 1988Slide15
Conducting a meta-ethnography (Atkins et al 2008)
Step 1: Getting started
Step 2: Deciding what is relevant to the initial interestStep 3: Reading the studiesStep 4: Determining how studies are relatedStep 5: Translating studies into one anotherStep 6: Synthesising translationsStep 7: Expressing the synthesisSlide16
Meta-ethnography: 7 phases
Phase 1: Getting started
Phase 2: Describing what is relevant to initial interestPhase 3: Reading the studies – repeated reading and noting of concepts or metaphorsPhase 4: Determining how studies are related – task of creating a list of key metaphors, phrases, ideas or concepts (and their relations) used in each account, and juxtaposing them. Leads to initial assumptions about relations between studies, e.g. Are they related? Are they answering the same question, considering the same problem, from the same perspective?Slide17
Meta-ethnography: 7 phases
Phase 5: Translating the studies into one another – the metaphors and/or concepts in each account and their interactions are compared with the metaphors and/or concepts and their interactions in other accounts. First level of meta-ethnographic synthesis.
Phase 6: Synthesizing translations – unique metaphors/concepts or one able to encompass those of other accounts, which are able to produce a new interpretation/conceptual development.Phase 7: Expressing the synthesis – communication of findings that takes account of the intended audience’s own culture and its concepts and language.Slide18
Realist SynthesisSlide19
In a nutshell, realist synthesis…
Configures beginning theory to explain “what works for whom in what circumstances and in what respects” (
Pawson, 2006, p.74)Configures Contexts, Mechanisms and Outcomes (CMO configurations)E.g. Hospital league tables cp. School league tables, Surgeon performance tables [Mechanisms?] Slide20
CMO ConfigurationsSlide21
Example CMO ConfigurationsSlide22
Example CMO Configurations
QUANTITATIVE
e.g. Different effect sizes change on motivation scaleQUALITATIVEe.g. Explanations for employee motivation “We had low morale because…”Slide23
Realist synthesis can
Discover weak links in an “implementation chain” (critical success factors)
Adjudicate between rival theoriesIdentify contextual factors leading to improved or impaired effectivenessCompare anticipated performance with actual performanceSlide24
Steps in a realist synthesis – Iterative!
Identify review questions
Search for primary studiesExtract data & appraise evidence Synthesise findings Slide25
Sounds easy doesn’t it?Slide26Slide27
Now select you preferred workshop choices (1
st
and 2nd)Best Fit Framework SynthesisMeta-EthnographyRealist SynthesisAnd to Coffee Break……..