Research designs Empirical circle Research designs 4 elements Randomization Comparison Before vs after Prospective vs retrospective Randomized controlled study Controlled beforeafter study ID: 911839
Download Presentation The PPT/PDF document "7 . Evidence -based management:" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
7
.
Evidence
-based management:
Research designs
Slide2Empirical circle
Slide3Research designs:
4
elements
Randomization
Comparison
Before
vs
after
Prospective
vs
retrospective
Slide4Randomized controlled study
Controlled before-after study
Cohort / panel study
Before-after study
Post-test only study
Survey
Case study
ExperimentQuasi-experimentObservational studyLongitudinal studyCross-sectional studyQualitative study
Research
designs: terms
Slide5CBA: controlled before-after study
In a controlled
before-after study
two or more groups are compared with each other, usually comprising one group in which an intervention is carried out (experimental group) and one group where no or an alternative intervention is conducted (control group).
Slide6=
CBA: controlled before-after study
Slide7In the case of randomization, the groups compared with each other are selected entirely randomly, for example by drawing lots. This means that each participant (or other unit such as a team, department or company) has an equal chance of being in the intervention or control group. In this way, the influence of any distorting factors is spread over both groups so that these groups are as comparable as possible with each other with the exception of the intervention.
Better (but not always feasible): randomization
Slide8=
even
oneven
Randomized controlled study (RCT)
Slide9Cohort / panel study
Starting point:
intervention/exposure (independent variable)
Longitudinal study where large groups of people or companies (cohort / panel) are followed over a long period to see (prospective) whether differences occur among the groups.
=
Slide10Case-control study
Starting
point:
outcome
(dependent variable)
Longitudinal study in which one group of people or companies with a particular outcome
is compared retrospectively with a group that does not have this outcome.
=
✔
✗
VS
VS
Slide11Examples of
(flawed) case
-control studies
Slide12versus
Study in which data are obtained or particular characteristics are measured of a population before versus after an intervention / exposure / event, to measure the effect or correlation.
Before-after study
Slide13=
Posttest-only
Slide14Cross-sectional study
Study in which data of a statistically significant sample of a population (managers, CEO’s, employees) is gathered at one point in time. It provides a snapshot of the current condition but does not explain cause and effect.
Cross-sectional studies include surveys
Slide15Cross-sectional study
?
?
?
Slide16Study in which
a large number (qualitative or quantitative) of aspects of a single case (organization or team) was investigated in depth over a long period within the case’s own context.
Case study
Slide17Experimental research
‘True’ experiment: RCT
‘Quasi’ experiment: CBA
Experimental
research refers to studies where the researcher
manipulates one (or more) variable and controls the other variable(s) to determine whether there is a causal relation between the manipulated variable and the outcome.
Slide18Observational research
Natural experiment
Cohort
/ panel study
Case-control
study
Observational research refers to studies where the researcher merely observes but does not intervene, with the intention of finding correlations among the observed data
Slide19Qualitative research explores and tries to understand people's beliefs, experiences, attitudes, behaviour and interactions. It generates non-numerical data. The best-known qualitative research-methods include in-depth interviews, focus groups, documentary analysis and participant observation.
Qualitative research includes
Case studies
Ethnographic studies
Field research
Grounded theory approach
Qualitative research
Slide20Longitudinal
research
Cohort
/ panel
study
Repeated measures
Times series
A longitudinal study is an observational study that involves repeated observations (measurements) of the same variable(s) over long periods of time (sometimes years or even decades).
Slide21Mixed methods
Slide22Better than a single study:
a replication study
Better than a replication study:
a systematic review / meta analysis
If there were
100 studies,
99 of which gave a ‘negative’ result (where, say, the new intervention appeared to be not effective)
, while one had a ‘positive’ result (were the intervention appeared effective), it would obviously be a mistake to consider only the single positive study.But ….
Slide23Systematic review / meta-analysis
The intention behind a systematic review is to identify as fully as possible all the scientific studies of relevance to a particular subject and to assess the validity and authority of the evidence of each study separately. As the name indicates, a systematic review takes a systematic approach to identifying studies and has the methodological quality critically appraised by multiple researchers independently of each other, as a consequence of which the review is transparent and reproducible and can be monitored. The use of statistical analysis techniques in a systematic review to pool the results of the individual studies numerically in order to achieve a more accurate estimate of the effect is termed a “meta-analysis”.
Slide24?
Systematic review / meta-analysis
Slide25Randomized controlled study
Controlled before-after study
Cohort / panel study
Before-after study
Post-test only study
Survey
Case study
ExperimentQuasi-experimentObservational studyLongitudinal studyCross-sectional studyQualitative study
Which terms belong together?