Ellen Bara Stolzenberg PhD Dominique Harrison UCLA Higher Education Research Institute Survey Administration A DMINISTRATION amp PLANNING B EST PRACTICES C OLLEGE IMPACT ADMINISTRATION amp PLANNING ID: 804388
Download The PPT/PDF document "From Administration to Z-Scores: An Over..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
From Administration to Z-Scores: An Overview of Survey Research
Ellen Bara Stolzenberg, Ph.D.
Dominique Harrison
UCLA Higher Education Research Institute
Slide2Survey Administration
A
DMINISTRATION & PLANNING
B
EST PRACTICES
C
OLLEGE IMPACT
Slide3ADMINISTRATION & PLANNING: FIVE Ws and an H
W
ho
WhatW
henWhereWhyHow
*Not necessarily in this order
Slide4WHAT & WHY
Overall
purpose of survey/study
Research questionsGoals for data use, policy, & practiceLongitudinal or cross-sectional
Slide5WHAT & WHY (continued)
Audience
?
Stakeholders?Is a survey the best option?Existing instrument vs. Design your own
Slide6Existing instrument vs. Design your own
Existing instruments?
Existing literature?
PilotFocus groups to help design/redesign
Types of QuestionsValidity & Reliability
Slide7Validity & ReliabilityValidity
Does it measure what it is designed to measure
?
Reliability Does the measurement give consistent results?
Slide8WHOPopulation vs. Sample
Population of interest
Freshmen
FacultyGraduate StudentsSTEM UndergraduatesEtc.Survey all or sub-sample?
Slide9WHO (continued)Personal Identifiers
Confidentiality vs. Anonymity
Merging data
Slide103 Dreaded Letters
Slide11WHEN, WHERE, & HOWTime of year
Time of term
Time of week
Time of dayMode of administration
Proctored settingPre-notificationIncentives
Slide12BEST PRACTICESAdministration
Paper vs. Web
Follow-up (reminders, communication)
AdvertisingSurvey length
Slide13COLLEGE IMPACTReports & Deliverables
Disseminating Data
Format
AudienceModeMerging Data
Analysis & Interpretation
Slide14Analysis & Interpretation
Descriptives
Frequency distributions
CrosstabsFactor Analysis/ConstructsGroup Comparisons
T-tests/ANOVA & Post-hoc testsLongitudinal StudiesRegression
Slide15Discussion & QuestionsCampus-specific concerns?
Examples with varying levels of success?
General questions
?
Slide16Contact Information
www.heri.ucla.edu
Ellen Stolzenberg
stolzenberg@gseis.ucla.edu310-825-6991Dominique Harrison
heri@ucla.edu310-825-7079