Module 3 presentation - PowerPoint Presentation

Module 3 presentationWriting items

OutlinePurpose of survey items.Goals for writing items.Guidelines for writing items.Rating scales. Response options.Formatting considerations.Skip patterns. 2

OutlinePurpose of survey items.Goals for writing items. Guidelines for writing items.Rating scales. Response options.Formatting considerations.Skip patterns. 3

Purpose of survey items To gather information. 4

Purpose of survey items To gather information. To measure a construct. 5

OutlinePurpose of survey items.Goals for writing items. Guidelines for writing items.Rating scales. Response options.Formatting considerations.Skip patterns. 6

Goals for writing items Ensure validity . 7

Goals for writing itemsEnsure validity.Minimize item nonresponse. 8

Goals for writing itemsEnsure validity.Minimize item nonresponse.Minimize measurement error. 9

Measurement error 10

OutlinePurpose of survey items.Goals for writing items. Guidelines for writing items.Rating scales. Response options. Formatting considerations.Skip patterns. 11

Guidelines for writing items 12

Be specific13 Do you work full-time ? About how many total hours per week do you usually work for pay, counting all jobs ?

Include definitions if necessary3. Writing Items 14

Avoid double-barreled itemsTo what extent are your measures of progress quantitative and objective? To what extent are your measures of progress quantitative? To what extent are your measures of progress objective? Each item should represent a unidimensional concept. 15

Avoid potential double negativesMy child’s teacher does not seem to care much about my child. Strongly agree/Agree/Disagree/Strongly disagree My child’s teacher cares about my child very much. Strongly agree/Agree/Disagree/Strongly disagree 16

Use clear directions where necessarySelect all that apply.Select only one response. Round to the nearest whole number. Do not include long-term substitute teachers in your total count. 17

Use appropriate reading level 18

Closed-ended versus open-ended items Closed-ended items: Require respondents to pick from one of several responses. Open-ended items: Allow respondents to provide their own responses. 19

Advantages of closed-ended items 20

Advantages of open-ended items 21

OutlinePurpose of survey items.Goals for writing items. Guidelines for writing items.Rating scales. Response options.Formatting considerations.Skip patterns. 22

Types of rating scales Agreement.Interest. Importance. Frequency. Degree or extent. Similarity ( like me to not like me).23

Types of rating scales Unipolar scale: ranges from lack of attribute to a high level of the attribute. 24

Unipolar example 25

Types of rating scales Unipolar scale: ranges from lack of attribute to a high level of the attribute. Bipolar scale: ranges from positive to negative (for example, agree to disagree ).26

Bipolar example 27

Types of rating scales Unipolar scale: ranges from lack of attribute to a high level of the attribute. Bipolar scale: ranges from positive to negative (for example, agree to disagree). Match the type of scale to the structure of the attribute. 28

Types of rating scales Unipolar scale: ranges from lack of attribute to a high level of the attribute. Bipolar scale: ranges from positive to negative (for example, agree to disagree ). Match the type of scale to the structure of the attribute. 29

OutlinePurpose of survey items.Goals for writing items. Guidelines for writing items. Rating scales. Response options.Formatting considerations.Skip patterns. 30

Writing response options for scales Four to six response categories typically are used. 31

Writing response options for scales Four to six response categories typically are used. Use middle (undecided or neutral) categories thoughtfully. 32

Using a middle category 33 3. Writing Items 33

Writing response options Do not use rating scales with unlabeled options: 1 2 3 4 5 Rarely Frequently 34

Response options example 35

Make responses mutually exclusiveWhat is wrong with this item? How many years have you been teaching ?0– 5 years. 5 –10 years.10+ years.36

Make responses collectively exhaustiveWhat is wrong with this item? How often do you do assign homework?Monthly. Weekly. Daily. 37

Frequency scale example38

OutlinePurpose of survey items.Goals for writing items. Guidelines for writing items. Rating scales. Response options.Formatting considerations.Skip patterns. 39

Formatting considerations40 40

Formatting considerationsOrder all rating scales on the survey in one direction ( either negative to positive or positive to negative). 41

Formatting considerationsShade alternate rows. 42

OutlinePurpose of survey items.Goals for writing items. Guidelines for writing items. Rating scales. Response options.Formatting considerations.Skip patterns. 43

Clarify skip instructions44

Additional resourcesConverse, J. M., & Presser, S. (1986). Survey questions: Handcrafting the standardized questionnaire. Newbury Park, CA: SAGE. Fowler, F. J., Jr. (2009). Survey research methods. In L. Brickman & D. J. Rog (Series Eds.), Applied social research methods series: Vol. 1. Newbury Park, CA: SAGE. Lavrakas , P. J. (2008). Encyclopedia of survey research methods. Thousand Oaks, CA: SAGE.Swanlund, A., Brown, M., & Martin, B. (2012). HSSI Survey Workshop II. Chicago, IL: American Institutes for Research. 45

Additional resourcesFor more information, please visit the following websites:The American Association for Public Opinion Research: http://www.aapor.org/. Public Opinion Quarterly: https://poq.oxfordjournals.org/. Journal of Survey Statistics and Methodology: http://jssam.oxfordjournals.org/content/current . 46