/
18a. Complex Samples Procedures 18a. Complex Samples Procedures

18a. Complex Samples Procedures - PowerPoint Presentation

mitsue-stanley
mitsue-stanley . @mitsue-stanley
Follow
398 views
Uploaded On 2015-11-11

18a. Complex Samples Procedures - PPT Presentation

in SPSS 0 1 Prerequisites Recommended modules to complete before viewing this module 1 Introduction to the NLTS2 Training Modules 2 NLTS2 Study Overview 3 NLTS2 Study Design and Sampling ID: 190059

data full modules complex full data complex modules subset generated random file replicated results plan output dataset samples select

Share:

Link:

Embed:

Download Presentation from below link

Download Presentation The PPT/PDF document "18a. Complex Samples Procedures" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.


Presentation Transcript

Slide1

18a. Complex Samples Procedures in SPSS®

0Slide2

1Prerequisites

Recommended modules to complete before viewing this module1. Introduction to the NLTS2 Training Modules2. NLTS2 Study Overview3. NLTS2 Study Design and SamplingNLTS2 Data Sources, either

4. Parent and Youth Surveys or

5. School Surveys, Student Assessments, and Transcripts

9. Weighting and Weighted Standard ErrorsSlide3

2Prerequisites

Recommended modules to complete before viewing this module (cont’d)NLTS2 Documentation10. Overview11. Data Dictionaries12. Quick ReferencesAccessing Data

14a. Files in SPSS

15a. Frequencies in SPSS

16a. Means in SPSS

17a. Manipulating Variables in SPSSSlide4

OverviewComplex samplesAnalysis and plan filesFrequenciesCrosstabs

MeansComparative meansExampleClosingImportant information

3Slide5

NLTS2 restricted-use dataNLTS2 data are restricted.Data used in these presentations are from a randomly selected subset of the restricted-use NLTS2 data.Results in these presentations cannot be replicated with the NLTS2 data licensed by NCES.

4Slide6

Complex samplesSPSS Complex Samples is a module that accounts for complex (stratified/clustered) sampling designs, correctly calculating standard errors with weighted data.

Survey designs that call for complex sampling require different methods to calculate standard errors.Procedures we have used to this point assume a simple random sample.

5Slide7

Complex samplesWeighted standard errors produced in complex samples procedures are very

different from those in basic SPSS procedures.The Complex Samples module includes procedures forFrequenciesMeans

Crosstabs

GLM (general linear model)

Regressions.

6

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide8

Complex samplesVariation among methods for calculating standard errors

Different programs that produce weighted standard errors for complex samples will typically generate slightly different estimates.Estimated standard errors are close in SAS Survey procedures, SUDAAN, and SPSS Complex Samples procedures but are not exactly the same.There is no uniform direction for these differences; sometimes the standard errors in SPSS Complex Samples are slightly higher, and sometimes they are slightly lower.

7

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide9

Complex samplesVariation among methods for calculating standard errors (cont’d)Standard errors in our reports and published tables were calculated with formulas for estimation and may be slightly different from those produced by SPSS Complex Samples procedures.

Ours tend to be slightly larger than those from SPSS.Standard errors produced by the general procedures in SPSS—frequencies, crosstabs, or descriptives—differ greatly from those generated by Complex Samples.

Don’t use unweighted standard errors!

8

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide10

Analysis and plan filesHow to prepare the data to use complex samplesThe first step is to create an analysis data set.

Combine data or select an existing file from a given source/wave.Once the analysis file has been created or selected, two variables need to be added to that file.Add “Stratum” and “Cluster” found in n2sample.sav.When the analysis and sample data are joined, the next step is to create a plan file.

A plan file is an external file that contains the sample design parameters and the appropriate weight.

9

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide11

Analysis and plan filesThe plan file is set up through a menu-driven wizard.

Analyze: Complex Samples: Prepare for AnalysisSelect “Create a Plan File” and “

Browse

” to assign a name and location of the plan file in the pop-up window.

Click “Next” to go to the “

Stage 1 Design Variables

” window.

Select “

Stratum

” and click the right-facing arrow to move the variable to the “

Strata

” box.

Select “

Cluster

” and click the right-facing arrow to move the variable to the “

Clusters

” box

Select the appropriate weight and click the right-facing arrow to move the variable to the “

Sample Weight

” box.

Click “Next” to go to the “

Stage 1 Estimation Method

” window.

Select “

WR

” for with replacement.

Click “

Finish.

10

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide12

Analysis and plan files

11

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide13

Analysis and plan files

12

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide14

Analysis and plan files

13

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide15

FrequenciesHow to run frequencies in Complex Samples

Running a frequency or any other procedure is not much different than in the base SPSS procedures once the plan file has been created and selected.Syntax for frequencies

*Complex Samples Frequencies.

CSTABULATE

/PLAN FILE = 'C:\Projects\Data\MyPlan.csaplan‘

/TABLES VARIABLES = w2_Age4

/CELLS POPSIZE TABLEPCT

/STATISTICS SE

/MISSING SCOPE = TABLE CLASSMISSING = EXCLUDE.

14

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide16

FrequenciesFrom menu, selectAnalyze: Complex Samples: Frequencies

Select sample plan file.May not be necessary to select the file; will often remember most recent file used.If no file is automatically selected, from “Browse” select the sample plan file created for analysis.Select “Open

” and “

Continue

.”

Select “

Statistics

” and “

Table Percent

” in pop-up window.

Select variable(s) and click the right-facing arrow to move to the “Frequency Tables” box.

Click “

OK

” or “

Paste

” to run from syntax editor.

15

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide17

CrosstabsHow to run crosstabsSyntax for crosstabs

* Complex Samples Crosstabs.

CSTABULATE

/PLAN FILE = 'C:\Projects\Data\MyPlan.csaplan‘

/TABLES VARIABLES = w2_Age4 BY w2_incm3

/CELLS POPSIZE COLPCT

/STATISTICS SE

/MISSING SCOPE = TABLE CLASSMISSING = EXCLUDE.

16

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide18

CrosstabsFrom menu, select

Analyze: Complex Samples: CrosstabsSelect sample plan file.Select “Open” and “

Continue.

Select “

Statistics

” and “

Column Percent

” in pop-up window.

Select the comparative (by-) variable for “

Column

” and the analysis variables for “

Row

” by selecting variables and clicking the appropriate right-facing arrow.

Click “

OK

” or “

Paste

” to run from syntax editor.

17

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide19

MeansHow to run meansSyntax for means

* Complex Samples Descriptives.

CSDESCRIPTIVES

/PLAN FILE =

'C:\Projects\Data\MyPlan.csaplan‘

/SUMMARY VARIABLES =ndaCalc_pr

/MEAN

/STATISTICS SE

/MISSING SCOPE = ANALYSIS CLASSMISSING = EXCLUDE.

18

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide20

MeansFrom menu, select

Analyze: Complex Samples: DescriptivesSelect sample plan file.Select “

Open

” and “

Continue.

Select the variable for “

Measures.

Click “

OK

” or “

Paste

” to run from syntax editor.

19

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide21

Comparative meansHow to run comparative meansSyntax for comparative means

* Complex Samples Descriptives.

CSDESCRIPTIVES

/PLAN FILE = 'C:\Projects\Data\MyPlan.csaplan‘

/SUMMARY VARIABLES = ndaCalc_pr

/SUBPOP TABLE=w2_incm3 DISPLAY=LAYERED

/MEAN

/STATISTICS SE

/MISSING SCOPE=ANALYSIS CLASSMISSING=EXCLUDE.

20

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide22

Comparative meansFrom menu, select

Analyze: Complex Samples: DescriptivesSelect sample plan file.Select “Open” and “

Continue.

Select the variable and click the right-facing arrow for “

Measures

” and comparative variable for “

Subpopulations.

Click “

OK

” or “

Paste

” to run from syntax editor.

21

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide23

ExampleOpen the file created in Module 14a, Accessing Data Files in SPSS, PrScoresEmp.Sav.

Merge sample data from n2sample.sav file.Create a plan file called PrScoresPlan.Weight variable will be wt_na.Using complex samples, run

Frequency of ndaF1_Friend

Crosstab of ndaF1_Friend by na_Age4 and w2_Dis12

Are differences significant?

If so, how do perceptions vary based on age? On disability category?

Means of ndaPC_pr

Comparative means of ndaPC_pr by na_Age4 and w2_Dis12.

22

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide24

Example

23

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide25

Example

24

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide26

Example

25

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide27

Example

26

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide28

Example

27

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide29

Example detail

28

These results cannot be replicated with full dataset; all output

in modules generated with a random subset of the full data.Slide30

ClosingTopics discussed in this moduleComplex samplesAnalysis and plan filesFrequencies

CrosstabsMeansComparative meansExampleNext module:19. Multivariate Analysis Using NLTS2 Data

29Slide31

Important informationNLTS2 website contains reports, data tables, and other project-related information

http://nlts2.org/Information about obtaining the NLTS2 database and documentation can be found on the NCES website http://nces.ed.gov/statprog/rudman/General information about restricted data licenses can be found on the NCES website

http://nces.ed.gov/statprog/instruct.asp

E-mail address: nlts2@sri.com

30