Welcome to the CIRTL Network’s

Welcome to the CIRTL Network’s Welcome to the CIRTL Network’s - Start

2016-06-20 37K 37 0 0

Download Presentation

Welcome to the CIRTL Network’s




Download Presentation - The PPT/PDF document "Welcome to the CIRTL Network’s" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.



Presentations text content in Welcome to the CIRTL Network’s

Slide1

Welcome to the CIRTL Network’s

Teaching-as-Research Capstone Seminar

Survey, Data Collection, Instruments and Questionnaires

Director,

EERCAssociate Professor and Fulton C. Noss Faculty FellowDepartment of Industrial EngineeringUniversity of Pittsburgh

Session begins at 3-4 ET/2-3 CT/1-2 MT/12-1 PT  When you join the room please run the Audio Setup Wizard: Tools Menu->Audio->Audio Setup Wizard While we wait for the session to begin, please feel free to test your microphone and webcam If you are experiencing problems and/or have questions, please type into the chat window

Dr.

Mary

Elizabeth

Besterfield

-

Sacre

Slide2

Ways to Interact during theTAR Working Session

Turn on/off your microphone:

Raise your hand if you have a question or comment

Turn on/off your video:

Use the chat window to add comments, ask questions, or request help

Slide3

Survey, Data Collection Instruments, Questionnaires

Mary Besterfield –

Sacre

Director, EERC

Associate Professor and Fulton C.

Noss

Faculty Fellow

Department of Industrial Engineering

University of Pittsburgh

Slide4

Once Upon A Time…

I was a grad student…

My research focus

Industrial statistics

Quality assurance

Finished one NSF grant in healthcare and put on another

Engineering education

Improving the freshman engineering

curriculum – integrated curriculum

I pouted…

Slide5

Integration of my skills to solve an engineering education problem

The effort needed a means to determine if change had occurred in students

Exam questions

Projects

Attitudes and perceptions of engineering

Retention in engineering

I set up my first

evaluation

plan…

Objectives, strategies, measures of the

objectives

Slide6

Thought it would take a weekend…

First researched the area of student attitudes and students leaving the STEM fieldSeymour and Hewitt – Talking About LeavingOthers in the STEM areasSearch for other instrumentsNone existedGot a great survey book - DillmanDeveloped an initial survey Some closed ended responses based on the research, but two critical open-ended responsesThings that enticed students about engineeringThings that turned students off from engineeringPiloted the 1st survey on Soph, Jr and Sr

Content Validity

Slide7

Thought it would take a weekend…

Initial data analysis

Reliability

analysis –

Crombach’s

alpha

Exploratory factor analysis

– some hypotheses

yes;

others

no

Grounded theory

approach to open-ended

questions – created new items

Revised the questionnaire

Conducted verbal protocols or

cognitive interviews

Revised the questionnaire – again

Obtained my first IRB

Human Subjects

clearance

Slide8

Thought it would take a weekend…

Launched it on Freshman engineering class

“Old” programming

Launched

it on incoming Freshman engineering class

Incoming pre attitudes about engineering

Again, at the end of their Freshman year

New” programming

Slide9

Thought it would take a weekend…

Data analysis

Confirmatory factor analysis

Establishment of

weights

based on the factor analysis

Item reliability

analysis - again

Slide10

Slide11

What did we learn?

Differences between the two cohorts of freshmenBesterfield-Sacre, ME, Atman, CJ, and Shuman, LJ. “Engineering Student Attitudes Assessment.” Journal of Engineering Education 87, no 2 (April 1998): 133-141.Prediction of freshmen who will leave engineeringBesterfield-Sacre, M.E., C.J. Atman and L.J. Shuman. “Characteristics of Freshman Engineering Students: Models for Determining Student Attrition and Success in Engineering.” The Journal of Engineering Education 86, no 2 (April 1997): 139-149.My first grantBesterfield-Sacre, M.E., M. Moreno, L.J. Shuman, and C.J. Atman. “Gender and Ethnicity Differences in Freshmen Engineering Student Attitudes: A Cross-Institutional Study.” Journal of Engineering Education 90, no 4 (October 2001): 477 - 489.

Criterion-related Validity - Concurrent Validity

Criterion-related Validity – Predictive Validity

Criterion-related

Validity -

Concurrent Validity

Slide12

Since then…

People still ask for it!

I get about 5-8 schools ask per year

A group at ASU redid the work a few years back to ‘update’ the instrument

Construct

Validity?

Demonstrates an

association between the

survey and the

prediction of a theoretical

trait

Slide13

Your questions, issues

, challenges?

Slide14

Thank You for Joining Today’s Session

What did you think of today’s session?

Please take a minute right now to fill out a 1-question survey on today’s experience:

We very much appreciate your feedback.

Slide15

Upcoming TAR Capstone Session

Working

Session: Qualitative and Quantitative Data Management and Analysis

March 17, 2014

3-4 ET/2-3 CT/1-2 MT/12-1 PTFacilitated by:Mark Urban-Lurain, Associate Professor, Center for Engineering Education Research, Michigan State University

To sign up to hear about these and other CIRTL events, email

info@cirtl.net

.

Slide16

Slide17

Slide18

Slide19

Slide20


About DocSlides
DocSlides allows users to easily upload and share presentations, PDF documents, and images.Share your documents with the world , watch,share and upload any time you want. How can you benefit from using DocSlides? DocSlides consists documents from individuals and organizations on topics ranging from technology and business to travel, health, and education. Find and search for what interests you, and learn from people and more. You can also download DocSlides to read or reference later.