Presentations Hormone samplingKristin Eye trackingLee fMRIJerome Specific physio measures and examples Electromyography Measures of arousal Galvanic skin response Pupillary response ID: 577850
Download Presentation The PPT/PDF document "Physiological and implicit measures" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Internet and computer researchSlide2
Presentations
Computer simulation
Smart phones
Virtual realitySlide3
Examples of internet research
Types (Gosling & Winter, 2015)
Translational
Phenomenological
Novel
Resources
Yougov.com
TESS
Google (e.g.,
ngrams
)Slide4
Machine learning
What is it?
What is it used for?
What are the problems with it? Slide5
What makes big data big?
Cattell’s data box
Persons
Variables
OccasionsSlide6
Advantages to online data collection?Slide7
Disadvantages? Slide8
Ethical issues
Anonymity and confidentiality
Consenting people (and who gave consent)
Privacy
Nonnaive
participants/data quality
Researcher df
Compensation
Decreased external validitySlide9
mTurk
How frequently is it used?
In 2015, up to 45% of articles in major psych journals had at least one
mTurk
study (B,T,G, 2018)
Putting data quality/participant characteristics aside, what issues does that create? Slide10
mTurk
articles
Buhrmeister
et al., 2018
Chandler &
Paolacci
, 2017 “lie for a dime”
Arditte
et al., 2016
Chandler et al., 2020Slide11
Figure 2. Absolute and relative frequencies for participant source (MTurk, other crowdsource, college, and other) in 2005, 2010, and 2015.
DOI: (10.1177/0146167218798821) Anderson et al., 2018 Slide12
How do
mTurk
samples compare to other types of samples?
Are they getting better or worse?
How honest are they (Chandler &
Paolacci
, 2017)?
What other issues should you consider (Zhou &
Fishbach
, 2016;
Arditte
et al., 2016)? Slide13
Concern 1: Attentiveness
What are possible options to address this?
(Hauser,
Paolacci
, & Chandler, in press)Slide14
Concern 2: English skills
What are the possible options to address this? Slide15
Concern 3: Non-naive
What are the possible options to address this? Slide16
Concern 4: Honesty
What are the possible options to address this? Slide17
Concern 5: Attrition
What are the possible options to address this? Slide18
Concern 6: Self-selection to studies
What are the possible options to address this? Slide19
Best practices for collecting data on
mTurk
How much should you pay?
Should you use attention checks or not?
What qualifications should you put on workers?
Should you use an honesty check?
Should you exclude on certain characteristics? Slide20
Things are always good to do
Explicitly encourage honesty
Be clear in your instructions and measures
Keep the study as short as possible
Thank people and explain the reason for your tasks (make them meaningful)
Let them know you’re a nonprofit
Conceal research question
Use between-participants manipulations
Make study seem important and interestingSlide21
Things specific to mTurk
Use
Cloudresearch
or a similar system (helps with expenses and to refresh study)
Make subtle prescreen, do at 2 times, or direct those who don’t fit to a different study
Collect IP addresses and check them for duplicates, geography, and VPS
Collect worker numbers (especially if screening issues)—and not just of those who complete
Prevent those who have done similar studies from doing this oneSlide22
Collect response time and use it for screening
Use infrequency or attention check measures rather than relies on outlier analyses
Use validated measures
But not ones that are often used
Near the end
Make them look like regular items
Pre-register (including data cleaning plans)
Ask questions that only people from your target group could answerSlide23
Useful links
https://michaelbuhrmester.wordpress.com/mechanical-turk-guide/
http://www.mturk-tracker.com/
https://prolific.ac/
https://www.reddit.com/r/TurkerNation/
https://www.mturkcrowd.com/
http://mturkforum.com/index.php
https://forum.turkerview.com/Slide24
Things to remember for
Qualtrics
Click prevent ballot stuffing
Use quota randomization
Close study at the end and download incomplete data as wellSlide25
Things to remember about reporting
Look for attrition effects and their effects
Mention details in your study—what criteria you used, attrition rates, attention checks
And also…
Spend time as a workerSlide26
Next week
Qualitative research
Chapter
3 articles
Final presentation
Monday, May 4—qualitative method assignmentSlide27
Final Exam
In the exam, you will use information you learned from throughout the semester to a) design a study and answer questions about it; and b) critique an article/study.
I’ll email it out by this weekend.
Appropriate citations and excellent APA style are expected.
Wednesday, May 6