Supporting the research worflow Brian Nosek University of Virginia Improving science with openness Topdown fast but narrow Funders levers only for grantee projects Journals only at point of publication ID: 580679
Download Presentation The PPT/PDF document "Open Science Framework:" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Open Science Framework:Supporting the research worflow
Brian
Nosek
University of VirginiaSlide2
Improving science with opennessTop-down – fast, but narrow
Funders: levers only for grantee projects
Journals: only at point of publication
Bottom-up – slow, but comprehensive
Researcher’s entire workflow part of the cumulative record
Leverage norms rather than requirementsSlide3
Opening the research workflowRegistration is one pieceSlide4
Open Science Framework (OSF)Web app and tools for
collaborating, documenting,
archiving, sharing,
and registering science
Respect workflow
Robust to different workflows
Integrate private and public workflows
Incentivize openness
Support top-down and bottom-up
incentivizationSlide5
Registration
Existing solutions are:
Discipline specific
Appended to the workflow
Constrained to a point in time
Content restrictive
OSF registration is none of those. Instead:
Templating
Integrated in the workflow
Any time, any frequency
Registers everythingSlide6
OSF DemoCollaborator and Lead Developer: Jeff Spies
Open Science FrameworkSlide7Slide8
Open Science Framework (OSF)For collaboration, documentation, archiving, sharing, registration
Integrates components of workflow
Replaces ad hoc archiving with shared solution
Merges private and public workflows
Integrates top-down and bottom-up solutions
Breaks disciplinary silos
Connects infrastructureSlide9
Set up your OSF accounthttp://openscienceframework.org/Slide10
The SellHow can you get credit for doing good science?
Stick versus CarrotSlide11Slide12Slide13Slide14Slide15Slide16Slide17Slide18Slide19Slide20Slide21Slide22Slide23Slide24Slide25Slide26Slide27Slide28Slide29Slide30Slide31
TODOMetadata SystemCommenting
Dropbox
-like File Syncing
Finer-Grained Collaborator Information and Access Control
Exploring the Scientific/Collaborator Network
Application Programming Interface (API)Slide32Slide33Slide34Slide35
Improving ScienceOpen data, materials, and workflow
Registration
Structured replication process
Shifting incentives
By journals, funders, and infrastructureSlide36
3. Structured replicationsDesign
Peer-review prior to data collection
Publicly registered materials and analysis plan
Simultaneous replications on same methods
Features
Incentives for doing replications and reporting well
Avoid researchers’ degrees of freedom
Minimize methodology and quality drift
Sharing and communication
See
Call for Proposals for Special Issue of Social PsychologySlide37
4. Shifting IncentivesJournals and funders require disclosure
Journals credit openness and registration
Badges
Publishing replications
Gaining reputation with openness
Indicators of use; Functional citationsSlide38
1. OpennessBarriers
Extra work
Incentives
Emerging infrastructure options
Many open data
Some open materials
Little open workflow
No integrationSlide39
Collaboration Tools
Materials search
and acquisition
Data Repository
Registration
Study Documenting Archiving
Clinicaltrials.gov
Dataverse
Email file sharing
Folders on desktop
Email authors/Recreate