Improving Integrity, Transparency, and
Reproducibility Through Connection of
the Scholarly Workflow
Andrew Sallans
Partnerships Lead
Center for Open Science
A talk on the Open Science Framework
1. Free, open source platform
2. Designed to add efficiency to workflow
3. Connector to other tools and services
So, why is this important?
Challenges: Perceived norms
Norms
Counternorms
Communality
Secrecy
Open Sharing
Universalism
Evaluate research on own merit
Disinterestedness
Motivated by knowledge and discovery
Closed
Particularlism
Evaluate research by reputation
Self-interestedness
Treat science as a competition
Organized skepticism
Organized dogmatism
Consider all new evidence, even against
one’s prior work
Invest career promoting one’s own
theories, findings
Quality
Quantity
Anderson, Martinson & DeVries, 2007
A little something about COS
•
•
•
•
•
•
Est. 2013
Non-profit tech
startup
4 leading
foundation
funders, > $14M
Located in
Charlottesville, VA
Team: ~ 25 FT &
20 interns
Mostly software
developers and
researchers
Mission: Improve openness, integrity, and
reproducibility of research
Create an account
easy and free!
http://osf.io
Modify Account Settings
Update
information
https://osf.io/settings
Dashboard
Project Organizer
Project Overview Page
Overview
Using the Wiki
In the
menu
bar
Wiki
history
Add new
or edit
Adding Components
Add a new component
Adding Contributors
Choose
permissions
Select from
the results
Privacy
Uploading Files
Click upload button
or just drag and
drop
Versioning
See version history
and download
Registering Your Work
Choose the
registration
template
Create a frozen
registered version
Sharing Your Work
Describe the
link use
Option to
make
anonymous
Create a
view-only link
Select what parts of the
project to share
Unique and permanent IDs
Scientific content must be easy to cite and
annotate
Approach: GUIDs for all content
https://osf.io/e81xl -> RPCB
https://osf.io/alh38 -> Tim Errington
https://osf.io/ibdv8 -> Coding_Study_1.xslx
Current Add Ons:
• Dropbox
• Github
• Dataverse
• Figshare
• AmazonS3
Connecting the workflow
Examples of other connections
Taking a data management plan and converting it into a
living document.
Providing a data repository lookup service and checklist
to assist with preparation for deposit.
Connecting to a sensitive video storage service.
O PEN SCI EN CE FRA M EW O RK
o sf .i o | @O SFr am ew o r k | # O SFi n A ct i o n
OSF in t h e lab
Er ica Bar ansk i
Qualtrics,
Dropbox,
Monkey,
QTools
W used:
h at t ools
do y ou
use in ySurvey
our r esear
ch ? R
OSF features used: version control, collaboration, wiki for
A
lab notebook
and meetings
Tools used: next-gen sequencers, pipeline software, custom software
OSF features used: version control, file sharing, GitHub and Dropbox
integration, public sharing.
Problem to solve: teaching undergrads how to make research
reproducible and verifiable.
OSF features used: organization of documents and data, command files,
metadata, and file sharing.
What’s underneath the hood?
•
•
•
•
•
•
•
•
•
Python
Javascript
Git
MongoDB / TokuMx
Ansible
Elasticsearch
OSF API
Rackspace
Linode
Want to join the effort?
• Contribute content to SHARE or partner on
curation of content
• Serve as an Ambassador
• Coordinate a reproducible statistics and
practices workshop
• Join the team – http://cos.io/jobs
Open Science Framework osf.io
Email: contact@osf.io
Twitter: @OSFramework