Home Home | About Us | Sitemap | Contact  
  • Info For
  • Professionals
  • Students
  • Educators
  • Media
  • Search
    Powered By Google

 

SIOP 2018 Reproducible Research Presenter Guidelines

Congratulations on your accepted submission(s) and thanks for your interest and willingness to help advance reproducible research (RR) in its second year at SIOP2018!  For a refresher on what RR entails and the potential benefits it brings to SIOP2018 and our research and practice more generally, please refer back to the SIOP RR Submission Guidelines.

The focus herein will be more tactical, explaining how to move from agreeing to participate in RR for a SIOP2018 session to explaining the steps required to make it happen before the conference.  In general, the goal would be to have all RR presenters submit and post their data and code before the conference so that individuals attending the sessions might have an opportunity to access the data and source code in advance.  The earlier each presenter can make the materials available, the better.

First, we provide and outline the general steps to make your information available for SIOP2018. Second, we provide links to resources which provide guides and tutorials specific to getting started with three different commonly used file sharing applications.

Step 1:  Establish an account with a cloud-based code/data sharing provider

  • Many free sharing applications are available that are compatible with RR. 
  • If you do not already have one, establishing a free account with one of these providers will allow you to upload and share your data and code files with the broader SIOP community. 
  • A few examples of file sharing providers include GitHub, Google Drive, Dropbox, figshare, dryad, zenodo, and Academic Torrents.
  • Links to resources to assist with getting started with GitHub, Google Drive, and Dropbox are provided later in these presenter guidelines.
  • GitHub works very well with open source statistical software such as R.  GitHub can handle very large datafiles and code files, but it requires more technical skill to learn and use.  This application is commonly used by programmers for open source software development projects. 
  • Dropbox and Google Drive are more intuitive and user friendly and were designed with a broader audience in mind.  Thus, these file sharing applications carry a less steep learning curve to get started.    
  • In summary, all data sharing applications carry unique pros and cons, and there is not one right way to engage in RR. 
  • While there are no restrictions on which application you choose to use to share your RR data and code, we encourage you to try out several to get a better sense of each application’s features and to determine which one you like the best for sharing your research.    

Step 2:  Ready your materials for uploading

  • Remove potentially sensitive or restricted information
    • Remove any potentially sensitive information, such as personally identifiable information associated with your sample.
    • Ensure you are comfortable with having all contents contained within the final data and code you plan to share made public, and also ensure that you have obtained the proper approvals to share the data and code as may be necessary. 
    • If you have concerns or restrictions related to sharing your data, we would encourage you to create a mock datafile with similar characteristics of the original data to share in its place.
  • Prepare your code/syntax 
    • At the top of your syntax file, indicate in a programmer note the name of the statistical software program in which the code is written.
    • Add helpful programmer or commented notes in the base code to offer additional context, instruction, or clarity for your SIOP colleagues accessing the materials.
  • Prepare your data file
    • Label the data file in a manner that will be intuitive for your colleagues associate with your accepted presentation.
    • Creating a data dictionary is an example of a way you can aid others in interpreting your data file.
  • Save the code and data into formats compatible with open source sharing
    • If the code and data you share was not created in an open source analysis program such as R (i.e., if you conducted the analysis using SPSS, SAS, MPLUS, etc.), please save the final code you plan to share as a text (.txt) file and the data in a commonly used spreadsheet format such as Microsoft Excel or Google Spreadsheets.   

Step 3:  Upload your materials and make them retrievable

  • Upload the supplemental materials you intend to share with the broader SIOP community related to your presentation.
  • Gather your hyperlink(s).  We recommend sharing so that the files can be viewed and downloaded, but that the original cannot be modified (e.g., in Dropbox, sharing a link as “view only”).
  • Test the shareable hyperlink(s) to ensure the links provide access to the materials you desire and function in the manner you intended.
  • Send your hyperlink(s) to SIOP by emailing them to Rob Stilson at robstilson@gmail.com.
  • Hyperlinks will be cataloged in a document available to all SIOP members.
    • Please also share the following information:
      • Session Type (Poster, Symposium, etc.), Presentation Title, Content Area(s), Presenter, Code/Syntax Language (R, Python, SPSS Syntax, etc.), Reproducible Analyses (CFA, Cluster Analysis, SEM, Various Data Viz, etc.), Data Shared? (Y or N)

Step 4:  Present your RR at the SIOP conference

  • Plan to spend 1 minute at the end of your presentation sharing with the audience that your presentation uses RR.  Let them know how they can get access to your materials. 
  • Consider creative sharing methods such as providing your Twitter handle, short URLs, or a QR code to link to your shareable materials for easier access.
  • Insert information into your presentation materials highlighting the specific RR qualities and aspects of your presentation.
  • We recommend inserting the following details within your presentation content:
    • RR logo (copy logo from here)
    • Short description of type of RR materials made available (e.g., syntax; data; etc.)
    • Statistical software/coding language utilized with analyses/syntax (e.g., R, SPSS, MPlus)
    • URL to access RR materials: (e.g., github address)
    • Consider other helpful information such as types of analyses conducted

Resources and Reference Guides

2018 SIOP Conference Presentation Guidelines and Suggestions

Below, several links to resources are provided to help guide new users through getting started with three commonly used sharing platforms.

GitHub.  To use GitHub, you can find instructions on getting started by visiting the GitHub Hello World guide.  You can also explore additional guides made available on the GitHub website.  The GitHub YouTube channel provides video tutorials.

Dropbox.  To establish a Dropbox account, go to https://www.dropbox.com and view the information available on the primary webpage that walks you through features and setting up an account.  If you need additional assistance, you can explore the Dropbox Help Center.  Exploring the Dropbox YouTube channel or searching YouTube for Dropbox Tutorials may also be beneficial.

Google Drive.  A Google Drive account can be established by visiting https://www.google.com/drive/.  From this page, you can also find links to information about using Drive, as well as the Google Drive Help page.  As with the prior two, exploring YouTube for Google Drive video tutorials may also be beneficial.

Conclusion

Thank you again for your willingness to contribute toward increasing the collective knowledge-base and level of transparency within the broader I-O community.  Any additional questions about SIOP Reproducible Research not answered above or in the SIOP RR Submission Guidelines should be directed to Rob Stilson (robstilson@gmail.com) of the 2018 Program Committee. 


Return to 2018 Conference Page | Presenter Guidelines Page