(suggested by @benmarwick)

• http://rescience.github.io/
• https://github.com/topics/reproducible-paper

Process

The paper co-authors each read 2-3 research compendia using the guidelines. Papers read during the last 12 months are not allowed ;-). The lessons learned validate the process suggested in the How to.

Candidates

• https://github.com/topics/reproducible-paper
• https://github.com/bocinsky/guedesbocinsky2018/blob/master/Dockerfile
• Ruschhaupt M, Huber W, Poustka A, et al. A compendium to ensure computational reproducibility in high-dimensional classification tasks. Stat Appl Genet Mol Biol 2004;3:article 37. (http://www.bepress.com/sagmb/vol3/iss1/art37), PDF at http://www-huber.embl.de/pub/pdf/sagmb_2004.pdf
  • https://www.degruyter.com/view/j/sagmb.2004.3.issue-1/sagmb.2004.3.1.1078/sagmb.2004.3.1.1078.xml has supplemental materials (the R package, the data)
  • http://data.cgt.duke.edu/lancet.php > data URL seems dead
• Computational Reproducibility in Archaeological Research: Basic Principles and a Case Study of Their Implementation

• b2share: https://www.eudat.eu/services/userdoc/b2share-usage#Communities
• Zenodo: #8
• GitLab: #10
• ...

https://www.re3data.org/search?query=&contentTypes%5B%5D=Plain%20text&contentTypes%5B%5D=Raw%20data&contentTypes%5B%5D=Source%20code&contentTypes%5B%5D=other

Related to #7 and #8

Currently you can add tags to a project, but there is no UI: https://gitlab.com/gitlab-org/gitlab-ce/issues/2978

Current version: https://github.com/nuest/how-to-read-a-research-compendium/blob/master/research-compendium-review-matrix.pdf

Based on http://blizzard.cs.uwaterloo.ca/keshav/home/Papers/data/07/paper_review_matrix.pdf

• 1st PASS
  • code license - can I use it (checkbox)?
  • is the software useful if it works?
• 2nd PASS
  • code repository - is it active? what is the bus factor?
  • published on CRAN/PyPi or "source only"
• 3rd PASS
  • ...

And what should it comprise? The original has something on writing reviews and writing articles/scientific writing.

One could also say the RC section is already enough related work.

Please tell us what you think about https://arxiv.org/abs/1806.09525 and share https://twitter.com/nordholmen/status/1011484208211079169

@noamross @victoriastodden @codersquid @ldecicco-USGS @duncantl @rgentlem

Just like the GitHub tag (see #7) we could create a community on Zenodo to collect research compendia published on Zenodo.

Help needed

• identifier
  • research-compendium 🥇
  • reproducible-paper
• title
• description
• curation policy
  • require a corresponding journal submission?
  • require data + paper + code?
  • must have clear licenses
• logo

Required information

At the moment unchanged paragraphs are indented and italic, and the original paper is cited at each:

Is that too much?

Should we just invite Keshav as a co-author and skip all the citing?