Opening Reproducible Research (o2r)
- Status
- finished
Description
Open access is not only a form of publishing such that research papers become available to the large public free of charge, it also refers to a trend in science that the act of doing research becomes more open and transparent. When science transforms to open access we mean access to papers, research data being collected, data being generated, access to the procedures carried out in the research paper, even to the computational environment that was used, in order to reproduce and inspect the findings in the paper.Reproducibility of research findings, the ability to repeat experimental procedures and confirm previously found results, is at the heart of the scientific method. For many sciences the reproduction involves the replication of an experimental set up, e.g. in the lab or a field mission to collect data. Increasingly, scientific results are generated by numerical manipulation of data that were already collected, and may involve simulation experiments that are completely carried out computationally.In this proposal Opening Reproducible Research (ORR) we directly aim for the main aspects of open access, by improving the exchange of, by facilitating productive access to and by simplifying reuse of research results that are published over the Internet. The experimentally oriented proposal ORR aims at both the publication process (technische und organisatorische Aspekte des Publikationsprozesses) and the reuse of publications (Absichern der möglichst umfassenden Nachnutzbarkeit der Publikationen), but combines these goals by setting a clear innovation in the area of reproducible research, a goal that has extraordinary meaning for scientific publication. Central to the proposal is a new form for creating and providing research results, the executable research compendium (ERC), which not only enables third parties to reproduce the original research and hence recreate the original research results (figures, tables), but also facilitates interaction with them and the recombination of them with new data or methods. The container format that specifies the ERC will store all information required by different applications (e.g. one-click reproduce, long-term archive, research information systems, discovery purposes) and thus guarantees use independent from original information systems. Building on existing open standards and software, this project will develop standards and tools for ERCs and demonstrate and evaluate these based on fully fledged case studies, initially taken from the geosciences domain. ORR will make a step forward towards executable papers as a new standard in scientific publication. Persons
- Dr. Stephanie Klötgen
- Dr. Markus Konkol
- Professor Dr. Christian Kray
- Jörg Lorenz
- Dr. Daniel Nüst
- Professor Dr. Edzer Pebesma
- Diplom-Geologe Holger Przibytzin
- Marc Schutzeichel
- Dr. Beate Tröger
Publications
- . . Infrastructures and Practices for Reproducible Research in Geography, Geosciences, and GIScience Dissertation thesis, Universität Münster. Zenodo. doi: 10.5281/zenodo.4768096.
- . . A Web service for executable research compendia enables reproducible publications and transparent reviews in geospatial sciences. Zenodo. doi: 10.5281/zenodo.4818119.
- . . AGILE Reproducible Paper Guidelines.: OSF. doi: 10.17605/OSF.IO/CB7Z8.
- . ‘Creating interactive scientific publications using bindings.’ Proceedings of the ACM on Human-Computer Interaction 3, No. EICS. doi: 10.1145/3331158.
- . . ‘Guerrilla Badges for Reproducible Geospatial Data Science.’ In Accepted Short Papers and Posters from the 22nd AGILE Conference on Geo‐information Science, edited by . Limassol, Cyprus: Stichting AGILE. doi: 10.31223/osf.io/xtsqh.
- . . How to Read a Research Compendium. https://arxiv.org/abs/1806.09525: arXiv.
- . . Reproducibility Service for Executable Research Compendia: Technical Specifications and Reference Implementation. doi: 10.5281/zenodo.2203844.
- . . ‘In-depth examination of spatiotemporal figures in open reproducible research.’ Cartography and Geographic Information Science 2018. doi: 10.1080/15230406.2018.1512421.
- . . ‘Computational reproducibility in geoscientific papers: Insights from a series of studies with geoscientists and a reproduction study.’ International Journal of Geographical Information Science 2018. doi: 10.1080/13658816.2018.1508687.
- . . ‘Reproducible research and GIScience: an evaluation using AGILE conference papers.’ PeerJ 6: e5072. doi: 10.7717/peerj.5072.
- . ‘Open Environmental Data Analysis.’ contributed to the EGU General Assembly 2018, Vienna, Austria, . doi: 10.5281/zenodo.1217911.
- . ‘rocker/geospatial: a flexible runtime environment for geoscientific data analysis.’ contributed to the EGU General Assembly 2018, Vienna, Austria, . doi: 10.5281/zenodo.1216750.
- . . Reproducible research and GIScience: an evaluation using AGILE conference papers. doi: 10.7287/peerj.preprints.26561v1.
- . . The State of Reproducibility in the Computational Geosciences. doi: 10.17605/OSF.IO/KZU8E.
- . . In-depth examination of spatio-temporal figures in open reproducible research. doi: 10.17605/OSF.IO/Q53M8.
- . ‘Reproducible research bindings.’ contributed to the European Geosciences Union General Assembly 2018, Wien, Österreich, . [accepted / in Press (not yet published)]
- . . Opening Reproducible Research: a research project website and blog. doi: 10.5281/zenodo.1485437.
- . . ‘Reproducible Research is like riding a bike.’ PeerJ Preprints 6, No. e27216v1. doi: 10.7287/peerj.preprints.27216v1.
- . ‘An Architecture for Reproducible Computational Geosciences.’ contributed to the AGILE Annual International Conference on Geographic Information Science, Wageningen, The Netherlands, . doi: 10.5281/zenodo.1478542.
- . ‘Opening reproducible research (o2r).’ contributed to the Open Science Conference, Berlin, Germany, .
- . . ‘Opening the Publication Process with Executable Research Compendia.’ D-Lib Magazine 23. doi: 10.1045/january2017-nuest.
- . ‘Executable research compendia in geoscience research infrastructures.’ contributed to the EGU General Assembly 2017, Vienna, Austria, .
- . . ‘Reproducibility and Practical Adoption of GEOBIA with Open-Source Software in Docker Containers.’ Remote Sensing 9, No. 3. doi: 10.3390/rs9030290.
- . ‘Reproducible Earth observation analytics: challenges, ideas, and a study case on containerized land use change detection.’ contributed to the EGU General Assembly 2017, Vienna, Austria, .
- . . ‘Enabling Reproducible OBIA with Open-Source Software in Docker Containers.’ Contributed to the GEOBIA 2016: Solutions & Synergies, Enschede, The Netherlands. doi: 10.3990/2.456.
- . ‘Sharing environmental models: An Approach using GitHub repositories and Web Processing Services.’ contributed to the EGU General Assembly, Vienna, .
- . ‘Opening Reproducible Research.’ contributed to the EGU, Vienna, .