Reproducible research and GIScience: an evaluation using AGILE conference papers

Daniel Nüst (Corresponding Author), Carlos Granell, Barbara Hofer, Markus Konkol, Frank O. Ostermann, Rusne Sileryte, Valentina Cerutti

Research output: Contribution to journalArticleAcademicpeer-review

3 Citations (Scopus)
1 Downloads (Pure)

Abstract

The demand for reproducible research is on the rise in disciplines concerned with data analysis and computational methods. Therefore, we reviewed current recommendations for reproducible research and translated them into criteria for assessing the reproducibility of articles in the field of geographic information science (GIScience). Using this criteria, we assessed a sample of GIScience studies from the Association of Geographic Information Laboratories in Europe (AGILE) conference series, and we collected feedback about the assessment from the study authors. Results from the author feedback indicate that although authors support the concept of performing reproducible research, the incentives for doing this in practice are too small. Therefore, we propose concrete actions for individual researchers and the GIScience conference series to improve transparency and reproducibility. For example, to support researchers in producing reproducible work, the GIScience conference series could offer awards and paper badges, provide author guidelines for computational research, and publish articles in Open Access formats.

Original languageEnglish
Article numbere5072
Pages (from-to)1-23
Number of pages23
JournalPeerJ
Volume6
Early online date24 Feb 2018
DOIs
Publication statusPublished - 13 Jul 2018
Externally publishedYes

Fingerprint

information science
Information Science
Information science
spatial data
Research
reproducibility
Research Personnel
Feedback
information transparency
researchers
Computational methods
honors and awards
Transparency
Motivation
Guidelines
data analysis

Keywords

  • ITC-ISI-JOURNAL-ARTICLE
  • ITC-GOLD

Cite this

Nüst, D., Granell, C., Hofer, B., Konkol, M., Ostermann, F. O., Sileryte, R., & Cerutti, V. (2018). Reproducible research and GIScience: an evaluation using AGILE conference papers. PeerJ, 6, 1-23. [e5072]. https://doi.org/10.7717/peerj.5072
Nüst, Daniel ; Granell, Carlos ; Hofer, Barbara ; Konkol, Markus ; Ostermann, Frank O. ; Sileryte, Rusne ; Cerutti, Valentina. / Reproducible research and GIScience: an evaluation using AGILE conference papers. In: PeerJ. 2018 ; Vol. 6. pp. 1-23.
@article{38af17baf36d474aa5c4f4c9bfad03e4,
title = "Reproducible research and GIScience: an evaluation using AGILE conference papers",
abstract = "The demand for reproducible research is on the rise in disciplines concerned with data analysis and computational methods. Therefore, we reviewed current recommendations for reproducible research and translated them into criteria for assessing the reproducibility of articles in the field of geographic information science (GIScience). Using this criteria, we assessed a sample of GIScience studies from the Association of Geographic Information Laboratories in Europe (AGILE) conference series, and we collected feedback about the assessment from the study authors. Results from the author feedback indicate that although authors support the concept of performing reproducible research, the incentives for doing this in practice are too small. Therefore, we propose concrete actions for individual researchers and the GIScience conference series to improve transparency and reproducibility. For example, to support researchers in producing reproducible work, the GIScience conference series could offer awards and paper badges, provide author guidelines for computational research, and publish articles in Open Access formats.",
keywords = "ITC-ISI-JOURNAL-ARTICLE, ITC-GOLD",
author = "Daniel N{\"u}st and Carlos Granell and Barbara Hofer and Markus Konkol and Ostermann, {Frank O.} and Rusne Sileryte and Valentina Cerutti",
year = "2018",
month = "7",
day = "13",
doi = "10.7717/peerj.5072",
language = "English",
volume = "6",
pages = "1--23",
journal = "PeerJ",
issn = "2167-8359",
publisher = "PeerJ",

}

Nüst, D, Granell, C, Hofer, B, Konkol, M, Ostermann, FO, Sileryte, R & Cerutti, V 2018, 'Reproducible research and GIScience: an evaluation using AGILE conference papers' PeerJ, vol. 6, e5072, pp. 1-23. https://doi.org/10.7717/peerj.5072

Reproducible research and GIScience: an evaluation using AGILE conference papers. / Nüst, Daniel (Corresponding Author); Granell, Carlos; Hofer, Barbara; Konkol, Markus; Ostermann, Frank O.; Sileryte, Rusne; Cerutti, Valentina.

In: PeerJ, Vol. 6, e5072, 13.07.2018, p. 1-23.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Reproducible research and GIScience: an evaluation using AGILE conference papers

AU - Nüst, Daniel

AU - Granell, Carlos

AU - Hofer, Barbara

AU - Konkol, Markus

AU - Ostermann, Frank O.

AU - Sileryte, Rusne

AU - Cerutti, Valentina

PY - 2018/7/13

Y1 - 2018/7/13

N2 - The demand for reproducible research is on the rise in disciplines concerned with data analysis and computational methods. Therefore, we reviewed current recommendations for reproducible research and translated them into criteria for assessing the reproducibility of articles in the field of geographic information science (GIScience). Using this criteria, we assessed a sample of GIScience studies from the Association of Geographic Information Laboratories in Europe (AGILE) conference series, and we collected feedback about the assessment from the study authors. Results from the author feedback indicate that although authors support the concept of performing reproducible research, the incentives for doing this in practice are too small. Therefore, we propose concrete actions for individual researchers and the GIScience conference series to improve transparency and reproducibility. For example, to support researchers in producing reproducible work, the GIScience conference series could offer awards and paper badges, provide author guidelines for computational research, and publish articles in Open Access formats.

AB - The demand for reproducible research is on the rise in disciplines concerned with data analysis and computational methods. Therefore, we reviewed current recommendations for reproducible research and translated them into criteria for assessing the reproducibility of articles in the field of geographic information science (GIScience). Using this criteria, we assessed a sample of GIScience studies from the Association of Geographic Information Laboratories in Europe (AGILE) conference series, and we collected feedback about the assessment from the study authors. Results from the author feedback indicate that although authors support the concept of performing reproducible research, the incentives for doing this in practice are too small. Therefore, we propose concrete actions for individual researchers and the GIScience conference series to improve transparency and reproducibility. For example, to support researchers in producing reproducible work, the GIScience conference series could offer awards and paper badges, provide author guidelines for computational research, and publish articles in Open Access formats.

KW - ITC-ISI-JOURNAL-ARTICLE

KW - ITC-GOLD

UR - https://ezproxy2.utwente.nl/login?url=https://webapps.itc.utwente.nl/library/2018/isi/ostermann_rep.pdf

U2 - 10.7717/peerj.5072

DO - 10.7717/peerj.5072

M3 - Article

VL - 6

SP - 1

EP - 23

JO - PeerJ

JF - PeerJ

SN - 2167-8359

M1 - e5072

ER -