Abstract
The quality of volunteered geographic information (VGI) is questionable as it emerges through a diversity of contributors. The reputation of a contributor is increasingly applied to VGI quality assessment and its assurance. Research on how to measure and validate reputation, however, is still required. This study proposes an evaluation-based weighted PageRank (EWPR) algorithm to provide a ranking metric of reputation. Ranking is established on the basis of the assumptions that: (a) there is an evaluation relationship between VGI contributors; (b) the reputation of a contributor is movable within the VGI community; and (c) highly active contributors are more likely to have high reputation. By means of case studies using OpenStreetMap, two existing methods are compared with the EWPR algorithm. The results show that the algorithms used for web pages and social network participants are applicable to understand the reputation of VGI contributors. This study also applies credibility, based on reputation, as a popular indicator of VGI quality. The high correlation between credibility and VGI characteristics indicates that reputation is useful for dealing with quality variability in VGI.
Original language | English |
---|---|
Pages (from-to) | 1439-1459 |
Number of pages | 21 |
Journal | Transactions in GIS |
Volume | 25 |
Issue number | 3 |
Early online date | 4 Mar 2021 |
DOIs | |
Publication status | Published - Jun 2021 |
Keywords
- ITC-ISI-JOURNAL-ARTICLE
Access to Document
Other files and links
Fingerprint
Dive into the research topics of 'Ranking of VGI contributor reputation using an evaluation-based weighted pagerank'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver
}
Ranking of VGI contributor reputation using an evaluation-based weighted pagerank. / Zhang, D.; Ge, Y.; Stein, A.; Zhang, W.-B.
In: Transactions in GIS, Vol. 25, No. 3, 06.2021, p. 1439-1459.Research output: Contribution to journal › Article › Academic › peer-review
TY - JOUR
T1 - Ranking of VGI contributor reputation using an evaluation-based weighted pagerank
AU - Zhang, D.
AU - Ge, Y.
AU - Stein, A.
AU - Zhang, W.-B.
N1 - Export Date: 26 May 2021 CODEN: TRGIF Correspondence Address: Ge, Y.; State Key Laboratory of Resources & Environmental Information System, China; email: gey@lreis.ac.cn Correspondence Address: Ge, Y.; University of Chinese Academy of SciencesChina; email: gey@lreis.ac.cn References: Adler, B.T., de Alfaro, L., Kulshreshtha, A., Pye, I., Reputation systems for open collaboration (2011) Communications of the ACM, 54 (8), pp. 81-87. , https://doi.org/10.1145/1978542.1978560; Antoniou, V., Skopeliti, A., Measures and indicators of VGI quality: An overview (2015) ISPRS Annals of Photogrammetry, Remote Sensing & Spatial Information Sciences, 1, pp. 345-351. , https://doi.org/10.5194/isprsannals-II-3-W5-345-2015; Arkin, E.M., Chew, L.P., Huttenlocher, D.P., Kedem, K., Mitchell, J.S., An efficiently computable metric for comparing polygonal shapes (1991) IEEE Transactions on Pattern Analysis & Machine Intelligence, 13 (3), pp. 209-216. , https://doi.org/10.1109/34.75509; Bishr, M., Janowicz, K., Can we trust information? The case of volunteered geographic information (2010) Proceedings of the Towards Digital Earth: Search, Discover and Share Geospatial Data Workshop at the Future Internet Symposium, , Berlin, Germany; Bishr, M., Kuhn, W., Trust and reputation models for quality assessment of human sensor observations (2013) Spatial information theory, 8116, pp. 53-73. , T. Tenbrink, J. Stell, A. Galton, Z. Wood, (Eds.),, (Lecture Notes in Computer Science (, Cham, Switzerland, Springer; Box, G.E., Meyer, R.D., An analysis for unreplicated fractional factorials (1986) Technometrics, 28 (1), pp. 11-18. , https://doi.org/10.1080/00401706.1986.10488093; Brin, S., Page, L., The anatomy of a large-scale hypertextual Web search engine (1998) Computer Networks & ISDN Systems, 30 (1), pp. 107-117. , https://doi.org/10.1016/S0169-7552(98)00110-X; Degrossi, L.C., de Albuquerque, J.P., Rocha, R.D., Zipf, A., A taxonomy of quality assessment methods for volunteered and crowdsourced geographic information (2018) Transactions in GIS, 22, pp. 542-560. , https://doi.org/10.1111/tgis.12329; Fan, H.C., Zipf, A., Fu, Q., Neis, P., Quality assessment for building footprints data on OpenStreetMap (2014) International Journal of Geographical Information Science, 28, pp. 700-719. , https://doi.org/10.1080/13658816.2013.867495; Flanagin, A.J., Metzger, M.J., The credibility of volunteered geographic information (2008) GeoJournal, 72 (3-4), pp. 137-148. , https://doi.org/10.1007/s10708-008-9188-y; Fogliaroni, P., D'Antonio, F., Clementini, E., Data trustworthiness and user reputation as indicators of VGI quality (2018) Geo-Spatial Information Science, 21 (3), pp. 213-233. , https://doi.org/10.1080/10095020.2018.1496556; Goodchild, M.F., Li, L.N., Assuring the quality of volunteered geographic information (2012) Spatial Statistics, 1, pp. 110-120. , https://doi.org/10.1016/j.spasta.2012.03.002; Gusmini, M., Jabeur, N., Karam, R., Melchiori, M., Renso, C., Reputation evaluation of georeferenced data for crowd-sensed applications (2017) Procedia Computer Science, 109, pp. 656-663. , https://doi.org/10.1016/j.procs.2017.05.372; Haklay, M., How good is volunteered geographical information? A comparative study of OpenStreetMap and Ordnance Survey datasets (2010) Environment & Planning B, 37, pp. 682-703. , https://doi.org/10.1068/b35097; Hovland, C.I., Janis, I.L., Kelley, H.H., (1953) Communication and persuasion: Psychological studies of opinion change, , New Haven, CT, Yale University Press; Jackson, S.P., Mullen, W., Agouris, P., Crooks, A., Croitoru, A., Stefanidis, A., Assessing completeness and spatial error of features in volunteered geographic information (2013) ISPRS International Journal of Geo-Information, 2, pp. 507-530. , https://doi.org/10.3390/ijgi2020507; Lodigiani, C., Melchiori, M., A PageRank-based reputation model for VGI data (2016) Procedia Computer Science, 98, pp. 566-571. , https://doi.org/10.1016/j.procs.2016.09.088; Maué, P., Reputation as tool to ensure validity of VGI (2007) Paper presented at the VGI Specialist Meeting, , Santa Barbara, CA; Mooney, P., Corcoran, P., Analysis of interaction and co-editing patterns amongst OpenStreetMap contributors (2014) Transactions in GIS, 18, pp. 633-659. , https://doi.org/10.1111/tgis.12051; Muttaqien, B.I., Ostermann, F.O., Lemmens, R.L.G., Modeling aggregated expertise of user contributions to assess the credibility of OpenStreetMap features (2018) Transactions in GIS, 22, pp. 823-841. , https://doi.org/10.1111/tgis.12454; Rehrl, K., Gröechenig, S., Hochmair, H., Leitinger, S., Steinmann, R., Wagner, A., A conceptual model for analyzing contribution patterns in the context of VGI (2013) Progress in location-based services, pp. 373-388. , J. Krisp, (Ed.),, (Lecture Notes in Geoinformation and Cartography, Berlin, Germany, Springer; Severinsen, J., de Roiste, M., Reitsma, F., Hartato, E., VGTrust: Measuring trust for volunteered geographic information (2019) International Journal of Geographical Information Science, 33, pp. 1683-1701. , https://doi.org/10.1080/13658816.2019.1572893; Stein, K., Kremer, D., Schlieder, C., Spatial collaboration networks of OpenStreetMap (2015) OpenStreetMap in GIScience, pp. 167-186. , J. A. Jamal, Z. Alexander, M. Peter, H. Marco, (Eds.),, Cham, Switzerland, Springer; Truong, Q.T., de Runz, C., Touya, G., Analysis of collaboration networks in OpenStreetMap through weighted social multigraph mining (2018) International Journal of Geographical Information Science, 33, pp. 1651-1682; Xing, W., Ghorbani, A., Weighted PageRank algorithm (2004) Proceedings of the Second Annual Conference on Communication Networks and Services Research, pp. 305-314. , Fredericton, NB, Canada (, Piscataway, NJ, IEEE; Zhang, W.-B., Leung, Y., Ma, J.-H., Analysis of positional uncertainty of road networks in volunteered geographic information with a statistically defined buffer-zone method (2019) International Journal of Geographical Information Science, 33, pp. 1807-1828. , https://doi.org/10.1080/13658816.2019.1606430; Zhou, X., Zhao, Y., A version-similarity based trust degree computation model for crowdsourcing geographic data (2016) International Archives of the Photogrammetry, Remote Sensing & Spatial Information Sciences, 41, pp. 327-333
PY - 2021/6
Y1 - 2021/6
N2 - The quality of volunteered geographic information (VGI) is questionable as it emerges through a diversity of contributors. The reputation of a contributor is increasingly applied to VGI quality assessment and its assurance. Research on how to measure and validate reputation, however, is still required. This study proposes an evaluation-based weighted PageRank (EWPR) algorithm to provide a ranking metric of reputation. Ranking is established on the basis of the assumptions that: (a) there is an evaluation relationship between VGI contributors; (b) the reputation of a contributor is movable within the VGI community; and (c) highly active contributors are more likely to have high reputation. By means of case studies using OpenStreetMap, two existing methods are compared with the EWPR algorithm. The results show that the algorithms used for web pages and social network participants are applicable to understand the reputation of VGI contributors. This study also applies credibility, based on reputation, as a popular indicator of VGI quality. The high correlation between credibility and VGI characteristics indicates that reputation is useful for dealing with quality variability in VGI.
AB - The quality of volunteered geographic information (VGI) is questionable as it emerges through a diversity of contributors. The reputation of a contributor is increasingly applied to VGI quality assessment and its assurance. Research on how to measure and validate reputation, however, is still required. This study proposes an evaluation-based weighted PageRank (EWPR) algorithm to provide a ranking metric of reputation. Ranking is established on the basis of the assumptions that: (a) there is an evaluation relationship between VGI contributors; (b) the reputation of a contributor is movable within the VGI community; and (c) highly active contributors are more likely to have high reputation. By means of case studies using OpenStreetMap, two existing methods are compared with the EWPR algorithm. The results show that the algorithms used for web pages and social network participants are applicable to understand the reputation of VGI contributors. This study also applies credibility, based on reputation, as a popular indicator of VGI quality. The high correlation between credibility and VGI characteristics indicates that reputation is useful for dealing with quality variability in VGI.
KW - ITC-ISI-JOURNAL-ARTICLE
UR - https://ezproxy2.utwente.nl/login?url=https://doi.org/10.1111/tgis.12735
UR - https://ezproxy2.utwente.nl/login?url=https://library.itc.utwente.nl/login/2021/isi/stein_ran.pdf
U2 - 10.1111/tgis.12735
DO - 10.1111/tgis.12735
M3 - Article
VL - 25
SP - 1439
EP - 1459
JO - Transactions in GIS
JF - Transactions in GIS
SN - 1361-1682
IS - 3
ER -