Can app changelogs improve requirements classification from app reviews? An exploratory study

Chong Wang, Fan Zhang, Peng Liang, Maya Daneva, Marten van Sinderen

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

2 Citations (Scopus)

Abstract

Background: Recent research on mining app reviews for software evolution indicated that the elicitation and analysis of user requirements can benefit from supplementing user reviews by data from other sources. However, only a few studies reported results of leveraging app changelogs together with app reviews.

Aims: Motivated by those findings, this exploratory experimental study looks into the role of app changelogs in the classification of requirements derived from app reviews. We aim at understanding if the use of app changelogs can lead to more accurate identification and classification of functional and non-functional requirements from app reviews. We also want to know which classification technique works better in this context.

Method: We did a case study on the effect of app changelogs on automatic classification of app reviews. Specifically, manual labeling, text preprocessing, and four supervised machine learning algorithms were applied to a series of experiments, varying in the number of app changelogs in the experimental data.

Results: We compared the accuracy of requirements classification from app reviews, by training the four classifiers with varying combinations of app reviews and changelogs. Among the four algorithms, Naïve Bayes was found to be more accurate for categorizing app reviews.

Conclusions: The results show that official app changelogs did not contribute to more accurate identification and classification of requirements from app reviews. In addition, Naïve Bayes seems to be more suitable for our further research on this topic.

Original languageEnglish
Title of host publicationProceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2018
Place of PublicationPiscataway, NJ
PublisherIEEE Computer Society
Number of pages4
ISBN (Print)978-1-4503-5823-1
DOIs
Publication statusPublished - 11 Oct 2018
Event12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2018 - Oulu, Finland
Duration: 11 Oct 201812 Oct 2018
Conference number: 12

Conference

Conference12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2018
Abbreviated titleESEM
CountryFinland
CityOulu
Period11/10/1812/10/18

    Fingerprint

Keywords

  • App changelogs
  • App reviews
  • Data-driven requirements engineering
  • Machine learning
  • Requirements analysis

Cite this

Wang, C., Zhang, F., Liang, P., Daneva, M., & van Sinderen, M. (2018). Can app changelogs improve requirements classification from app reviews? An exploratory study. In Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2018 [a43] Piscataway, NJ: IEEE Computer Society. https://doi.org/10.1145/3239235.3267428