Practical Relevance of Experiments in Comprehensibility of Requirements Specifications

Nelly Condori-Fernandez, Maia Daneva, Nicolaas Sikkel, Andrea Herrmann

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    6 Citations (Scopus)
    25 Downloads (Pure)

    Abstract

    Recently, the Requirements Engineering (RE) community has become increasingly aware of the importance of carrying out industry-relevant research. Researchers and practitioners should be able to evaluate the relevance of their empirical research to increase the likely adoption of RE methods in software industry. It is in this perspective that we evaluate 24 experimental studies on comprehensibility of software requirements specifications to determine their practical value. To that end a checklist based on Kitchenham’s approach was operationalized from a practitioner’s perspective and an analysis with respect to the main factors that affecting on comprehensibility was carried out. Although 100% of the papers reviewed reported statistically significant results, and 96% of them take examples from a real-life project. 80% of the papers do not scale to real life, 54% of the papers do not specify the context in which the results are expected to be useful. We also found that there is a lack of underlying theory in the formulation of comprehensibility questions.
    Original languageEnglish
    Title of host publication2011 First International Workshop on Empirical Requirements Engineering
    Place of PublicationUSA
    PublisherIEEE Computer Society
    Pages21-28
    Number of pages8
    ISBN (Electronic)978-1-4577-1076-6
    ISBN (Print)978-1-4577-1075-9
    DOIs
    Publication statusPublished - 30 Aug 2011
    EventFirst International Workshop on Empirical Requirements Engineering, EMPIRE 2011 - Trento, Italy
    Duration: 30 Aug 201130 Aug 2011
    Conference number: 1
    http://selab.fbk.eu/empire2011/

    Publication series

    Name
    PublisherIEEE Computer Society

    Workshop

    WorkshopFirst International Workshop on Empirical Requirements Engineering, EMPIRE 2011
    Abbreviated titleEmpiRE 2011
    CountryItaly
    CityTrento
    Period30/08/1130/08/11
    Internet address

    Fingerprint

    Requirements engineering
    Specifications
    Industry
    Experiments

    Keywords

    • METIS-278743
    • IR-77811
    • Comprehensibility
    • EWI-20390
    • Practioner’s checklist
    • Requirements specifications
    • SCS-Services
    • Experiments

    Cite this

    Condori-Fernandez, N., Daneva, M., Sikkel, N., & Herrmann, A. (2011). Practical Relevance of Experiments in Comprehensibility of Requirements Specifications. In 2011 First International Workshop on Empirical Requirements Engineering (pp. 21-28). USA: IEEE Computer Society. https://doi.org/10.1109/EmpiRE.2011.6046251
    Condori-Fernandez, Nelly ; Daneva, Maia ; Sikkel, Nicolaas ; Herrmann, Andrea. / Practical Relevance of Experiments in Comprehensibility of Requirements Specifications. 2011 First International Workshop on Empirical Requirements Engineering. USA : IEEE Computer Society, 2011. pp. 21-28
    @inproceedings{b0fb7a42fbd14ab8924677a9f8da6622,
    title = "Practical Relevance of Experiments in Comprehensibility of Requirements Specifications",
    abstract = "Recently, the Requirements Engineering (RE) community has become increasingly aware of the importance of carrying out industry-relevant research. Researchers and practitioners should be able to evaluate the relevance of their empirical research to increase the likely adoption of RE methods in software industry. It is in this perspective that we evaluate 24 experimental studies on comprehensibility of software requirements specifications to determine their practical value. To that end a checklist based on Kitchenham’s approach was operationalized from a practitioner’s perspective and an analysis with respect to the main factors that affecting on comprehensibility was carried out. Although 100{\%} of the papers reviewed reported statistically significant results, and 96{\%} of them take examples from a real-life project. 80{\%} of the papers do not scale to real life, 54{\%} of the papers do not specify the context in which the results are expected to be useful. We also found that there is a lack of underlying theory in the formulation of comprehensibility questions.",
    keywords = "METIS-278743, IR-77811, Comprehensibility, EWI-20390, Practioner’s checklist, Requirements specifications, SCS-Services, Experiments",
    author = "Nelly Condori-Fernandez and Maia Daneva and Nicolaas Sikkel and Andrea Herrmann",
    year = "2011",
    month = "8",
    day = "30",
    doi = "10.1109/EmpiRE.2011.6046251",
    language = "English",
    isbn = "978-1-4577-1075-9",
    publisher = "IEEE Computer Society",
    pages = "21--28",
    booktitle = "2011 First International Workshop on Empirical Requirements Engineering",
    address = "United States",

    }

    Condori-Fernandez, N, Daneva, M, Sikkel, N & Herrmann, A 2011, Practical Relevance of Experiments in Comprehensibility of Requirements Specifications. in 2011 First International Workshop on Empirical Requirements Engineering. IEEE Computer Society, USA, pp. 21-28, First International Workshop on Empirical Requirements Engineering, EMPIRE 2011, Trento, Italy, 30/08/11. https://doi.org/10.1109/EmpiRE.2011.6046251

    Practical Relevance of Experiments in Comprehensibility of Requirements Specifications. / Condori-Fernandez, Nelly; Daneva, Maia; Sikkel, Nicolaas; Herrmann, Andrea.

    2011 First International Workshop on Empirical Requirements Engineering. USA : IEEE Computer Society, 2011. p. 21-28.

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    TY - GEN

    T1 - Practical Relevance of Experiments in Comprehensibility of Requirements Specifications

    AU - Condori-Fernandez, Nelly

    AU - Daneva, Maia

    AU - Sikkel, Nicolaas

    AU - Herrmann, Andrea

    PY - 2011/8/30

    Y1 - 2011/8/30

    N2 - Recently, the Requirements Engineering (RE) community has become increasingly aware of the importance of carrying out industry-relevant research. Researchers and practitioners should be able to evaluate the relevance of their empirical research to increase the likely adoption of RE methods in software industry. It is in this perspective that we evaluate 24 experimental studies on comprehensibility of software requirements specifications to determine their practical value. To that end a checklist based on Kitchenham’s approach was operationalized from a practitioner’s perspective and an analysis with respect to the main factors that affecting on comprehensibility was carried out. Although 100% of the papers reviewed reported statistically significant results, and 96% of them take examples from a real-life project. 80% of the papers do not scale to real life, 54% of the papers do not specify the context in which the results are expected to be useful. We also found that there is a lack of underlying theory in the formulation of comprehensibility questions.

    AB - Recently, the Requirements Engineering (RE) community has become increasingly aware of the importance of carrying out industry-relevant research. Researchers and practitioners should be able to evaluate the relevance of their empirical research to increase the likely adoption of RE methods in software industry. It is in this perspective that we evaluate 24 experimental studies on comprehensibility of software requirements specifications to determine their practical value. To that end a checklist based on Kitchenham’s approach was operationalized from a practitioner’s perspective and an analysis with respect to the main factors that affecting on comprehensibility was carried out. Although 100% of the papers reviewed reported statistically significant results, and 96% of them take examples from a real-life project. 80% of the papers do not scale to real life, 54% of the papers do not specify the context in which the results are expected to be useful. We also found that there is a lack of underlying theory in the formulation of comprehensibility questions.

    KW - METIS-278743

    KW - IR-77811

    KW - Comprehensibility

    KW - EWI-20390

    KW - Practioner’s checklist

    KW - Requirements specifications

    KW - SCS-Services

    KW - Experiments

    U2 - 10.1109/EmpiRE.2011.6046251

    DO - 10.1109/EmpiRE.2011.6046251

    M3 - Conference contribution

    SN - 978-1-4577-1075-9

    SP - 21

    EP - 28

    BT - 2011 First International Workshop on Empirical Requirements Engineering

    PB - IEEE Computer Society

    CY - USA

    ER -

    Condori-Fernandez N, Daneva M, Sikkel N, Herrmann A. Practical Relevance of Experiments in Comprehensibility of Requirements Specifications. In 2011 First International Workshop on Empirical Requirements Engineering. USA: IEEE Computer Society. 2011. p. 21-28 https://doi.org/10.1109/EmpiRE.2011.6046251