Review: Design parameters of rating scales for Web sites

Egon van den Broek

    Research output: Contribution to journalBook/Film/Article reviewAcademic

    Abstract

    With the increasing popularity of the Internet, more and more online questionnaires are being conducted. However, little research is being done on their construction, in particular on their design. The authors of this paper have conducted such a study, within the scope of rating scales for Web sites; however, their conclusions are of interest for a broader range of applications. The authors studied the influence of three design parameters (response format, questionnaire layout, and interaction mechanism) on users' behavior on rating scales, determined through perceived ease of use, perceived usefulness, disorientation, and flow. In parallel, the concepts of factor structure, reliability, validity, and sensitivity are introduced. However, their relation with perceived ease of use, perceived usefulness, disorientation, and flow remains fuzzy throughout the paper. Moreover, the relation between these concepts and the design parameters is not convincing. Hence, the psychometric properties of the research are questionable. Through two experiments, the authors found that, first, visual analogue and discrete Likert scales are equally good, and, second, a design that supports direct interaction (with radio buttons) and one item per page is preferred by users over indirect interaction (with drop-down boxes) and all items on one page. This finding was despite the fact that responses were faster with all items on one page. The research report is preceded by a thorough literature overview, and accompanied by a vast amount of analysis. Regrettably, the result is a 35-page paper, which makes the authors' important message less accessible.
    Original languageUndefined
    Pages (from-to)CR134483
    Number of pages1
    JournalACM Computing Reviews
    Publication statusPublished - 28 Jun 2007

    Keywords

    • HMI-HF: Human Factors
    • HMI-MI: MULTIMODAL INTERACTIONS
    • Web sites
    • design parameters
    • Review
    • EWI-20859

    Cite this

    @article{9310f7d38ff446d591a0696c8cb35663,
    title = "Review: Design parameters of rating scales for Web sites",
    abstract = "With the increasing popularity of the Internet, more and more online questionnaires are being conducted. However, little research is being done on their construction, in particular on their design. The authors of this paper have conducted such a study, within the scope of rating scales for Web sites; however, their conclusions are of interest for a broader range of applications. The authors studied the influence of three design parameters (response format, questionnaire layout, and interaction mechanism) on users' behavior on rating scales, determined through perceived ease of use, perceived usefulness, disorientation, and flow. In parallel, the concepts of factor structure, reliability, validity, and sensitivity are introduced. However, their relation with perceived ease of use, perceived usefulness, disorientation, and flow remains fuzzy throughout the paper. Moreover, the relation between these concepts and the design parameters is not convincing. Hence, the psychometric properties of the research are questionable. Through two experiments, the authors found that, first, visual analogue and discrete Likert scales are equally good, and, second, a design that supports direct interaction (with radio buttons) and one item per page is preferred by users over indirect interaction (with drop-down boxes) and all items on one page. This finding was despite the fact that responses were faster with all items on one page. The research report is preceded by a thorough literature overview, and accompanied by a vast amount of analysis. Regrettably, the result is a 35-page paper, which makes the authors' important message less accessible.",
    keywords = "HMI-HF: Human Factors, HMI-MI: MULTIMODAL INTERACTIONS, Web sites, design parameters, Review, EWI-20859",
    author = "{van den Broek}, Egon",
    year = "2007",
    month = "6",
    day = "28",
    language = "Undefined",
    pages = "CR134483",
    journal = "ACM Computing Reviews",
    publisher = "Association for Computing Machinery (ACM)",

    }

    Review: Design parameters of rating scales for Web sites. / van den Broek, Egon.

    In: ACM Computing Reviews, 28.06.2007, p. CR134483.

    Research output: Contribution to journalBook/Film/Article reviewAcademic

    TY - JOUR

    T1 - Review: Design parameters of rating scales for Web sites

    AU - van den Broek, Egon

    PY - 2007/6/28

    Y1 - 2007/6/28

    N2 - With the increasing popularity of the Internet, more and more online questionnaires are being conducted. However, little research is being done on their construction, in particular on their design. The authors of this paper have conducted such a study, within the scope of rating scales for Web sites; however, their conclusions are of interest for a broader range of applications. The authors studied the influence of three design parameters (response format, questionnaire layout, and interaction mechanism) on users' behavior on rating scales, determined through perceived ease of use, perceived usefulness, disorientation, and flow. In parallel, the concepts of factor structure, reliability, validity, and sensitivity are introduced. However, their relation with perceived ease of use, perceived usefulness, disorientation, and flow remains fuzzy throughout the paper. Moreover, the relation between these concepts and the design parameters is not convincing. Hence, the psychometric properties of the research are questionable. Through two experiments, the authors found that, first, visual analogue and discrete Likert scales are equally good, and, second, a design that supports direct interaction (with radio buttons) and one item per page is preferred by users over indirect interaction (with drop-down boxes) and all items on one page. This finding was despite the fact that responses were faster with all items on one page. The research report is preceded by a thorough literature overview, and accompanied by a vast amount of analysis. Regrettably, the result is a 35-page paper, which makes the authors' important message less accessible.

    AB - With the increasing popularity of the Internet, more and more online questionnaires are being conducted. However, little research is being done on their construction, in particular on their design. The authors of this paper have conducted such a study, within the scope of rating scales for Web sites; however, their conclusions are of interest for a broader range of applications. The authors studied the influence of three design parameters (response format, questionnaire layout, and interaction mechanism) on users' behavior on rating scales, determined through perceived ease of use, perceived usefulness, disorientation, and flow. In parallel, the concepts of factor structure, reliability, validity, and sensitivity are introduced. However, their relation with perceived ease of use, perceived usefulness, disorientation, and flow remains fuzzy throughout the paper. Moreover, the relation between these concepts and the design parameters is not convincing. Hence, the psychometric properties of the research are questionable. Through two experiments, the authors found that, first, visual analogue and discrete Likert scales are equally good, and, second, a design that supports direct interaction (with radio buttons) and one item per page is preferred by users over indirect interaction (with drop-down boxes) and all items on one page. This finding was despite the fact that responses were faster with all items on one page. The research report is preceded by a thorough literature overview, and accompanied by a vast amount of analysis. Regrettably, the result is a 35-page paper, which makes the authors' important message less accessible.

    KW - HMI-HF: Human Factors

    KW - HMI-MI: MULTIMODAL INTERACTIONS

    KW - Web sites

    KW - design parameters

    KW - Review

    KW - EWI-20859

    M3 - Book/Film/Article review

    SP - CR134483

    JO - ACM Computing Reviews

    JF - ACM Computing Reviews

    ER -