Review: Design parameters of rating scales for Web sites

Egon van den Broek

Research output: Contribution to journalBook/Film/Article reviewAcademic

Abstract

With the increasing popularity of the Internet, more and more online questionnaires are being conducted. However, little research is being done on their construction, in particular on their design. The authors of this paper have conducted such a study, within the scope of rating scales for Web sites; however, their conclusions are of interest for a broader range of applications. The authors studied the influence of three design parameters (response format, questionnaire layout, and interaction mechanism) on users' behavior on rating scales, determined through perceived ease of use, perceived usefulness, disorientation, and flow. In parallel, the concepts of factor structure, reliability, validity, and sensitivity are introduced. However, their relation with perceived ease of use, perceived usefulness, disorientation, and flow remains fuzzy throughout the paper. Moreover, the relation between these concepts and the design parameters is not convincing. Hence, the psychometric properties of the research are questionable. Through two experiments, the authors found that, first, visual analogue and discrete Likert scales are equally good, and, second, a design that supports direct interaction (with radio buttons) and one item per page is preferred by users over indirect interaction (with drop-down boxes) and all items on one page. This finding was despite the fact that responses were faster with all items on one page. The research report is preceded by a thorough literature overview, and accompanied by a vast amount of analysis. Regrettably, the result is a 35-page paper, which makes the authors' important message less accessible.
Original languageUndefined
Pages (from-to)CR134483
Number of pages1
JournalACM Computing Reviews
Publication statusPublished - 28 Jun 2007

Keywords

  • HMI-HF: Human Factors
  • HMI-MI: MULTIMODAL INTERACTIONS
  • Web sites
  • design parameters
  • Review
  • EWI-20859

Cite this

@article{9310f7d38ff446d591a0696c8cb35663,
title = "Review: Design parameters of rating scales for Web sites",
abstract = "With the increasing popularity of the Internet, more and more online questionnaires are being conducted. However, little research is being done on their construction, in particular on their design. The authors of this paper have conducted such a study, within the scope of rating scales for Web sites; however, their conclusions are of interest for a broader range of applications. The authors studied the influence of three design parameters (response format, questionnaire layout, and interaction mechanism) on users' behavior on rating scales, determined through perceived ease of use, perceived usefulness, disorientation, and flow. In parallel, the concepts of factor structure, reliability, validity, and sensitivity are introduced. However, their relation with perceived ease of use, perceived usefulness, disorientation, and flow remains fuzzy throughout the paper. Moreover, the relation between these concepts and the design parameters is not convincing. Hence, the psychometric properties of the research are questionable. Through two experiments, the authors found that, first, visual analogue and discrete Likert scales are equally good, and, second, a design that supports direct interaction (with radio buttons) and one item per page is preferred by users over indirect interaction (with drop-down boxes) and all items on one page. This finding was despite the fact that responses were faster with all items on one page. The research report is preceded by a thorough literature overview, and accompanied by a vast amount of analysis. Regrettably, the result is a 35-page paper, which makes the authors' important message less accessible.",
keywords = "HMI-HF: Human Factors, HMI-MI: MULTIMODAL INTERACTIONS, Web sites, design parameters, Review, EWI-20859",
author = "{van den Broek}, Egon",
year = "2007",
month = "6",
day = "28",
language = "Undefined",
pages = "CR134483",
journal = "ACM Computing Reviews",
publisher = "Association for Computing Machinery (ACM)",

}

Review: Design parameters of rating scales for Web sites. / van den Broek, Egon.

In: ACM Computing Reviews, 28.06.2007, p. CR134483.

Research output: Contribution to journalBook/Film/Article reviewAcademic

TY - JOUR

T1 - Review: Design parameters of rating scales for Web sites

AU - van den Broek, Egon

PY - 2007/6/28

Y1 - 2007/6/28

N2 - With the increasing popularity of the Internet, more and more online questionnaires are being conducted. However, little research is being done on their construction, in particular on their design. The authors of this paper have conducted such a study, within the scope of rating scales for Web sites; however, their conclusions are of interest for a broader range of applications. The authors studied the influence of three design parameters (response format, questionnaire layout, and interaction mechanism) on users' behavior on rating scales, determined through perceived ease of use, perceived usefulness, disorientation, and flow. In parallel, the concepts of factor structure, reliability, validity, and sensitivity are introduced. However, their relation with perceived ease of use, perceived usefulness, disorientation, and flow remains fuzzy throughout the paper. Moreover, the relation between these concepts and the design parameters is not convincing. Hence, the psychometric properties of the research are questionable. Through two experiments, the authors found that, first, visual analogue and discrete Likert scales are equally good, and, second, a design that supports direct interaction (with radio buttons) and one item per page is preferred by users over indirect interaction (with drop-down boxes) and all items on one page. This finding was despite the fact that responses were faster with all items on one page. The research report is preceded by a thorough literature overview, and accompanied by a vast amount of analysis. Regrettably, the result is a 35-page paper, which makes the authors' important message less accessible.

AB - With the increasing popularity of the Internet, more and more online questionnaires are being conducted. However, little research is being done on their construction, in particular on their design. The authors of this paper have conducted such a study, within the scope of rating scales for Web sites; however, their conclusions are of interest for a broader range of applications. The authors studied the influence of three design parameters (response format, questionnaire layout, and interaction mechanism) on users' behavior on rating scales, determined through perceived ease of use, perceived usefulness, disorientation, and flow. In parallel, the concepts of factor structure, reliability, validity, and sensitivity are introduced. However, their relation with perceived ease of use, perceived usefulness, disorientation, and flow remains fuzzy throughout the paper. Moreover, the relation between these concepts and the design parameters is not convincing. Hence, the psychometric properties of the research are questionable. Through two experiments, the authors found that, first, visual analogue and discrete Likert scales are equally good, and, second, a design that supports direct interaction (with radio buttons) and one item per page is preferred by users over indirect interaction (with drop-down boxes) and all items on one page. This finding was despite the fact that responses were faster with all items on one page. The research report is preceded by a thorough literature overview, and accompanied by a vast amount of analysis. Regrettably, the result is a 35-page paper, which makes the authors' important message less accessible.

KW - HMI-HF: Human Factors

KW - HMI-MI: MULTIMODAL INTERACTIONS

KW - Web sites

KW - design parameters

KW - Review

KW - EWI-20859

M3 - Book/Film/Article review

SP - CR134483

JO - ACM Computing Reviews

JF - ACM Computing Reviews

ER -