Testing the usability of a personalized system: comparing the use of interviews, questionnaires and thinking -aloud

Lex Stefan van Velsen, Thea van der Geest, R.F. Klaassen

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

6 Citations (Scopus)
70 Downloads (Pure)

Abstract

Personalized systems present each user with tailored content or output. Testing the usability of such a system must take some specific usability issues and the suitability of the personalized output into account. In this study, we evaluated a personalized search engine to compare the use of interviews, questionnaires and concurrent thinking- aloud to this avail. The interview and the questionnaire are the best methods to elicit comments on usability issues. Concurrent thinking-aloud turned out to be the best method to elicit comments on the perceived relevance of search results. When testing the usability of a personalized system it is wise to use a combination of concurrent thinking-aloud and the interview or the questionnaire.
Original languageUndefined
Title of host publication2007 IEEE International Professional Communication Conference (IPCC 2007). CD Rom
Place of PublicationSeattle, WA
Publisher2007 IEEE International Professional Communication Conference (IPCC 2007)
Pages-
ISBN (Print)1-4244-1243-9
DOIs
Publication statusPublished - 2007
EventIEEE International Professional Communication Conference, IPCC 2007 - Seattle, United States
Duration: 1 Oct 20073 Oct 2007

Conference

ConferenceIEEE International Professional Communication Conference, IPCC 2007
Abbreviated titleIPCC
CountryUnited States
CitySeattle
Period1/10/073/10/07

Keywords

  • Usability testing
  • METIS-243009
  • Interviews
  • personalized search engine
  • personalized system
  • thinking-aloud
  • information retrieval system evaluation
  • search engines
  • IR-61643
  • Questionnaires

Cite this

van Velsen, L. S., van der Geest, T., & Klaassen, R. F. (2007). Testing the usability of a personalized system: comparing the use of interviews, questionnaires and thinking -aloud. In 2007 IEEE International Professional Communication Conference (IPCC 2007). CD Rom (pp. -). Seattle, WA: 2007 IEEE International Professional Communication Conference (IPCC 2007). https://doi.org/10.1109/IPCC.2007.4464043
van Velsen, Lex Stefan ; van der Geest, Thea ; Klaassen, R.F. / Testing the usability of a personalized system: comparing the use of interviews, questionnaires and thinking -aloud. 2007 IEEE International Professional Communication Conference (IPCC 2007). CD Rom. Seattle, WA : 2007 IEEE International Professional Communication Conference (IPCC 2007), 2007. pp. -
@inproceedings{9e47bdca532b4f5cb407566a9b431e94,
title = "Testing the usability of a personalized system: comparing the use of interviews, questionnaires and thinking -aloud",
abstract = "Personalized systems present each user with tailored content or output. Testing the usability of such a system must take some specific usability issues and the suitability of the personalized output into account. In this study, we evaluated a personalized search engine to compare the use of interviews, questionnaires and concurrent thinking- aloud to this avail. The interview and the questionnaire are the best methods to elicit comments on usability issues. Concurrent thinking-aloud turned out to be the best method to elicit comments on the perceived relevance of search results. When testing the usability of a personalized system it is wise to use a combination of concurrent thinking-aloud and the interview or the questionnaire.",
keywords = "Usability testing, METIS-243009, Interviews, personalized search engine, personalized system, thinking-aloud, information retrieval system evaluation, search engines, IR-61643, Questionnaires",
author = "{van Velsen}, {Lex Stefan} and {van der Geest}, Thea and R.F. Klaassen",
year = "2007",
doi = "10.1109/IPCC.2007.4464043",
language = "Undefined",
isbn = "1-4244-1243-9",
pages = "--",
booktitle = "2007 IEEE International Professional Communication Conference (IPCC 2007). CD Rom",
publisher = "2007 IEEE International Professional Communication Conference (IPCC 2007)",

}

van Velsen, LS, van der Geest, T & Klaassen, RF 2007, Testing the usability of a personalized system: comparing the use of interviews, questionnaires and thinking -aloud. in 2007 IEEE International Professional Communication Conference (IPCC 2007). CD Rom. 2007 IEEE International Professional Communication Conference (IPCC 2007), Seattle, WA, pp. -, IEEE International Professional Communication Conference, IPCC 2007, Seattle, United States, 1/10/07. https://doi.org/10.1109/IPCC.2007.4464043

Testing the usability of a personalized system: comparing the use of interviews, questionnaires and thinking -aloud. / van Velsen, Lex Stefan; van der Geest, Thea; Klaassen, R.F.

2007 IEEE International Professional Communication Conference (IPCC 2007). CD Rom. Seattle, WA : 2007 IEEE International Professional Communication Conference (IPCC 2007), 2007. p. -.

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - Testing the usability of a personalized system: comparing the use of interviews, questionnaires and thinking -aloud

AU - van Velsen, Lex Stefan

AU - van der Geest, Thea

AU - Klaassen, R.F.

PY - 2007

Y1 - 2007

N2 - Personalized systems present each user with tailored content or output. Testing the usability of such a system must take some specific usability issues and the suitability of the personalized output into account. In this study, we evaluated a personalized search engine to compare the use of interviews, questionnaires and concurrent thinking- aloud to this avail. The interview and the questionnaire are the best methods to elicit comments on usability issues. Concurrent thinking-aloud turned out to be the best method to elicit comments on the perceived relevance of search results. When testing the usability of a personalized system it is wise to use a combination of concurrent thinking-aloud and the interview or the questionnaire.

AB - Personalized systems present each user with tailored content or output. Testing the usability of such a system must take some specific usability issues and the suitability of the personalized output into account. In this study, we evaluated a personalized search engine to compare the use of interviews, questionnaires and concurrent thinking- aloud to this avail. The interview and the questionnaire are the best methods to elicit comments on usability issues. Concurrent thinking-aloud turned out to be the best method to elicit comments on the perceived relevance of search results. When testing the usability of a personalized system it is wise to use a combination of concurrent thinking-aloud and the interview or the questionnaire.

KW - Usability testing

KW - METIS-243009

KW - Interviews

KW - personalized search engine

KW - personalized system

KW - thinking-aloud

KW - information retrieval system evaluation

KW - search engines

KW - IR-61643

KW - Questionnaires

U2 - 10.1109/IPCC.2007.4464043

DO - 10.1109/IPCC.2007.4464043

M3 - Conference contribution

SN - 1-4244-1243-9

SP - -

BT - 2007 IEEE International Professional Communication Conference (IPCC 2007). CD Rom

PB - 2007 IEEE International Professional Communication Conference (IPCC 2007)

CY - Seattle, WA

ER -

van Velsen LS, van der Geest T, Klaassen RF. Testing the usability of a personalized system: comparing the use of interviews, questionnaires and thinking -aloud. In 2007 IEEE International Professional Communication Conference (IPCC 2007). CD Rom. Seattle, WA: 2007 IEEE International Professional Communication Conference (IPCC 2007). 2007. p. - https://doi.org/10.1109/IPCC.2007.4464043