Assessing the Effectiveness and Usability of Personalized Internet Search through a Longitudinal Evaluation

Lex Stefan van Velsen, Florian König, Alexandros Paramythis

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    31 Downloads (Pure)


    This paper discusses a longitudinal user evaluation of Prospector, a personalized Internet meta-search engine capable of personalized re-ranking of search results. Twenty-one participants used Prospector as their primary search engine for 12 days, agreed to have their interaction with the system logged, and completed three questionnaires. The data logs show that the personalization provided by Prospector is successful: participants preferred re-ranked results that appeared higher up. However, the questionnaire results indicated that people would prefer to use Google instead (their search engine of choice). Users would, nevertheless, consider employing a personalized search engine to perform searches with terms that require disambiguation and/or contextualization. We conclude the paper with a discussion on the merit of combining system- and user-centered evaluation for the case of personalized systems.
    Original languageUndefined
    Title of host publicationProceedings of the Sixth workshop on User-Centred Design and Evaluation of Adaptive Systems
    Place of PublicationTrento Italy
    Number of pages10
    Publication statusPublished - 26 Jun 2009
    Event6th Workshop on User-Centred Design and Evaluation of Adaptive Systems, UCDEAS - Trento, Italy
    Duration: 26 Jun 200926 Jun 2009


    Workshop6th Workshop on User-Centred Design and Evaluation of Adaptive Systems, UCDEAS
    OtherJune 26, 2009


    • METIS-261097
    • IR-68858

    Cite this