Evaluation of perceived persuasiveness constructs by combining user tests and expert assessments

Nienke de Jong; Jobke Wentzel; Saskia Kelders; Harri Oinas-Kukkonen; Julia van Gemert-Pijnen

Evaluation of perceived persuasiveness constructs by combining user tests and expert assessments

Nienke de Jong
, Jobke Wentzel
, Saskia Kelders
, Harri Oinas-Kukkonen
, Julia van Gemert-Pijnen

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

11 Citations (Scopus)

362 Downloads (Pure)

Abstract

To develop effective behaviour change support systems, persuasive technology can be used. The persuasive systems design model offers a framework to identify and operationalize such elements. In this pilot study, we evaluate the questionnaire developed to measure perceived persuasiveness of information technology. We analyzed verbatim user-test transcripts, and performed expert-assessments of the Nurse Antibiotic Information App (NAIA). These data were compared to questionnaire results on this app. Expert-assessment identified task support, perceived persuasiveness, unobtrusiveness, credibility, perceived effort and perceived effectiveness (as defined in the Persuasive Systems Design model) as being present within the NAIA. These constructs also scored satisfactory in the questionnaire. User-test transcripts are in line with questionnaire results. Given the consistent results in this pilot study, our approach seems promising for evaluating the questionnaire and will be applied to other settings and websites/applications

Original language	English
Title of host publication	BCSS 2014: Behavior Change Support Systems
Subtitle of host publication	Proceedings of the Second International Workshop on Behavior Change Support Systems co-located with the 9th International Conference on Persuasive Technology (PERSUASIVE 2014)
Editors	Anssi Öörni, Saskia Kelders, Lisette van Gemert-Pijnen, Harri Oinas-Kukkonen
Publisher	CEUR
Pages	7-15
Publication status	Published - 22 May 2014
Event	2nd International Workshop on Behavior Change Support Systems, BCSS 2014 - University of Padua, Padua, Italy Duration: 22 May 2014 → 22 May 2014 Conference number: 2 https://bcssworkshop.wordpress.com/2nd-bcss-workshop/

Publication series

Name	CEUR workshop proceedings
Publisher	CEUR-WS.org
Volume	1153

Workshop

Workshop	2nd International Workshop on Behavior Change Support Systems, BCSS 2014
Abbreviated title	BCSS
Country/Territory	Italy
City	Padua
Period	22/05/14 → 22/05/14
Internet address	https://bcssworkshop.wordpress.com/2nd-bcss-workshop/

Access to Document

ArticleFinal published version, 212 KB

http://ceur-ws.org/Vol-1153/

11 Citations
1 Book editing
1 Other

BCSS 2014, Behavior Change Support Systems: Proceedings of the Second International Workshop on Behavior Change Support Systems co-located with the 9th International Conference on Persuasive Technology (PERSUASIVE 2014), Padua, Italy, May 22, 2014
Oörni, A., Kelders, S., van Gemert-Pijnen, L. & Oinas-Kukkonen, H., 2014, Aachen, Germany: CEUR. 93 p. (CEUR Workshop Proceedings; vol. 1153)
Research output: Book/Report › Book editing › Academic

Open Access
File
Perceived persuasiveness questionnaire: Evaluation of Perceived Persuasiveness Constructs by Combining User Tests and Expert Assessments
de Jong, N., Wentzel, J., Kelders, S., Oinas-Kukkonen, H. & van Gemert-Pijnen, J., 22 May 2014.
Research output: Contribution to conference › Other › Other research output

Cite this

de Jong, N., Wentzel, J., Kelders, S., Oinas-Kukkonen, H., & van Gemert-Pijnen, J. (2014). Evaluation of perceived persuasiveness constructs by combining user tests and expert assessments. In A. Öörni, S. Kelders, L. van Gemert-Pijnen, & H. Oinas-Kukkonen (Eds.), BCSS 2014: Behavior Change Support Systems: Proceedings of the Second International Workshop on Behavior Change Support Systems co-located with the 9th International Conference on Persuasive Technology (PERSUASIVE 2014) (pp. 7-15). (CEUR workshop proceedings; Vol. 1153). CEUR. http://ceur-ws.org/Vol-1153/

de Jong, Nienke ; Wentzel, Jobke ; Kelders, Saskia et al. / Evaluation of perceived persuasiveness constructs by combining user tests and expert assessments. BCSS 2014: Behavior Change Support Systems: Proceedings of the Second International Workshop on Behavior Change Support Systems co-located with the 9th International Conference on Persuasive Technology (PERSUASIVE 2014). editor / Anssi Öörni ; Saskia Kelders ; Lisette van Gemert-Pijnen ; Harri Oinas-Kukkonen. CEUR, 2014. pp. 7-15 (CEUR workshop proceedings).

@inproceedings{d96c1a6313104cd2b062759dddf78236,

title = "Evaluation of perceived persuasiveness constructs by combining user tests and expert assessments",

abstract = "To develop effective behaviour change support systems, persuasive technology can be used. The persuasive systems design model offers a framework to identify and operationalize such elements. In this pilot study, we evaluate the questionnaire developed to measure perceived persuasiveness of information technology. We analyzed verbatim user-test transcripts, and performed expert-assessments of the Nurse Antibiotic Information App (NAIA). These data were compared to questionnaire results on this app. Expert-assessment identified task support, perceived persuasiveness, unobtrusiveness, credibility, perceived effort and perceived effectiveness (as defined in the Persuasive Systems Design model) as being present within the NAIA. These constructs also scored satisfactory in the questionnaire. User-test transcripts are in line with questionnaire results. Given the consistent results in this pilot study, our approach seems promising for evaluating the questionnaire and will be applied to other settings and websites/applications",

author = "\{de Jong\}, Nienke and Jobke Wentzel and Saskia Kelders and Harri Oinas-Kukkonen and \{van Gemert-Pijnen\}, Julia",

note = "Co-located with the 9th International Conference on Persuasive Technology, PERSUASIVE 2014; Padua; Italy; 21-23 May 2014 ; 2nd International Workshop on Behavior Change Support Systems, BCSS 2014, BCSS ; Conference date: 22-05-2014 Through 22-05-2014",

year = "2014",

month = may,

day = "22",

language = "English",

series = "CEUR workshop proceedings",

publisher = "CEUR",

pages = "7--15",

editor = "Anssi {\"O}{\"o}rni and Saskia Kelders and \{van Gemert-Pijnen\}, Lisette and Harri Oinas-Kukkonen",

booktitle = "BCSS 2014: Behavior Change Support Systems",

address = "Germany",

url = "https://bcssworkshop.wordpress.com/2nd-bcss-workshop/",

}

de Jong, N, Wentzel, J, Kelders, S, Oinas-Kukkonen, H & van Gemert-Pijnen, J 2014, Evaluation of perceived persuasiveness constructs by combining user tests and expert assessments. in A Öörni, S Kelders, L van Gemert-Pijnen & H Oinas-Kukkonen (eds), BCSS 2014: Behavior Change Support Systems: Proceedings of the Second International Workshop on Behavior Change Support Systems co-located with the 9th International Conference on Persuasive Technology (PERSUASIVE 2014). CEUR workshop proceedings, vol. 1153, CEUR, pp. 7-15, 2nd International Workshop on Behavior Change Support Systems, BCSS 2014, Padua, Italy, 22/05/14. <http://ceur-ws.org/Vol-1153/>

Evaluation of perceived persuasiveness constructs by combining user tests and expert assessments. / de Jong, Nienke; Wentzel, Jobke; Kelders, Saskia et al.
BCSS 2014: Behavior Change Support Systems: Proceedings of the Second International Workshop on Behavior Change Support Systems co-located with the 9th International Conference on Persuasive Technology (PERSUASIVE 2014). ed. / Anssi Öörni; Saskia Kelders; Lisette van Gemert-Pijnen; Harri Oinas-Kukkonen. CEUR, 2014. p. 7-15 (CEUR workshop proceedings; Vol. 1153).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Evaluation of perceived persuasiveness constructs by combining user tests and expert assessments

AU - de Jong, Nienke

AU - Wentzel, Jobke

AU - Kelders, Saskia

AU - Oinas-Kukkonen, Harri

AU - van Gemert-Pijnen, Julia

N1 - Conference code: 2

PY - 2014/5/22

Y1 - 2014/5/22

N2 - To develop effective behaviour change support systems, persuasive technology can be used. The persuasive systems design model offers a framework to identify and operationalize such elements. In this pilot study, we evaluate the questionnaire developed to measure perceived persuasiveness of information technology. We analyzed verbatim user-test transcripts, and performed expert-assessments of the Nurse Antibiotic Information App (NAIA). These data were compared to questionnaire results on this app. Expert-assessment identified task support, perceived persuasiveness, unobtrusiveness, credibility, perceived effort and perceived effectiveness (as defined in the Persuasive Systems Design model) as being present within the NAIA. These constructs also scored satisfactory in the questionnaire. User-test transcripts are in line with questionnaire results. Given the consistent results in this pilot study, our approach seems promising for evaluating the questionnaire and will be applied to other settings and websites/applications

AB - To develop effective behaviour change support systems, persuasive technology can be used. The persuasive systems design model offers a framework to identify and operationalize such elements. In this pilot study, we evaluate the questionnaire developed to measure perceived persuasiveness of information technology. We analyzed verbatim user-test transcripts, and performed expert-assessments of the Nurse Antibiotic Information App (NAIA). These data were compared to questionnaire results on this app. Expert-assessment identified task support, perceived persuasiveness, unobtrusiveness, credibility, perceived effort and perceived effectiveness (as defined in the Persuasive Systems Design model) as being present within the NAIA. These constructs also scored satisfactory in the questionnaire. User-test transcripts are in line with questionnaire results. Given the consistent results in this pilot study, our approach seems promising for evaluating the questionnaire and will be applied to other settings and websites/applications

M3 - Conference contribution

T3 - CEUR workshop proceedings

SP - 7

EP - 15

BT - BCSS 2014: Behavior Change Support Systems

A2 - Öörni, Anssi

A2 - Kelders, Saskia

A2 - van Gemert-Pijnen, Lisette

A2 - Oinas-Kukkonen, Harri

PB - CEUR

T2 - 2nd International Workshop on Behavior Change Support Systems, BCSS 2014

Y2 - 22 May 2014 through 22 May 2014

ER -

de Jong N, Wentzel J, Kelders S, Oinas-Kukkonen H, van Gemert-Pijnen J. Evaluation of perceived persuasiveness constructs by combining user tests and expert assessments. In Öörni A, Kelders S, van Gemert-Pijnen L, Oinas-Kukkonen H, editors, BCSS 2014: Behavior Change Support Systems: Proceedings of the Second International Workshop on Behavior Change Support Systems co-located with the 9th International Conference on Persuasive Technology (PERSUASIVE 2014). CEUR. 2014. p. 7-15. (CEUR workshop proceedings).

Evaluation of perceived persuasiveness constructs by combining user tests and expert assessments

Abstract

Publication series

Workshop

Access to Document

Fingerprint

Research output

BCSS 2014, Behavior Change Support Systems: Proceedings of the Second International Workshop on Behavior Change Support Systems co-located with the 9th International Conference on Persuasive Technology (PERSUASIVE 2014), Padua, Italy, May 22, 2014

Perceived persuasiveness questionnaire: Evaluation of Perceived Persuasiveness Constructs by Combining User Tests and Expert Assessments

Cite this