Assessing the Involvement of Users During Development of Lower Limb Wearable Robotic Exoskeletons: A Survey Study

Anna L. Ármannsdóttir, Philipp Beckerle, Juan C. Moreno, Edwin H.F. van Asseldonk, Maria Teresa Manrique-Sancho, Antonio J. del-Ama, Jan F. Veneman, Kristín Briem*

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

6 Downloads (Pure)

Abstract

Objective: To explore user-centered design methods currently implemented during development of lower limb wearable robots and how they are utilized during different stages of product development. Background: Currently, there appears to be a lack of standardized frameworks for evaluation methods and design requirements to implement effective user-centered design for safe and effective clinical or ergonomic system application. Method: Responses from a total of 191 experts working in the field of lower limb exoskeletons were analyzed in this exploratory survey. Descriptive statistics were used to present responses and measures of frequency, and chi-square tests were used to contrast the answers of respondents who identified as clinicians versus engineers. Results: A vast majority of respondents involve users in their development, in particular at the initial and iterative stages, although some differences were found between disciplines. A variety of methods and metrics are used to capture feedback from users and test devices, and although valuable, some methods used may not be based on validated measures. Guidelines regarding tests on safety of exoskeletons also lack standardization. Conclusion: There seems to be a consensus among experts regarding the importance of a user-centered approach in exoskeleton development; however, standardized frameworks with regard to appropriate testing methods and design approaches are lacking. Such frameworks should consider an interdisciplinary focus on the needs and safety of the intended user during each iteration of the process. Application: This exploratory study provides an overview of current practice among engineers and clinicians regarding the user-centered design of exoskeletons. Limitations and recommendations for future directions are identified.

Original languageEnglish
Number of pages14
JournalHuman factors
DOIs
Publication statusE-pub ahead of print/First online - 13 Jan 2020

Fingerprint

Lower Extremity
Robotics
Engineers
Ergonomics
Product development
Standardization
engineer
Statistics
Robots
Feedback
Safety
expert
Human Engineering
Testing
Chi-Square Distribution
lack
descriptive statistics
User centered design
Exoskeleton (Robotics)
Surveys and Questionnaires

Keywords

  • UT-Hybrid-D
  • usability testing and evaluation
  • user-centered design strategies
  • wearable robots
  • outcome measures

Cite this

Ármannsdóttir, Anna L. ; Beckerle, Philipp ; Moreno, Juan C. ; van Asseldonk, Edwin H.F. ; Manrique-Sancho, Maria Teresa ; del-Ama, Antonio J. ; Veneman, Jan F. ; Briem, Kristín. / Assessing the Involvement of Users During Development of Lower Limb Wearable Robotic Exoskeletons : A Survey Study. In: Human factors. 2020.
@article{6c1d746df8fe469982824cfc760f30ef,
title = "Assessing the Involvement of Users During Development of Lower Limb Wearable Robotic Exoskeletons: A Survey Study",
abstract = "Objective: To explore user-centered design methods currently implemented during development of lower limb wearable robots and how they are utilized during different stages of product development. Background: Currently, there appears to be a lack of standardized frameworks for evaluation methods and design requirements to implement effective user-centered design for safe and effective clinical or ergonomic system application. Method: Responses from a total of 191 experts working in the field of lower limb exoskeletons were analyzed in this exploratory survey. Descriptive statistics were used to present responses and measures of frequency, and chi-square tests were used to contrast the answers of respondents who identified as clinicians versus engineers. Results: A vast majority of respondents involve users in their development, in particular at the initial and iterative stages, although some differences were found between disciplines. A variety of methods and metrics are used to capture feedback from users and test devices, and although valuable, some methods used may not be based on validated measures. Guidelines regarding tests on safety of exoskeletons also lack standardization. Conclusion: There seems to be a consensus among experts regarding the importance of a user-centered approach in exoskeleton development; however, standardized frameworks with regard to appropriate testing methods and design approaches are lacking. Such frameworks should consider an interdisciplinary focus on the needs and safety of the intended user during each iteration of the process. Application: This exploratory study provides an overview of current practice among engineers and clinicians regarding the user-centered design of exoskeletons. Limitations and recommendations for future directions are identified.",
keywords = "UT-Hybrid-D, usability testing and evaluation, user-centered design strategies, wearable robots, outcome measures",
author = "{\'A}rmannsd{\'o}ttir, {Anna L.} and Philipp Beckerle and Moreno, {Juan C.} and {van Asseldonk}, {Edwin H.F.} and Manrique-Sancho, {Maria Teresa} and del-Ama, {Antonio J.} and Veneman, {Jan F.} and Krist{\'i}n Briem",
note = "Sage deal",
year = "2020",
month = "1",
day = "13",
doi = "10.1177/0018720819883500",
language = "English",
journal = "Human factors",
issn = "0018-7208",
publisher = "SAGE Publications",

}

Assessing the Involvement of Users During Development of Lower Limb Wearable Robotic Exoskeletons : A Survey Study. / Ármannsdóttir, Anna L.; Beckerle, Philipp; Moreno, Juan C.; van Asseldonk, Edwin H.F.; Manrique-Sancho, Maria Teresa; del-Ama, Antonio J.; Veneman, Jan F.; Briem, Kristín.

In: Human factors, 13.01.2020.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Assessing the Involvement of Users During Development of Lower Limb Wearable Robotic Exoskeletons

T2 - A Survey Study

AU - Ármannsdóttir, Anna L.

AU - Beckerle, Philipp

AU - Moreno, Juan C.

AU - van Asseldonk, Edwin H.F.

AU - Manrique-Sancho, Maria Teresa

AU - del-Ama, Antonio J.

AU - Veneman, Jan F.

AU - Briem, Kristín

N1 - Sage deal

PY - 2020/1/13

Y1 - 2020/1/13

N2 - Objective: To explore user-centered design methods currently implemented during development of lower limb wearable robots and how they are utilized during different stages of product development. Background: Currently, there appears to be a lack of standardized frameworks for evaluation methods and design requirements to implement effective user-centered design for safe and effective clinical or ergonomic system application. Method: Responses from a total of 191 experts working in the field of lower limb exoskeletons were analyzed in this exploratory survey. Descriptive statistics were used to present responses and measures of frequency, and chi-square tests were used to contrast the answers of respondents who identified as clinicians versus engineers. Results: A vast majority of respondents involve users in their development, in particular at the initial and iterative stages, although some differences were found between disciplines. A variety of methods and metrics are used to capture feedback from users and test devices, and although valuable, some methods used may not be based on validated measures. Guidelines regarding tests on safety of exoskeletons also lack standardization. Conclusion: There seems to be a consensus among experts regarding the importance of a user-centered approach in exoskeleton development; however, standardized frameworks with regard to appropriate testing methods and design approaches are lacking. Such frameworks should consider an interdisciplinary focus on the needs and safety of the intended user during each iteration of the process. Application: This exploratory study provides an overview of current practice among engineers and clinicians regarding the user-centered design of exoskeletons. Limitations and recommendations for future directions are identified.

AB - Objective: To explore user-centered design methods currently implemented during development of lower limb wearable robots and how they are utilized during different stages of product development. Background: Currently, there appears to be a lack of standardized frameworks for evaluation methods and design requirements to implement effective user-centered design for safe and effective clinical or ergonomic system application. Method: Responses from a total of 191 experts working in the field of lower limb exoskeletons were analyzed in this exploratory survey. Descriptive statistics were used to present responses and measures of frequency, and chi-square tests were used to contrast the answers of respondents who identified as clinicians versus engineers. Results: A vast majority of respondents involve users in their development, in particular at the initial and iterative stages, although some differences were found between disciplines. A variety of methods and metrics are used to capture feedback from users and test devices, and although valuable, some methods used may not be based on validated measures. Guidelines regarding tests on safety of exoskeletons also lack standardization. Conclusion: There seems to be a consensus among experts regarding the importance of a user-centered approach in exoskeleton development; however, standardized frameworks with regard to appropriate testing methods and design approaches are lacking. Such frameworks should consider an interdisciplinary focus on the needs and safety of the intended user during each iteration of the process. Application: This exploratory study provides an overview of current practice among engineers and clinicians regarding the user-centered design of exoskeletons. Limitations and recommendations for future directions are identified.

KW - UT-Hybrid-D

KW - usability testing and evaluation

KW - user-centered design strategies

KW - wearable robots

KW - outcome measures

U2 - 10.1177/0018720819883500

DO - 10.1177/0018720819883500

M3 - Article

AN - SCOPUS:85078277252

JO - Human factors

JF - Human factors

SN - 0018-7208

ER -