TY - JOUR
T1 - The Gray Area of Freezing of Gait Annotation
T2 - A Guideline and Open-Source Practical Tool
AU - Cockx, Helena
AU - Klaver, Emilie
AU - Tjepkema-Cloostermans, Marleen
AU - van Wezel, Richard
AU - Nonnekes, Jorik
N1 - Funding Information:
H. Cockx and R. van Wezel report support from Operational Program European Regional Development Fund (OP ERDF) of the European Union and the “Nederlandse Organisatie voor Wetenschappelijk Onderzoek—Toegepaste en Technische wetenschappen” (NWO-TTW) Crossover program. E. Klaver and M. Tjepkema-Cloostermans report grants from the Michael J. Fox Foundation (Legacy ID 16457) outside the submitted work. Dr. Nonnekes reports grants from ZonMW (OffRoad grant, Veni grant), Michael J. Fox Foundation, Ipsen Pharmaceuticals, and Gossweiler Foundation outside the submitted work. He serves at the medical advisory board of Cue2Walk and Ceriter. This work was supported by the Operational Program European Regional Development Fund (OP ERDF) of the European Union under the “PROMPT” project (PROJ-00872) and the “Nederlandse Organisatie voor Wetenschappelijk Onderzoek–Toegepaste en Technische wetenschappen” (NWO-TTW) Crossover program under the Innovative NeuroTechnology for Society (INTENSE) project. The authors declare that they have no competing interests concerning the research related to this manuscript. The authors confirm that the approval of an institutional review board or patient consent was not required for this work. We confirm that we have read the Journal's position on issues involved in ethical publication and affirm that this work is consistent with those guidelines. This work was supported by the Operational Program European Regional Development Fund (OP ERDF) of the European Union under the “PROMPT” project (PROJ-00872) and the “Nederlandse Organisatie voor Wetenschappelijk Onderzoek–Toegepaste en Technische wetenschappen” (NWO-TTW) Crossover program under the Innovative NeuroTechnology for Society (INTENSE) project. The authors declare that they have no competing interests concerning the research related to this manuscript. H. Cockx and R. van Wezel report support from Operational Program European Regional Development Fund (OP ERDF) of the European Union and the “Nederlandse Organisatie voor Wetenschappelijk Onderzoek—Toegepaste en Technische wetenschappen” (NWO-TTW) Crossover program. E. Klaver and M. Tjepkema-Cloostermans report grants from the Michael J. Fox Foundation (Legacy ID 16457) outside the submitted work. Dr. Nonnekes reports grants from ZonMW (OffRoad grant, Veni grant), Michael J. Fox Foundation, Ipsen Pharmaceuticals, and Gossweiler Foundation outside the submitted work. He serves at the medical advisory board of Cue2Walk and Ceriter.
Funding Information:
H. Cockx and R. van Wezel report support from Operational Program European Regional Development Fund (OP ERDF) of the European Union and the “Nederlandse Organisatie voor Wetenschappelijk Onderzoek—Toegepaste en Technische wetenschappen” (NWO‐TTW) Crossover program. E. Klaver and M. Tjepkema‐Cloostermans report grants from the Michael J. Fox Foundation (Legacy ID 16457) outside the submitted work. Dr. Nonnekes reports grants from ZonMW (OffRoad grant, Veni grant), Michael J. Fox Foundation, Ipsen Pharmaceuticals, and Gossweiler Foundation outside the submitted work. He serves at the medical advisory board of Cue2Walk and Ceriter.
Funding Information:
This work was supported by the Operational Program European Regional Development Fund (OP ERDF) of the European Union under the “PROMPT” project (PROJ‐00872) and the “Nederlandse Organisatie voor Wetenschappelijk Onderzoek–Toegepaste en Technische wetenschappen” (NWO‐TTW) Crossover program under the Innovative NeuroTechnology for Society (INTENSE) project. The authors declare that they have no competing interests concerning the research related to this manuscript.
Publisher Copyright:
© 2022 The Authors. Movement Disorders Clinical Practice published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.
PY - 2022/11
Y1 - 2022/11
N2 - Background: Freezing of gait, a disabling episodic symptom, is difficult to assess as the exact begin- and endpoint of an episode is not easy to specify. This hampers scientific and clinical progress. The current golden standard is video annotation by two independent raters. However, the comparison of the two ratings gives rise to non-overlapping, gray areas. Objective: To provide a guideline for dealing with these gray areas. Methods/Results: We propose a standardized procedure for handling the gray areas based on two parameters, the tolerance and correction parameter. Furthermore, we recommend the use of positive agreement, negative agreement, and prevalence index to report interrater agreement instead of the commonly used intraclass correlation coefficient or Cohen's kappa. This theoretical guideline was implemented in an open-source practical tool, FOGtool (https://github.com/helenacockx/FOGtool). Conclusion: This paper aims to contribute to the standardization of freezing of gait assessment, thereby improving data sharing procedures and replicability of study results.
AB - Background: Freezing of gait, a disabling episodic symptom, is difficult to assess as the exact begin- and endpoint of an episode is not easy to specify. This hampers scientific and clinical progress. The current golden standard is video annotation by two independent raters. However, the comparison of the two ratings gives rise to non-overlapping, gray areas. Objective: To provide a guideline for dealing with these gray areas. Methods/Results: We propose a standardized procedure for handling the gray areas based on two parameters, the tolerance and correction parameter. Furthermore, we recommend the use of positive agreement, negative agreement, and prevalence index to report interrater agreement instead of the commonly used intraclass correlation coefficient or Cohen's kappa. This theoretical guideline was implemented in an open-source practical tool, FOGtool (https://github.com/helenacockx/FOGtool). Conclusion: This paper aims to contribute to the standardization of freezing of gait assessment, thereby improving data sharing procedures and replicability of study results.
KW - freezing of gait
KW - standardization
KW - video annotations
UR - http://www.scopus.com/inward/record.url?scp=85138144123&partnerID=8YFLogxK
U2 - 10.1002/mdc3.13556
DO - 10.1002/mdc3.13556
M3 - Article
AN - SCOPUS:85138144123
SN - 2330-1619
VL - 9
SP - 1099
EP - 1104
JO - Movement Disorders Clinical Practice
JF - Movement Disorders Clinical Practice
IS - 8
ER -