Standardized versus practice: ISO/IEC 19795-2 compared to cases

Researchers from the Data Management and Biometrics group (DMB) have participated in evaluations of biometric performance for years. Recently we started a line of research into a practical framework for biometric performance evaluation.
The series of standards crafted by the international standards organisation ISO starting with ISO/IEC 19795-1 [1] intends to support systematic biometric performance testing and reporting; we analysed the 19795-2 standard by comparing the requirements and guidelines therein to our approach with several evaluation projects with two questions in mind: 1) does/do our approach(es) comply with the relevant clauses given in ISO/IEC 19795-2?, and 2) does the standard provide us with a framework or recipe that we can execute?
The analysis results show that overall we usually comply with the standard’s relevant clauses; where we have diverged from the standards we usually have done so with a reasoned motivation. The main finding contributing to our research on a practical framework is that the standard does not provide a framework or recipe for biometric performance evaluation that can be executed directly.