Manually annotated characteristic descriptors: Measurability and variability

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

1 Citation (Scopus)

Abstract

In this paper we study the measurability and variability of manually annotated characteristic descriptors on a forensic relevant face dataset. Characteristic descriptors are facial features (landmarks, shapes, etc.) that can be used during forensic case work. With respect to measurability, we observe that a significant proportion cannot be determined in images representative of forensic case work. Landmarks, closed and open shapes, and other forensic facial features show mostly that the variability depends on the image quality. Up to 50% of all considered evidential values are either positively or negatively influenced by annotator variability. However, when considering images with the lowest quality, we found that more than 70% of the evidential value intervals in principle could yield the wrong conclusion.

Original languageEnglish
Title of host publication2017 5th International Workshop on Biometrics and Forensics (IWBF 2017)
PublisherIEEE
ISBN (Electronic)9781509057917
ISBN (Print)9781509057924
DOIs
Publication statusPublished - 26 May 2017
EventInternational Workshop on Biometrics and Forensics 2017 - Coventry, United Kingdom
Duration: 4 Apr 20175 Apr 2017
Conference number: 5
https://warwick.ac.uk/fac/sci/dcs/people/chang-tsun_li/iwbf2017/

Conference

ConferenceInternational Workshop on Biometrics and Forensics 2017
Abbreviated titleIWBF 2017
CountryUnited Kingdom
CityCoventry
Period4/04/175/04/17
Internet address

Fingerprint

Image quality
landmarks
proportion
intervals
Datasets

Keywords

  • FISWG
  • Forensic facial features
  • Manual annotation
  • Measurability
  • Variability

Cite this

Zeinstra, C., Veldhuis, R., Spreeuwers, L., & Ruifrok, A. (2017). Manually annotated characteristic descriptors: Measurability and variability. In 2017 5th International Workshop on Biometrics and Forensics (IWBF 2017) [7935095] IEEE. https://doi.org/10.1109/IWBF.2017.7935095
Zeinstra, Chris ; Veldhuis, Raymond ; Spreeuwers, Luuk ; Ruifrok, Arnout. / Manually annotated characteristic descriptors : Measurability and variability. 2017 5th International Workshop on Biometrics and Forensics (IWBF 2017) . IEEE, 2017.
@inproceedings{b22a78e0413249798df943f8fd229e56,
title = "Manually annotated characteristic descriptors: Measurability and variability",
abstract = "In this paper we study the measurability and variability of manually annotated characteristic descriptors on a forensic relevant face dataset. Characteristic descriptors are facial features (landmarks, shapes, etc.) that can be used during forensic case work. With respect to measurability, we observe that a significant proportion cannot be determined in images representative of forensic case work. Landmarks, closed and open shapes, and other forensic facial features show mostly that the variability depends on the image quality. Up to 50{\%} of all considered evidential values are either positively or negatively influenced by annotator variability. However, when considering images with the lowest quality, we found that more than 70{\%} of the evidential value intervals in principle could yield the wrong conclusion.",
keywords = "FISWG, Forensic facial features, Manual annotation, Measurability, Variability",
author = "Chris Zeinstra and Raymond Veldhuis and Luuk Spreeuwers and Arnout Ruifrok",
year = "2017",
month = "5",
day = "26",
doi = "10.1109/IWBF.2017.7935095",
language = "English",
isbn = "9781509057924",
booktitle = "2017 5th International Workshop on Biometrics and Forensics (IWBF 2017)",
publisher = "IEEE",
address = "United States",

}

Zeinstra, C, Veldhuis, R, Spreeuwers, L & Ruifrok, A 2017, Manually annotated characteristic descriptors: Measurability and variability. in 2017 5th International Workshop on Biometrics and Forensics (IWBF 2017) ., 7935095, IEEE, International Workshop on Biometrics and Forensics 2017, Coventry, United Kingdom, 4/04/17. https://doi.org/10.1109/IWBF.2017.7935095

Manually annotated characteristic descriptors : Measurability and variability. / Zeinstra, Chris; Veldhuis, Raymond; Spreeuwers, Luuk; Ruifrok, Arnout.

2017 5th International Workshop on Biometrics and Forensics (IWBF 2017) . IEEE, 2017. 7935095.

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - Manually annotated characteristic descriptors

T2 - Measurability and variability

AU - Zeinstra, Chris

AU - Veldhuis, Raymond

AU - Spreeuwers, Luuk

AU - Ruifrok, Arnout

PY - 2017/5/26

Y1 - 2017/5/26

N2 - In this paper we study the measurability and variability of manually annotated characteristic descriptors on a forensic relevant face dataset. Characteristic descriptors are facial features (landmarks, shapes, etc.) that can be used during forensic case work. With respect to measurability, we observe that a significant proportion cannot be determined in images representative of forensic case work. Landmarks, closed and open shapes, and other forensic facial features show mostly that the variability depends on the image quality. Up to 50% of all considered evidential values are either positively or negatively influenced by annotator variability. However, when considering images with the lowest quality, we found that more than 70% of the evidential value intervals in principle could yield the wrong conclusion.

AB - In this paper we study the measurability and variability of manually annotated characteristic descriptors on a forensic relevant face dataset. Characteristic descriptors are facial features (landmarks, shapes, etc.) that can be used during forensic case work. With respect to measurability, we observe that a significant proportion cannot be determined in images representative of forensic case work. Landmarks, closed and open shapes, and other forensic facial features show mostly that the variability depends on the image quality. Up to 50% of all considered evidential values are either positively or negatively influenced by annotator variability. However, when considering images with the lowest quality, we found that more than 70% of the evidential value intervals in principle could yield the wrong conclusion.

KW - FISWG

KW - Forensic facial features

KW - Manual annotation

KW - Measurability

KW - Variability

UR - http://www.scopus.com/inward/record.url?scp=85021801338&partnerID=8YFLogxK

U2 - 10.1109/IWBF.2017.7935095

DO - 10.1109/IWBF.2017.7935095

M3 - Conference contribution

SN - 9781509057924

BT - 2017 5th International Workshop on Biometrics and Forensics (IWBF 2017)

PB - IEEE

ER -

Zeinstra C, Veldhuis R, Spreeuwers L, Ruifrok A. Manually annotated characteristic descriptors: Measurability and variability. In 2017 5th International Workshop on Biometrics and Forensics (IWBF 2017) . IEEE. 2017. 7935095 https://doi.org/10.1109/IWBF.2017.7935095