Reusing Annotation Labor for Concept Selection

Robin Aly, Djoerd Hiemstra, A.P. de Vries

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

5 Citations (Scopus)
38 Downloads (Pure)

Abstract

Describing shots through the occurrence of semantic concepts is the first step towards modeling the content of a video semantically. An important challenge is to automatically select the right concepts for a given information need. For example, systems should be able to decide whether the concept ``Outdoor'' should be included into a search for ``Street Basketball''. In this paper we provide an innovative method to automatically select concepts for an information need. To achieve this, we provide an estimation for the occurrence probability of a concept in relevant shots, which helps us to quantify the helpfulness of a concept. Our method re-uses existing training data which is annotated with concept occurrences to build a text collection. Searching in this collection with a text retrieval system and knowing about the concept occurrences allows us to come up with a good estimate for this probability. We evaluate our method against a concept selection benchmark and search runs on both the TRECVID 2005 and 2007 collections. These experiments show that the estimation consistently improves retrieval effectiveness.
Original languageUndefined
Title of host publicationProceedings of the 8th ACM International Conference on Image and Video Retrieval (CIVR '09)
Place of PublicationNew York
PublisherAssociation for Computing Machinery (ACM)
Pages44:1-44:8
Number of pages8
ISBN (Print)978-1-60558-480-5
DOIs
Publication statusPublished - Jun 2009

Publication series

Name
PublisherACM

Keywords

  • EWI-15456
  • IR-68558
  • METIS-264405
  • CR-H.3.3

Cite this

Aly, R., Hiemstra, D., & de Vries, A. P. (2009). Reusing Annotation Labor for Concept Selection. In Proceedings of the 8th ACM International Conference on Image and Video Retrieval (CIVR '09) (pp. 44:1-44:8). [10.1145/1646396.1646448] New York: Association for Computing Machinery (ACM). https://doi.org/10.1145/1646396.1646448
Aly, Robin ; Hiemstra, Djoerd ; de Vries, A.P. / Reusing Annotation Labor for Concept Selection. Proceedings of the 8th ACM International Conference on Image and Video Retrieval (CIVR '09). New York : Association for Computing Machinery (ACM), 2009. pp. 44:1-44:8
@inproceedings{e7a5c4211ec145ce948d30d91c11caf7,
title = "Reusing Annotation Labor for Concept Selection",
abstract = "Describing shots through the occurrence of semantic concepts is the first step towards modeling the content of a video semantically. An important challenge is to automatically select the right concepts for a given information need. For example, systems should be able to decide whether the concept ``Outdoor'' should be included into a search for ``Street Basketball''. In this paper we provide an innovative method to automatically select concepts for an information need. To achieve this, we provide an estimation for the occurrence probability of a concept in relevant shots, which helps us to quantify the helpfulness of a concept. Our method re-uses existing training data which is annotated with concept occurrences to build a text collection. Searching in this collection with a text retrieval system and knowing about the concept occurrences allows us to come up with a good estimate for this probability. We evaluate our method against a concept selection benchmark and search runs on both the TRECVID 2005 and 2007 collections. These experiments show that the estimation consistently improves retrieval effectiveness.",
keywords = "EWI-15456, IR-68558, METIS-264405, CR-H.3.3",
author = "Robin Aly and Djoerd Hiemstra and {de Vries}, A.P.",
note = "10.1145/1646396.1646448",
year = "2009",
month = "6",
doi = "10.1145/1646396.1646448",
language = "Undefined",
isbn = "978-1-60558-480-5",
publisher = "Association for Computing Machinery (ACM)",
pages = "44:1--44:8",
booktitle = "Proceedings of the 8th ACM International Conference on Image and Video Retrieval (CIVR '09)",
address = "United States",

}

Aly, R, Hiemstra, D & de Vries, AP 2009, Reusing Annotation Labor for Concept Selection. in Proceedings of the 8th ACM International Conference on Image and Video Retrieval (CIVR '09)., 10.1145/1646396.1646448, Association for Computing Machinery (ACM), New York, pp. 44:1-44:8. https://doi.org/10.1145/1646396.1646448

Reusing Annotation Labor for Concept Selection. / Aly, Robin; Hiemstra, Djoerd; de Vries, A.P.

Proceedings of the 8th ACM International Conference on Image and Video Retrieval (CIVR '09). New York : Association for Computing Machinery (ACM), 2009. p. 44:1-44:8 10.1145/1646396.1646448.

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - Reusing Annotation Labor for Concept Selection

AU - Aly, Robin

AU - Hiemstra, Djoerd

AU - de Vries, A.P.

N1 - 10.1145/1646396.1646448

PY - 2009/6

Y1 - 2009/6

N2 - Describing shots through the occurrence of semantic concepts is the first step towards modeling the content of a video semantically. An important challenge is to automatically select the right concepts for a given information need. For example, systems should be able to decide whether the concept ``Outdoor'' should be included into a search for ``Street Basketball''. In this paper we provide an innovative method to automatically select concepts for an information need. To achieve this, we provide an estimation for the occurrence probability of a concept in relevant shots, which helps us to quantify the helpfulness of a concept. Our method re-uses existing training data which is annotated with concept occurrences to build a text collection. Searching in this collection with a text retrieval system and knowing about the concept occurrences allows us to come up with a good estimate for this probability. We evaluate our method against a concept selection benchmark and search runs on both the TRECVID 2005 and 2007 collections. These experiments show that the estimation consistently improves retrieval effectiveness.

AB - Describing shots through the occurrence of semantic concepts is the first step towards modeling the content of a video semantically. An important challenge is to automatically select the right concepts for a given information need. For example, systems should be able to decide whether the concept ``Outdoor'' should be included into a search for ``Street Basketball''. In this paper we provide an innovative method to automatically select concepts for an information need. To achieve this, we provide an estimation for the occurrence probability of a concept in relevant shots, which helps us to quantify the helpfulness of a concept. Our method re-uses existing training data which is annotated with concept occurrences to build a text collection. Searching in this collection with a text retrieval system and knowing about the concept occurrences allows us to come up with a good estimate for this probability. We evaluate our method against a concept selection benchmark and search runs on both the TRECVID 2005 and 2007 collections. These experiments show that the estimation consistently improves retrieval effectiveness.

KW - EWI-15456

KW - IR-68558

KW - METIS-264405

KW - CR-H.3.3

U2 - 10.1145/1646396.1646448

DO - 10.1145/1646396.1646448

M3 - Conference contribution

SN - 978-1-60558-480-5

SP - 44:1-44:8

BT - Proceedings of the 8th ACM International Conference on Image and Video Retrieval (CIVR '09)

PB - Association for Computing Machinery (ACM)

CY - New York

ER -

Aly R, Hiemstra D, de Vries AP. Reusing Annotation Labor for Concept Selection. In Proceedings of the 8th ACM International Conference on Image and Video Retrieval (CIVR '09). New York: Association for Computing Machinery (ACM). 2009. p. 44:1-44:8. 10.1145/1646396.1646448 https://doi.org/10.1145/1646396.1646448