ImageGrouper: a group-oriented user interface for content-based image retrieval and digital image arrangement

Munehiro Nakazato, L. Manola, Thomas S. Huang

Research output: Contribution to journalArticleAcademic

30 Citations (Scopus)

Abstract

In content-based image retrieval (CBIR), experimental (trial-and-error) query with relevance feedback is essential for successful retrieval. Unfortunately, the traditional user interfaces are not suitable for trying different combinations of query examples. This is because first, these systems assume query examples are always added incrementally. Second, the query and the result display are done on the same workspace. Once the user removes an image from the query examples, the image may disappear from the user interface. In addition, it is difficult to combine the result of different queries. In this paper, we propose a new interface for Content-based image retrieval named ImageGrouper. ImageGrouper is a Group-Oriented user interface in that all operations are done by creating groups of images. This approach has several advantages. First, the users can interactively compare different combinations of the query examples by dragging and grouping the images on the workspace (Query-by-Group). Because the query results are displayed on another pane, the user can quickly review the results and modify the query. Combining different queries is also easy. Furthermore, the concept of “Image Groups” is also applied for annotating and organizing many images. The Annotation-by-Groups method relieves the user of tedious task of annotating textual information on a large number of images. This method realizes a hierarchical annotation of the images as well as Bulk Annotation. The Organize-by-Group method lets the users manipulate the image groups as “Photo Albums” to organize the images. Finally, the usability of the system is compared with the traditional user interfaces. By incorporating the lessons from the experiments, the usability of ImageGrouper is further improved.
Original languageUndefined
Pages (from-to)363-386
JournalJournal of visual languages and computing
Volume14
Issue number4
DOIs
Publication statusPublished - Aug 2003

Keywords

  • IR-58696

Cite this

@article{fd1ac90b49814f46a7e0ec6697d82645,
title = "ImageGrouper: a group-oriented user interface for content-based image retrieval and digital image arrangement",
abstract = "In content-based image retrieval (CBIR), experimental (trial-and-error) query with relevance feedback is essential for successful retrieval. Unfortunately, the traditional user interfaces are not suitable for trying different combinations of query examples. This is because first, these systems assume query examples are always added incrementally. Second, the query and the result display are done on the same workspace. Once the user removes an image from the query examples, the image may disappear from the user interface. In addition, it is difficult to combine the result of different queries. In this paper, we propose a new interface for Content-based image retrieval named ImageGrouper. ImageGrouper is a Group-Oriented user interface in that all operations are done by creating groups of images. This approach has several advantages. First, the users can interactively compare different combinations of the query examples by dragging and grouping the images on the workspace (Query-by-Group). Because the query results are displayed on another pane, the user can quickly review the results and modify the query. Combining different queries is also easy. Furthermore, the concept of “Image Groups” is also applied for annotating and organizing many images. The Annotation-by-Groups method relieves the user of tedious task of annotating textual information on a large number of images. This method realizes a hierarchical annotation of the images as well as Bulk Annotation. The Organize-by-Group method lets the users manipulate the image groups as “Photo Albums” to organize the images. Finally, the usability of the system is compared with the traditional user interfaces. By incorporating the lessons from the experiments, the usability of ImageGrouper is further improved.",
keywords = "IR-58696",
author = "Munehiro Nakazato and L. Manola and Huang, {Thomas S.}",
year = "2003",
month = "8",
doi = "10.1016/S1045-926X(03)00034-X",
language = "Undefined",
volume = "14",
pages = "363--386",
journal = "Journal of visual languages and computing",
issn = "1045-926X",
publisher = "Academic Press Inc.",
number = "4",

}

ImageGrouper: a group-oriented user interface for content-based image retrieval and digital image arrangement. / Nakazato, Munehiro; Manola, L.; Huang, Thomas S.

In: Journal of visual languages and computing, Vol. 14, No. 4, 08.2003, p. 363-386.

Research output: Contribution to journalArticleAcademic

TY - JOUR

T1 - ImageGrouper: a group-oriented user interface for content-based image retrieval and digital image arrangement

AU - Nakazato, Munehiro

AU - Manola, L.

AU - Huang, Thomas S.

PY - 2003/8

Y1 - 2003/8

N2 - In content-based image retrieval (CBIR), experimental (trial-and-error) query with relevance feedback is essential for successful retrieval. Unfortunately, the traditional user interfaces are not suitable for trying different combinations of query examples. This is because first, these systems assume query examples are always added incrementally. Second, the query and the result display are done on the same workspace. Once the user removes an image from the query examples, the image may disappear from the user interface. In addition, it is difficult to combine the result of different queries. In this paper, we propose a new interface for Content-based image retrieval named ImageGrouper. ImageGrouper is a Group-Oriented user interface in that all operations are done by creating groups of images. This approach has several advantages. First, the users can interactively compare different combinations of the query examples by dragging and grouping the images on the workspace (Query-by-Group). Because the query results are displayed on another pane, the user can quickly review the results and modify the query. Combining different queries is also easy. Furthermore, the concept of “Image Groups” is also applied for annotating and organizing many images. The Annotation-by-Groups method relieves the user of tedious task of annotating textual information on a large number of images. This method realizes a hierarchical annotation of the images as well as Bulk Annotation. The Organize-by-Group method lets the users manipulate the image groups as “Photo Albums” to organize the images. Finally, the usability of the system is compared with the traditional user interfaces. By incorporating the lessons from the experiments, the usability of ImageGrouper is further improved.

AB - In content-based image retrieval (CBIR), experimental (trial-and-error) query with relevance feedback is essential for successful retrieval. Unfortunately, the traditional user interfaces are not suitable for trying different combinations of query examples. This is because first, these systems assume query examples are always added incrementally. Second, the query and the result display are done on the same workspace. Once the user removes an image from the query examples, the image may disappear from the user interface. In addition, it is difficult to combine the result of different queries. In this paper, we propose a new interface for Content-based image retrieval named ImageGrouper. ImageGrouper is a Group-Oriented user interface in that all operations are done by creating groups of images. This approach has several advantages. First, the users can interactively compare different combinations of the query examples by dragging and grouping the images on the workspace (Query-by-Group). Because the query results are displayed on another pane, the user can quickly review the results and modify the query. Combining different queries is also easy. Furthermore, the concept of “Image Groups” is also applied for annotating and organizing many images. The Annotation-by-Groups method relieves the user of tedious task of annotating textual information on a large number of images. This method realizes a hierarchical annotation of the images as well as Bulk Annotation. The Organize-by-Group method lets the users manipulate the image groups as “Photo Albums” to organize the images. Finally, the usability of the system is compared with the traditional user interfaces. By incorporating the lessons from the experiments, the usability of ImageGrouper is further improved.

KW - IR-58696

U2 - 10.1016/S1045-926X(03)00034-X

DO - 10.1016/S1045-926X(03)00034-X

M3 - Article

VL - 14

SP - 363

EP - 386

JO - Journal of visual languages and computing

JF - Journal of visual languages and computing

SN - 1045-926X

IS - 4

ER -