Reinforcement Learning of Informative Attention Patterns for Object Recognition

Lucas Paletta, Gerald Fritz, Christin Seifert

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    4 Citations (Scopus)
    48 Downloads (Pure)


    Attention is a highly important phenomenon emerging in infant development [1]. In human perception, sequential visual sampling about the environment is mandatory for object recognition purposes. Sequential attention is viewed in the framework of a saccadic decision process that aims at minimizing the uncertainty about the semantic interpretation for object or scene recognition. Methodologically, this work provides a framework for learning sequential attention in real-world visual object recognition, using an architecture of three processing stages. The first stage rejects irrelevant local descriptors providing candidates for foci of interest (FOI). The second stage investigates the information in the FOI using a codebook matcher. The third stage integrates local information via shifts of attention to characterize object discrimination. A Q-learner adapts then from explorative search on the FOI sequences. The methodology is successfully evaluated on representative indoors and outdoors imagery, demonstrating the significant impact of the learning procedures on recognition accuracy and processing time.
    Original languageEnglish
    Title of host publicationThe 4th IEEE International Conference on Development and Learning (ICDL 2005)
    Subtitle of host publicationProceedings
    Place of PublicationPiscataway, NJ
    Number of pages6
    ISBN (Print)0-7803-9226-4
    Publication statusPublished - 1 Jul 2005
    Event4th International Conference on Development and Learning, ICDL 2005 - INTEX Osaka, Osaka, Japan
    Duration: 19 Jul 200521 Jul 2005
    Conference number: 4


    Conference4th International Conference on Development and Learning, ICDL 2005
    Abbreviated titleICDL
    Internet address


    Dive into the research topics of 'Reinforcement Learning of Informative Attention Patterns for Object Recognition'. Together they form a unique fingerprint.

    Cite this