Text representation for efficient document annotation

Christin Seifert, Eva Ulbrich, Roman Kern, Michael Granitzer

    Research output: Contribution to journalArticleAcademicpeer-review

    5 Citations (Scopus)
    18 Downloads (Pure)

    Abstract

    In text classification the amount and quality of training data is crucial for the performance of the classifier. The generation of training data is done by human labellers - a tedious and time-consuming work. To reduce the labelling time for single documents we propose to use condensed representations of text documents instead of the full-text document. These condensed representations are key sentences and key phrases and can be generated in a fully unsupervised way. We extended and evaluated the TextRank algorithm to automatically extract key sentences and key phrases. For representing key phrases we propose a layout similar to a tag cloud. In a user study with 37 participants we evaluated whether document labelling with these condensed representations can be done faster and equally accurate by the human labellers. Our evaluation shows that the users labelled tag clouds twice as fast and as accurately as full-text documents. While further investigations for different classification tasks are necessary, this insight could potentially reduce costs for the labelling process of text documents.
    Original languageEnglish
    Pages (from-to)383-405
    Number of pages23
    JournalJournal of universal computer science
    Volume19
    Issue number3
    DOIs
    Publication statusPublished - 2013

    Keywords

    • Data mining
    • Document labelling
    • Supervised learning
    • Tag clouds
    • Text summarisation
    • TextRank
    • Word clouds

    Fingerprint Dive into the research topics of 'Text representation for efficient document annotation'. Together they form a unique fingerprint.

  • Cite this