Towards a Digital Infrastructure for Illustrated Handwritten Archives

Andreas Weber, Mahya Ameryan, Katherine Wolstencroft, Lise Stork, Maarten Heerlien, Lambert Schomaker

Research output: Chapter in Book/Report/Conference proceedingChapterAcademicpeer-review

125 Downloads (Pure)

Abstract

Large and important parts of cultural heritage are stored in archives that are difficult to access, even after digitization. Documents and notes are written in hard-to-read historical handwriting and are often interspersed with illustrations. Such collections are weakly structured and largely inaccessible to a wider public and scholars. Traditionally, humanities researchers treat text and images separately. This separation extends to traditional handwriting recognition systems. Many of them use a segmentation free OCR approach which only allows the resolution of homogenous manuscripts in terms of layout, style and linguistic content. This is in contrast to our infrastructure which aims to resolve heterogeneous handwritten manuscript pages in which different scripts and images are narrowly intertwined. Authors in our use case, a 17,000 page account of exploration of the Indonesian Archipelago between 1820–1850 (“Natuurkundige Commissie voor Nederlands-Indië”) tried to follow a semantic way to record their knowledge and observations, however, this discipline does not exist in the handwriting script. The use of different languages, such as German, Latin, Dutch, Malay, Greek, and French makes interpretation more challenging. Our infrastructure takes the state-of-the-art word retrieval system MONK as starting point. Owing to its visual approach, MONK can handle the diversity of material we encounter in our use case and many other historical collections: text, drawings and images. By combining text and image recognition, we significantly transcend beyond the state-of-the art, and provide meaningful additions to integrated manuscript recognition. This paper describes the infrastructure and presents early results.

Keywords: Deep learning · Digital heritage · Natural history
Biodiversity heritage
Original languageEnglish
Title of host publicationDigital Cultural Heritage
EditorsMarinos Ioannides
PublisherSpringer
Pages155-166
Number of pages12
ISBN (Electronic)978-3-319-75826-8
ISBN (Print)978-3-319-75825-1
DOIs
Publication statusPublished - Mar 2018

Publication series

NameLecture Notes in Computer Science LNCS
PublisherSpringer
Volume10605

    Fingerprint

Keywords

  • deep learning
  • Digital Heritage
  • Natural History
  • Biodiversity heritage
  • Digital Humanities

Cite this

Weber, A., Ameryan, M., Wolstencroft, K., Stork, L., Heerlien, M., & Schomaker, L. (2018). Towards a Digital Infrastructure for Illustrated Handwritten Archives. In M. Ioannides (Ed.), Digital Cultural Heritage (pp. 155-166). (Lecture Notes in Computer Science LNCS; Vol. 10605). Springer. https://doi.org/10.1007/978-3-319-75826-8_13