Collaborative Video and Image Annotation

Collaborative Video and Image Annotation
Print Friendly
XML
Arnold, Matthias, Cluster of Excellence ‘Asia and Europe in a Global Context’, Heidelberg University, Germany, arnold@asia-europe.uni-heidelberg.de
Knab, Cornelia, Cluster of Excellence ‘Asia and Europe in a Global Context’, Heidelberg University, Germany, knab@asia-europe.uni-heidelberg.de
Decker, Eric, Cluster of Excellence ‘Asia and Europe in a Global Context’, Heidelberg University, Germany, decker@asia-europe.uni-heidelberg.de
The Heidelberg Research Architecture (HRA)1 is the Digital Humanities Section of Heidelberg University’s Cluster of Excellence Asia and Europe in a Global Context – Shifting Asymmetries in Cultural Flows.2 It brings together a team of IT scientists, software developers, and database architects with international researchers and students. In collaborative projects, the HRA aims to develop an integrated digital humanities environment for interdisciplinary studies of transcultural dynamics.

The core of the HRA research environment is Tamboti, the central metadata framework3 which is used to store standards-based metadata information (e.g. MODS, VRA core 4, TEI, MADS) in an XML database4. Researchers can access their resources using a platform-independent browser interface to share and collaboratively work on metadata. In addition, an Open Annotation Collaboration (OAC)5 module for comments and research annotations is under development. Flexible webservices and user-friendly interfaces for data input (using XForms) will help to further accumulate resources for research.

This poster presentation provides two examples of research projects focussing on visual resource material.

First, the Video Annotation Database6 allows to annotate a film as a whole and to comment on individual scenes by using the Public Access Digital Media Archive (pad.ma)7 video annotation software. It offers different types of annotation: transcripts to record the narration, descriptions to annotate scenes, and keywords to add subjects, identify locations, etc. All textual input can be searched. In addition, keywords may be geo-referenced and browsed or searched in a map-interface.

Second, for digital still images a separate module is being developed using the VRA core 4 XML schema8. Besides storing images with metadata its aim is to provide researchers with a set of useful tools to directly link the visual material with their research. Important features for its users will be the opportunity of collaborative metadata editing, a flexible system for sharing of resources, as well as tools for annotation and comments based on OAC. In addition, the module will allow to automatically extract embedded metadata on ingest via exif-tool. It will also be possible to mark, annotate and link parts of images, to group images on virtual lighttables, and to save and export image sequences (‘visual itineraries’).

Two ongoing research projects will exemplify the use of the databases:

Example 1: Global Politics on Screen

As an example for empirical historical research concentrating on visual source material, the project Global Politics on Screen – A Japanese Film on the Lytton Commission in 19329 tests the potential of video annotation tools by combining pad.ma with models of historical film interpretation. In this research based training project, a team of history students and researchers centres on analysing and commenting a silent Japanese propaganda film about a crucial moment of world history – the Japanese invasion of Manchuria in 1931 which led the way to the Second World War. While the League of Nations commission aimed at preventing further military disputes in the ‘Far East’ the focus of the film producers was to propagate their own interpretation of international politics. The analysis of the film is a starting point to approach the complex international diplomatic and economic relations of the early 1930s. The project builds up a platform to explore the global contexts and public representations of these critical historical incidents from a new perspective.

Example 2: Priya Paul Collection

The Priya Paul Collection of Popular Art10contains more than 4.200 illustrations from late 19th and 20th century India. It is one of the finest collections of ephemera such as old posters, calendars, postcards, commercial advertisements, textile labels and cinema posters. In a collaborative endeavor with Tasveerghar – A Digital Network of South Asian Popular Visual Culture11the collection was digitised and is now being annotated by experts from history, art history, visual and media anthropology, and ethnology. The subststantial research metadata of the collection is a showcase for the implementation of VRA Core 4 XML in the metadata framework and a user-friendly VRA metadata editor is under development. Content analysis is closely connected with the intense study of the material which already resulted in fourteen research essays and extensive work of annotation. With the new digital still image module, Tamboti will serve as a platform to integrate archive and metadata storage with scientific discussion and analysis within a single framework.

Screenshot 1
Screenshot 1: Video Annotation Database – Editor

Screenshot 2
Screenshot 2: Image from the Priya Paul Collection – Image Viewer (HeidICON 12)

Coordination

Global Politics on Screen:

Prof. Dr. Madeleine Herren-Oesch, Cluster of Excellence “Asia and Europe in a Global Context”, Heidelberg University;

Cornelia Knab, Cluster of Excellence “Asia and Europe in a Global Context”, Heidelberg University;

Eric Decker, Heidelberg Research Architecture, Cluster of Excellence “Asia and Europe in a Global Context”, Heidelberg University

Priya Paul Collection:

Prof. Dr. Christiane Brosius, Cluster of Excellence “Asia and Europe in a Global Context”, Heidelberg University;

Sumathi Ramaswamy, Duke University

Yousuf Saeed, Tasveerghar, Delhi

Matthias Arnold, Heidelberg Research Architecture, Cluster of Excellence “Asia and Europe in a Global Context”, Heidelberg University

Members

Global Politics on Screen:

Inci Bosnak, Sascha Herlings, Felix Nothdurft, Maya Okuda, Julian Wettengel, Dulip Withanage, Matthias Guth

Priya Paul Collection:

Laila Abu-Er-Rub, Suboor Bakht, Gerhard Schönfelder, Sridevi Padmahan, Simon Grüning, Tony Buchwald, Johannes Alisch

Project term

Global Politics on Screen: September 2010 – September 2012

Priya Paul Collection: January 2009 – September 2012

Funding

DFG – Cluster of Excellence “Asia-Europe in a Global Context”, Heidelberg University

Cooperations

Cluster of Excellence “Asia-Europe in a Global Context”, Heidelberg University;

History Department, Heidelberg University;

League of Nations Archive, UNOG Library, Geneva;

Japan Center for Asian Historical Records (JACAR) アジア歴史資料センター;

LONSEA Project, Heidelberg University;

Tasveerghar – A Digital Network of South Asian Popular Visual Culture, Delhi

Presentation

Cornelia Knab, Eric Decker, Matthias Arnold

notes
1.Heidelberg Research Architecture, http://hra.uni-hd.de

2.Cluster of Excellence ‘Asia and Europe in a Global Context’, http://www.asia-europe.uni-heidelberg.de

3.Tamboti metadata framework, http://tamboti.uni-hd.de

4.eXist-db open source database management system, http://exist-db.org

5.Open Annotation Collaboration, http://www.openannotation.org

6.Video Annotation Database, http://vad.uni-hd.de

7.Public Access Digital Media Archive, http://pad.ma

8.VRA Core 4 XML standard, http://www.loc.gov/standards/vracore/

9.Global Politics on Screen, http://lytton-project.uni-hd.de

10.The Priya Paul Collection of Popular Art, http://priyapaulcollection.uni-hd.de/

11.Tasveerghar – A Digital Network of South Asian Popular Visual Culture, http://tasveerghar.net/

12.HeidICON – Die Heidelberger Bilddatenbank, http://heidicon.ub.uni-heidelberg.de