The term annotation is a collective term that comprises our efforts in developing new schemes and tools for the annotation of multi-modal data.
In 2005, we developed the general-purpose annotation tool AmiGram which has also been published as an open source project on SourceForge. In addition, we developed an annotation scheme to semantically enhance (annotate) the speech transcript in the multi-party conversations, stored in the AMI Meeting Corpus. Annotations that use this scheme can easily be made with the VISA tool. Parts of these annotations were the basis for our efforts in abstractive summarization. Furthermore, we broaden our annotation in the corpus with schemes for the annotation of speech disfluencies and discourse structure.