Tool Details

TEI P5 Tokenizer

dhl-tools-01Reads TEI P5 and produces token- and sentence annotations. The annotations refer to the base text, but also contain tokens themselves (sentences as readable text).

TaDiRAH 1. Level category: Enrichment
TaDiRAH 2. Level category: Annotating
Platforms: Windows, Mac, Webbased service
Cost: Free
Tool url:
Research objects: Text
Collection name: CLARIN.DK
Last modified: May 11, 2017