RubyGems Navigation menu

TokenizerProjectUT 0.0.1

A simple multilingual tokenizer for NLP tasks. This tool provides a CLI and a library for linguistic tokenization which is an anavoidable step for many HLT (human language technology) tasks in the preprocessing phase for further syntactic, semantic and other higher level processing goals. Use it for tokenization of German, English and French texts.

Gemfile:
=

instalar:
=

Versões:

  1. 0.0.1 November 29, 2011 (6,5 KB)

Donos:

Autores:

  • David Alfter

SHA 256 checksum:

=

Total de downloads 4.345

Desta versão 4.345

Versão lançada:

Licenças:

N/A

Versão Requerida do Ruby: Nenhum

Links: