Uses of Interface
opennlp.tools.tokenize.Detokenizer

Packages that use Detokenizer

opennlp.tools.formats	Experimental package related to converting various corpora to OpenNLP Format.
opennlp.tools.sentdetect	Package related to identifying sentece boundries.
opennlp.tools.tokenize	Contains classes related to finding token or words in a string.

Uses of Detokenizer in opennlp.tools.formats

Constructors in opennlp.tools.formats with parameters of type Detokenizer

NameToSentenceSampleStream(Detokenizer detokenizer, ObjectStream<NameSample> samples, int chunkSize)

NameToTokenSampleStream(Detokenizer detokenizer, ObjectStream<NameSample> samples)

POSToTokenSampleStream(Detokenizer detokenizer, ObjectStream<POSSample> samples)

Uses of Detokenizer in opennlp.tools.sentdetect

Constructors in opennlp.tools.sentdetect with parameters of type Detokenizer

SentenceSample(Detokenizer detokenizer, String[][] sentences)

Uses of Detokenizer in opennlp.tools.tokenize

Classes in opennlp.tools.tokenize that implement Detokenizer

class

DictionaryDetokenizer A rule based detokenizer.

Constructors in opennlp.tools.tokenize with parameters of type Detokenizer

TokenSample(Detokenizer detokenizer, String[] tokens)