Uses of Interface
opennlp.tools.tokenize.TokenContextGenerator

Packages that use TokenContextGenerator

opennlp.tools.tokenize

Contains classes related to finding token or words in a string.

Uses of TokenContextGenerator in opennlp.tools.tokenize

Classes in opennlp.tools.tokenize that implement TokenContextGenerator

class

DefaultTokenContextGenerator Generate events for maxent decisions for tokenization.

Constructors in opennlp.tools.tokenize with parameters of type TokenContextGenerator

TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, TokenContextGenerator cg)
Initializes the current instance.