|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||
| Packages that use TokenizerModel | |
|---|---|
| opennlp.tools.tokenize | Contains classes related to finding token or words in a string. |
| Uses of TokenizerModel in opennlp.tools.tokenize |
|---|
| Methods in opennlp.tools.tokenize that return TokenizerModel | |
|---|---|
static TokenizerModel |
TokenizerME.train(String languageCode,
ObjectStream<TokenSample> samples,
boolean useAlphaNumericOptimization)
Trains a model for the TokenizerME with a default cutoff of 5 and 100 iterations. |
static TokenizerModel |
TokenizerME.train(String languageCode,
ObjectStream<TokenSample> samples,
boolean useAlphaNumericOptimization,
int cutoff,
int iterations)
Trains a model for the TokenizerME. |
| Constructors in opennlp.tools.tokenize with parameters of type TokenizerModel | |
|---|---|
TokenizerME(TokenizerModel model)
|
|
|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||