opennlp.tools.tokenize
Class DefaultTokenContextGenerator
java.lang.Object
opennlp.tools.tokenize.DefaultTokenContextGenerator
- All Implemented Interfaces:
- TokenContextGenerator
public class DefaultTokenContextGenerator
- extends Object
- implements TokenContextGenerator
Generate events for maxent decisions for tokenization.
- Version:
- $Revision: 1.4 $, $Date: 2010/09/21 09:09:36 $
- Author:
- Jason Baldridge
Method Summary |
String[] |
getContext(String sentence,
int index)
Returns an array of features for the specified sentence string at the specified index. |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
DefaultTokenContextGenerator
public DefaultTokenContextGenerator()
getContext
public String[] getContext(String sentence,
int index)
- Description copied from interface:
TokenContextGenerator
- Returns an array of features for the specified sentence string at the specified index.
- Specified by:
getContext
in interface TokenContextGenerator
- Parameters:
sentence
- The string for a sentence.index
- The index to consider splitting as a token.
- Returns:
- an array of features for the specified sentence string at the
specified index.
Copyright © 2010. All Rights Reserved.