opennlp.tools.util.featuregen
Class TokenFeatureGenerator

java.lang.Object
  extended by opennlp.tools.util.featuregen.FeatureGeneratorAdapter
      extended by opennlp.tools.util.featuregen.TokenFeatureGenerator
All Implemented Interfaces:
AdaptiveFeatureGenerator

public class TokenFeatureGenerator
extends FeatureGeneratorAdapter

Generates a feature which contains the token itself.


Constructor Summary
TokenFeatureGenerator()
           
TokenFeatureGenerator(boolean lowercase)
           
 
Method Summary
 void createFeatures(List<String> features, String[] tokens, int index, String[] preds)
          Adds the appropriate features for the token at the specified index with the specified array of previous outcomes to the specified list of features.
 
Methods inherited from class opennlp.tools.util.featuregen.FeatureGeneratorAdapter
clearAdaptiveData, updateAdaptiveData
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

TokenFeatureGenerator

public TokenFeatureGenerator(boolean lowercase)

TokenFeatureGenerator

public TokenFeatureGenerator()
Method Detail

createFeatures

public void createFeatures(List<String> features,
                           String[] tokens,
                           int index,
                           String[] preds)
Description copied from interface: AdaptiveFeatureGenerator
Adds the appropriate features for the token at the specified index with the specified array of previous outcomes to the specified list of features.

Parameters:
features - The list of features to be added to.
tokens - The tokens of the sentence or other text unit being processed.
index - The index of the token which is currently being processed.
preds - The outcomes for the tokens prior to the specified index.


Copyright © 2010. All Rights Reserved.