Class TokenizerEvaluator

  extended by<TokenSample>
      extended by

public class TokenizerEvaluator
extends Evaluator<TokenSample>

The TokenizerEvaluator measures the performance of the given Tokenizer with the provided reference TokenSamples.

See Also:
Evaluator, Tokenizer, TokenSample

Constructor Summary
TokenizerEvaluator(Tokenizer tokenizer)
          Initializes the current instance with the given Tokenizer.
Method Summary
 void evaluateSample(TokenSample reference)
          Evaluates the given reference TokenSample object.
 FMeasure getFMeasure()
Methods inherited from class
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail


public TokenizerEvaluator(Tokenizer tokenizer)
Initializes the current instance with the given Tokenizer.

tokenizer - the Tokenizer to evaluate.
Method Detail


public void evaluateSample(TokenSample reference)
Evaluates the given reference TokenSample object. This is done by detecting the token spans with the Tokenizer. The detected token spans are then used to calculate calculate and update the scores.

Specified by:
evaluateSample in class Evaluator<TokenSample>
reference - the reference TokenSample.


public FMeasure getFMeasure()

Copyright © 2010. All Rights Reserved.