opennlp.tools.tokenize
Class WhitespaceTokenStream

java.lang.Object
  opennlp.tools.util.FilterObjectStream<TokenSample,String>
      opennlp.tools.tokenize.WhitespaceTokenStream

All Implemented Interfaces:

ObjectStream<String>

public class WhitespaceTokenStream
extends FilterObjectStream<TokenSample,String>

This stream formats a TokenSamples into whitespace separated token strings.

Field Summary

Fields inherited from class opennlp.tools.util.FilterObjectStream

samples

Constructor Summary

WhitespaceTokenStream(ObjectStream<TokenSample> tokens)

Method Summary

String

read() Returns the next object.

Methods inherited from class opennlp.tools.util.FilterObjectStream

close, reset

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WhitespaceTokenStream

public WhitespaceTokenStream(ObjectStream<TokenSample> tokens)

Method Detail

read

public String read()
            throws IOException

Description copied from interface: ObjectStream

Returns the next object. Calling this method repeatedly until it returns null will return each object from the underlying source exactly once.

Returns:

the next object or null to signal that the stream is exhausted

Throws:

IOException