public class TreeTokenizerFactory extends Object implements TokenizerFactory<Tree>
| Constructor and Description |
|---|
TreeTokenizerFactory(TreeReaderFactory trf)
Create a TreeTokenizerFactory from a TreeReaderFactory.
|
| Modifier and Type | Method and Description |
|---|---|
Iterator<Tree> |
getIterator(Reader r)
Same as getTokenizer().
|
Tokenizer<Tree> |
getTokenizer(Reader r)
Gets a tokenizer from a reader.
|
Tokenizer<Tree> |
getTokenizer(Reader r,
String extraOptions)
Get a tokenizer for this reader.
|
void |
setOptions(String options)
Sets default options for how tokenizers built from this factory should behave.
|
public TreeTokenizerFactory(TreeReaderFactory trf)
public Tokenizer<Tree> getTokenizer(Reader r)
getTokenizer in interface TokenizerFactory<Tree>r - A Reader (which is assumed to already by buffered, if appropriate)public Tokenizer<Tree> getTokenizer(Reader r, String extraOptions)
TokenizerFactorygetTokenizer in interface TokenizerFactory<Tree>r - A Reader (which is assumed to already by buffered, if appropriate)extraOptions - Options for how this tokenizer should behavepublic Iterator<Tree> getIterator(Reader r)
getIterator in interface IteratorFromReaderFactory<Tree>r - Where to read objects frompublic void setOptions(String options)
TokenizerFactorysetOptions in interface TokenizerFactory<Tree>options - Options for how this tokenizer should behave