public class WordTokenFactory extends Object implements LexedTokenFactory<Word>
| Constructor and Description |
|---|
WordTokenFactory() |
| Modifier and Type | Method and Description |
|---|---|
Word |
makeToken(String str,
int begin,
int length)
Constructs a token (of arbitrary type) from a String and its position
in the underlying text.
|
public Word makeToken(String str, int begin, int length)
LexedTokenFactorystr.makeToken in interface LexedTokenFactory<Word>str - The String extracted by the lexer.begin - The offset in the document of the first character in this string.length - The number of characters the string takes up in the document.