public class LexerTokenizer extends AbstractTokenizer<String>
Tokenizer designed to work with
Lexer implementing classes. Throw in a Lexer on
construction and you get a Tokenizer.NEWLINE_TOKEN, nextToken| Constructor and Description |
|---|
LexerTokenizer(Lexer l)
Constructs a tokenizer from a
Lexer. |
LexerTokenizer(Lexer l,
Reader r)
|
| Modifier and Type | Method and Description |
|---|---|
protected String |
getNext()
Internally fetches the next token.
|
static void |
main(String[] args)
For testing only.
|
hasNext, next, peek, remove, tokenizeclone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitforEachRemainingprotected String getNext()
getNext in class AbstractTokenizer<String>public static void main(String[] args) throws IOException
IOException