class Tokenizer extends Object implements Closeable
| Modifier and Type | Field and Description |
|---|---|
(package private) StringBuilder |
buffer |
(package private) File |
file |
(package private) int |
lastChar |
(package private) int |
lineNumber |
(package private) String |
lineSeparator |
(package private) Reader |
reader |
(package private) String |
text |
| Constructor and Description |
|---|
Tokenizer(File file) |
Tokenizer(File file,
String encoding) |
Tokenizer(Reader reader,
File file,
int lineNumber) |
Tokenizer(String text,
File file,
int lineNumber) |
| Modifier and Type | Method and Description |
|---|---|
void |
close() |
void |
filterLines(String[] patterns,
boolean skip) |
Token |
nextToken() |
(package private) int |
readChar() |
(package private) Token[] |
tokenize() |
File file
String text
Reader reader
String lineSeparator
int lastChar
int lineNumber
StringBuilder buffer
Tokenizer(File file) throws IOException
IOExceptionTokenizer(File file, String encoding) throws IOException
IOExceptionpublic void filterLines(String[] patterns, boolean skip) throws IOException
IOExceptionpublic void close()
throws IOException
close in interface Closeableclose in interface AutoCloseableIOExceptionint readChar()
throws IOException
IOExceptionpublic Token nextToken() throws IOException
IOExceptionToken[] tokenize()
Copyright © 2022. All rights reserved.