|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use Token | |
---|---|
org.antlr.grammar.v3 | |
org.antlr.gunit | |
org.antlr.runtime | |
org.antlr.runtime.debug | |
org.antlr.runtime.tree | |
org.antlr.tool |
Uses of Token in org.antlr.grammar.v3 |
---|
Methods in org.antlr.grammar.v3 that return Token | |
---|---|
Token |
ActionTranslator.nextToken()
|
Token |
ActionAnalysis.nextToken()
|
Uses of Token in org.antlr.gunit |
---|
Constructors in org.antlr.gunit with parameters of type Token | |
---|---|
OutputTest(Token token)
|
|
ReturnTest(Token retval)
|
Uses of Token in org.antlr.runtime |
---|
Classes in org.antlr.runtime that implement Token | |
---|---|
class |
ClassicToken
A Token object like we'd use in ANTLR 2.x; has an actual string created and associated with this object. |
class |
CommonToken
|
Fields in org.antlr.runtime declared as Token | |
---|---|
static Token |
Token.EOF_TOKEN
|
static Token |
Token.INVALID_TOKEN
|
static Token |
Token.SKIP_TOKEN
In an action, a lexer rule can set token to this SKIP_TOKEN and ANTLR will avoid creating a token for this symbol and try to fetch another. |
Token |
ParserRuleReturnScope.start
|
Token |
ParserRuleReturnScope.stop
|
Token |
RecognitionException.token
The current Token when an error occurred. |
Token |
RecognizerSharedState.token
The goal of all lexer rules/methods is to create a token object. |
Methods in org.antlr.runtime that return Token | |
---|---|
Token |
Lexer.emit()
The standard method called to automatically emit a token at the outermost lexical rule. |
Token |
CommonTokenStream.get(int i)
Return absolute token i; ignore which channel the tokens are on; that is, count all tokens not just on-channel tokens. |
Token |
TokenStream.get(int i)
Get a token at an absolute index i; 0..n-1. |
Token |
UnwantedTokenException.getUnexpectedToken()
|
protected Token |
CommonTokenStream.LB(int k)
Look backwards k tokens on-channel tokens |
Token |
CommonTokenStream.LT(int k)
Get the ith token from the current position 1..n where k=1 is the first symbol of lookahead. |
Token |
TokenStream.LT(int k)
Get Token at current input pointer + i ahead where i=1 is next Token. |
Token |
TokenSource.nextToken()
Return a Token object from your input stream (usually a CharStream). |
Token |
Lexer.nextToken()
Return a token from this source; i.e., match a token on the char stream. |
Methods in org.antlr.runtime with parameters of type Token | |
---|---|
void |
TokenRewriteStream.delete(java.lang.String programName,
Token from,
Token to)
|
void |
TokenRewriteStream.delete(Token indexT)
|
void |
TokenRewriteStream.delete(Token from,
Token to)
|
void |
Lexer.emit(Token token)
Currently does not support multiple emits per nextToken invocation for efficiency reasons. |
java.lang.String |
BaseRecognizer.getTokenErrorDisplay(Token t)
How should a token be displayed in an error message? The default is to display just the text, but during development you might want to have a lot of information spit out. |
void |
TokenRewriteStream.insertAfter(java.lang.String programName,
Token t,
java.lang.Object text)
|
void |
TokenRewriteStream.insertAfter(Token t,
java.lang.Object text)
|
void |
TokenRewriteStream.insertBefore(java.lang.String programName,
Token t,
java.lang.Object text)
|
void |
TokenRewriteStream.insertBefore(Token t,
java.lang.Object text)
|
void |
TokenRewriteStream.replace(java.lang.String programName,
Token from,
Token to,
java.lang.Object text)
|
void |
TokenRewriteStream.replace(Token indexT,
java.lang.Object text)
|
void |
TokenRewriteStream.replace(Token from,
Token to,
java.lang.Object text)
|
java.lang.String |
CommonTokenStream.toString(Token start,
Token stop)
|
java.lang.String |
TokenStream.toString(Token start,
Token stop)
Because the user is not required to use a token with an index stored in it, we must provide a means for two token objects themselves to indicate the start/end location. |
Constructors in org.antlr.runtime with parameters of type Token | |
---|---|
ClassicToken(Token oldToken)
|
|
CommonToken(Token oldToken)
|
Uses of Token in org.antlr.runtime.debug |
---|
Classes in org.antlr.runtime.debug that implement Token | |
---|---|
static class |
RemoteDebugEventSocketListener.ProxyToken
|
Methods in org.antlr.runtime.debug that return Token | |
---|---|
Token |
DebugTokenStream.get(int i)
|
Token |
DebugTreeAdaptor.getToken(java.lang.Object t)
|
Token |
DebugTokenStream.LT(int i)
|
Methods in org.antlr.runtime.debug with parameters of type Token | |
---|---|
void |
DebugTreeAdaptor.addChild(java.lang.Object t,
Token child)
|
java.lang.Object |
DebugTreeAdaptor.becomeRoot(Token newRoot,
java.lang.Object oldRoot)
|
void |
DebugEventRepeater.consumeHiddenToken(Token token)
|
void |
DebugEventSocketProxy.consumeHiddenToken(Token t)
|
void |
Profiler.consumeHiddenToken(Token token)
|
void |
BlankDebugEventListener.consumeHiddenToken(Token token)
|
void |
DebugEventHub.consumeHiddenToken(Token token)
|
void |
ParseTreeBuilder.consumeHiddenToken(Token token)
|
void |
DebugEventListener.consumeHiddenToken(Token t)
An off-channel input token was consumed. |
void |
DebugEventRepeater.consumeToken(Token token)
|
void |
DebugEventSocketProxy.consumeToken(Token t)
|
void |
Profiler.consumeToken(Token token)
|
void |
BlankDebugEventListener.consumeToken(Token token)
|
void |
DebugEventHub.consumeToken(Token token)
|
void |
ParseTreeBuilder.consumeToken(Token token)
|
void |
DebugEventListener.consumeToken(Token t)
An input token was consumed; matched by any kind of element. |
java.lang.Object |
DebugTreeAdaptor.create(int tokenType,
Token fromToken)
|
java.lang.Object |
DebugTreeAdaptor.create(int tokenType,
Token fromToken,
java.lang.String text)
|
java.lang.Object |
DebugTreeAdaptor.create(Token payload)
|
void |
DebugEventRepeater.createNode(java.lang.Object node,
Token token)
|
void |
DebugEventSocketProxy.createNode(java.lang.Object node,
Token token)
|
void |
BlankDebugEventListener.createNode(java.lang.Object node,
Token token)
|
void |
TraceDebugEventListener.createNode(java.lang.Object node,
Token token)
|
void |
DebugEventHub.createNode(java.lang.Object node,
Token token)
|
void |
DebugEventListener.createNode(java.lang.Object node,
Token token)
Announce a new node built from an existing token. |
java.lang.Object |
DebugTreeAdaptor.errorNode(TokenStream input,
Token start,
Token stop,
RecognitionException e)
|
void |
DebugEventRepeater.LT(int i,
Token t)
|
void |
DebugEventSocketProxy.LT(int i,
Token t)
|
void |
Profiler.LT(int i,
Token t)
Track refs to lookahead if in a fixed/nonfixed decision. |
void |
BlankDebugEventListener.LT(int i,
Token t)
|
void |
DebugEventHub.LT(int index,
Token t)
|
void |
DebugEventListener.LT(int i,
Token t)
Somebody (anybody) looked ahead. |
protected java.lang.String |
DebugEventSocketProxy.serializeToken(Token t)
|
void |
DebugTreeAdaptor.setTokenBoundaries(java.lang.Object t,
Token startToken,
Token stopToken)
|
java.lang.String |
DebugTokenStream.toString(Token start,
Token stop)
|
Uses of Token in org.antlr.runtime.tree |
---|
Fields in org.antlr.runtime.tree declared as Token | |
---|---|
Token |
CommonErrorNode.start
|
Token |
CommonErrorNode.stop
|
Token |
CommonTree.token
A single token is the payload |
Methods in org.antlr.runtime.tree that return Token | |
---|---|
Token |
CommonTreeAdaptor.createToken(int tokenType,
java.lang.String text)
Tell me how to create a token for use with imaginary token nodes. |
abstract Token |
BaseTreeAdaptor.createToken(int tokenType,
java.lang.String text)
Tell me how to create a token for use with imaginary token nodes. |
Token |
CommonTreeAdaptor.createToken(Token fromToken)
Tell me how to create a token for use with imaginary token nodes. |
abstract Token |
BaseTreeAdaptor.createToken(Token fromToken)
Tell me how to create a token for use with imaginary token nodes. |
Token |
CommonTree.getToken()
|
Token |
CommonTreeAdaptor.getToken(java.lang.Object t)
What is the Token associated with this node? If you are not using CommonTree, then you must override this in your own adaptor. |
Token |
TreeAdaptor.getToken(java.lang.Object t)
Return the token object from which this node was created. |
Token |
RewriteRuleTokenStream.nextToken()
|
Methods in org.antlr.runtime.tree with parameters of type Token | |
---|---|
java.lang.Object |
TreeAdaptor.becomeRoot(Token newRoot,
java.lang.Object oldRoot)
Create a node for newRoot make it the root of oldRoot. |
java.lang.Object |
BaseTreeAdaptor.becomeRoot(Token newRoot,
java.lang.Object oldRoot)
|
java.lang.Object |
TreeAdaptor.create(int tokenType,
Token fromToken)
Create a new node derived from a token, with a new token type. |
java.lang.Object |
BaseTreeAdaptor.create(int tokenType,
Token fromToken)
|
java.lang.Object |
TreeAdaptor.create(int tokenType,
Token fromToken,
java.lang.String text)
Same as create(tokenType,fromToken) except set the text too. |
java.lang.Object |
BaseTreeAdaptor.create(int tokenType,
Token fromToken,
java.lang.String text)
|
java.lang.Object |
CommonTreeAdaptor.create(Token payload)
|
java.lang.Object |
TreeWizard.TreePatternTreeAdaptor.create(Token payload)
|
java.lang.Object |
TreeAdaptor.create(Token payload)
Create a tree node from Token object; for CommonTree type trees, then the token just becomes the payload. |
Token |
CommonTreeAdaptor.createToken(Token fromToken)
Tell me how to create a token for use with imaginary token nodes. |
abstract Token |
BaseTreeAdaptor.createToken(Token fromToken)
Tell me how to create a token for use with imaginary token nodes. |
java.lang.Object |
TreeAdaptor.errorNode(TokenStream input,
Token start,
Token stop,
RecognitionException e)
Return a tree node representing an error. |
java.lang.Object |
BaseTreeAdaptor.errorNode(TokenStream input,
Token start,
Token stop,
RecognitionException e)
create tree node that holds the start and stop tokens associated with an error. |
void |
CommonTreeAdaptor.setTokenBoundaries(java.lang.Object t,
Token startToken,
Token stopToken)
Track start/stop token for subtree root created for a rule. |
void |
TreeAdaptor.setTokenBoundaries(java.lang.Object t,
Token startToken,
Token stopToken)
Where are the bounds in the input token stream for this node and all children? Each rule that creates AST nodes will call this method right before returning. |
Constructors in org.antlr.runtime.tree with parameters of type Token | |
---|---|
CommonErrorNode(TokenStream input,
Token start,
Token stop,
RecognitionException e)
|
|
CommonTree(Token t)
|
|
TreeWizard.TreePattern(Token payload)
|
|
TreeWizard.WildcardTreePattern(Token payload)
|
Uses of Token in org.antlr.tool |
---|
Methods in org.antlr.tool that return Token | |
---|---|
Token |
Interpreter.nextToken()
|
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |