antlr
Interface TokenManager

All Known Implementing Classes:

SimpleTokenManager

interface TokenManager

Interface that describes the set of defined tokens

Method Summary

java.lang.Object	clone()
void	define(TokenSymbol ts) define a token symbol
java.lang.String	getName() Get the name of the token manager
java.lang.String	getTokenStringAt(int idx) Get a token string by index
TokenSymbol	getTokenSymbol(java.lang.String sym) Get the TokenSymbol for a string
TokenSymbol	getTokenSymbolAt(int idx)
java.util.Enumeration	getTokenSymbolElements() Get an enumerator over the symbol table
java.util.Enumeration	getTokenSymbolKeys()
Vector	getVocabulary() Get the token vocabulary (read-only).
boolean	isReadOnly() Is this token manager read-only?
void	mapToTokenSymbol(java.lang.String name, TokenSymbol sym)
int	maxTokenType() Get the highest token type in use
int	nextTokenType() Get the next unused token type
void	setName(java.lang.String n)
void	setReadOnly(boolean ro)
boolean	tokenDefined(java.lang.String symbol) Is a token symbol defined?

Method Detail

clone

public java.lang.Object clone()

define

public void define(TokenSymbol ts)

define a token symbol

getName

public java.lang.String getName()

Get the name of the token manager

getTokenStringAt

public java.lang.String getTokenStringAt(int idx)

Get a token string by index

getTokenSymbol

public TokenSymbol getTokenSymbol(java.lang.String sym)

Get the TokenSymbol for a string

getTokenSymbolAt

public TokenSymbol getTokenSymbolAt(int idx)

getTokenSymbolElements

public java.util.Enumeration getTokenSymbolElements()

Get an enumerator over the symbol table

getTokenSymbolKeys

public java.util.Enumeration getTokenSymbolKeys()

getVocabulary

public Vector getVocabulary()

Get the token vocabulary (read-only).

Returns:

A Vector of Strings indexed by token type

isReadOnly

public boolean isReadOnly()

Is this token manager read-only?

mapToTokenSymbol

public void mapToTokenSymbol(java.lang.String name,
                             TokenSymbol sym)

maxTokenType

public int maxTokenType()

Get the highest token type in use

nextTokenType

public int nextTokenType()

Get the next unused token type

setName

public void setName(java.lang.String n)

setReadOnly

public void setReadOnly(boolean ro)

tokenDefined

public boolean tokenDefined(java.lang.String symbol)

Is a token symbol defined?