io.protostuff.parser

Class AbstractLexer

java.lang.Object

org.antlr.runtime.BaseRecognizer

org.antlr.runtime.Lexer

io.protostuff.parser.AbstractLexer

All Implemented Interfaces:

org.antlr.runtime.TokenSource

Direct Known Subclasses:

ProtoLexer

public abstract class AbstractLexer
extends org.antlr.runtime.Lexer

Base lexer.

Author:

David Yu

Date created:

Dec 16, 2009

Field Summary

Fields inherited from class org.antlr.runtime.Lexer

input

Fields inherited from class org.antlr.runtime.BaseRecognizer

DEFAULT_TOKEN_CHANNEL, HIDDEN, INITIAL_FOLLOW_STACK_SIZE, MEMO_RULE_FAILED, MEMO_RULE_UNKNOWN, NEXT_TOKEN_RULE_NAME, state

Constructor Summary

Constructors

Constructor and Description
AbstractLexer() Default constructor for the lexer, when you do not yet know what the character stream to be provided is.
AbstractLexer(org.antlr.runtime.CharStream input) Create a new instance of the lexer using the given character stream as the input to lex into tokens.
AbstractLexer(org.antlr.runtime.CharStream input, org.antlr.runtime.RecognizerSharedState state) Internal constructor for ANTLR - do not use.

Method Summary

Methods inherited from class org.antlr.runtime.Lexer

emit, emit, getCharErrorDisplay, getCharIndex, getCharPositionInLine, getCharStream, getEOFToken, getErrorMessage, getLine, getSourceName, getText, match, match, matchAny, matchRange, mTokens, nextToken, recover, reportError, reset, setCharStream, setText, skip, traceIn, traceOut

Methods inherited from class org.antlr.runtime.BaseRecognizer

alreadyParsedRule, beginResync, combineFollows, computeContextSensitiveRuleFOLLOW, computeErrorRecoverySet, consumeUntil, consumeUntil, displayRecognitionError, emitErrorMessage, endResync, failed, getBacktrackingLevel, getCurrentInputSymbol, getErrorHeader, getGrammarFileName, getMissingSymbol, getNumberOfSyntaxErrors, getRuleInvocationStack, getRuleInvocationStack, getRuleMemoization, getRuleMemoizationCacheSize, getTokenErrorDisplay, getTokenNames, match, matchAny, memoize, mismatchIsMissingToken, mismatchIsUnwantedToken, pushFollow, recover, recoverFromMismatchedSet, recoverFromMismatchedToken, setBacktrackingLevel, toStrings, traceIn, traceOut

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AbstractLexer

public AbstractLexer()

Default constructor for the lexer, when you do not yet know what the character stream to be provided is.

AbstractLexer

public AbstractLexer(org.antlr.runtime.CharStream input)

Create a new instance of the lexer using the given character stream as the input to lex into tokens.

Parameters:

input - A valid character stream that contains the ruleSrc code you wish to compile (or lex at least)

AbstractLexer

public AbstractLexer(org.antlr.runtime.CharStream input,
             org.antlr.runtime.RecognizerSharedState state)

Internal constructor for ANTLR - do not use.

Parameters:

input - The character stream we are going to lex

state - The shared state object, shared between all lexer comonents