Package org.nineml.coffeegrinder.tokens

The token classes.

See: Description

Class Summary

Class	Description
CharacterSet	A class that represents a range of Unicode characters.
Token	An input token.
TokenCharacter	A single character Token.
TokenCharacterSet	A token character set.
TokenEOF	A single character Token.
TokenEPSILON	A single character Token.
TokenRegex	A regular expression token Token.
TokenString	A string Token.

Package org.nineml.coffeegrinder.tokens Description

The token classes.

Tokens are what the parser consumes. Often this is a sequence of characters, but it can also be a sequence of strings or, in fact, arbitrary items.