module core

aix.lexer.core

Source: packages/aix/src/aix/lexer/core.py:1

AIX Unicode lexer.

Classes

• Lexer — Tokenize AIX source text.

• LexerError — AIX-specific lexer error with source location.

• Token — Store one token kind, value, and source location.

• TokenKind — Token kinds emitted by the AIX lexer.

• TokenList — Simple token stream consumed by the parser.

Attributes

• EOF_VALUE —

• PRIMITIVE_TYPES —

• _RESERVED_OPERATORS —

• _SYMBOL_TOKENS —