API reference
python:aix:aix.lexer.core
module core
aix.lexer.core
Source: packages/aix/src/aix/lexer/core.py:1
AIX Unicode lexer.
Attributes
-
EOF_VALUE — Eof value.; Type: Final[str]
-
PRIMITIVE_TYPES — Primitive types.; Type: Final[frozenset[str]]
-
_RESERVED_OPERATORS — Reserved operators.; Type: Final[frozenset[str]]
-
_SYMBOL_TOKENS — Symbol tokens.; Type: Final[dict[str, TokenKind]]
Classes
-
Lexer — Tokenize AIX source text.
-
LexerError — AIX-specific lexer error with source location.
-
Token — Store one token kind, value, and source location.
-
TokenKind — Token kinds emitted by the AIX lexer.
-
TokenList — Simple token stream consumed by the parser.