module core

arx.lexer.core

Source: packages/arx/src/arx/lexer/core.py:1

Module for handling the lexer analysis.

Classes

• Lexer — Lexer class for tokenizing known variables.

• LexerError — Custom exception for lexer errors.

• Token — Token class store the kind and the value of the token.

• TokenKind — TokenKind enumeration for known variables returned by the lexer.

• TokenList — Class for handle a List of tokens.

Attributes

• EOF —

• MAP_KW_TOKEN_TO_NAME —

• MAP_NAME_TO_KW_TOKEN —

• MAX_NESTING_DEPTH —

• MAX_NUMERIC_LITERAL_CHARS —

• MAX_TOKEN_COUNT —

• WORD_OPERATORS —

• _MANIFEST —