API reference

python:aix:aix.lexer.Lexer.tokenize

method tokenize

tokenize() -> TokenList

Source: packages/aix/src/aix/lexer/core.py:365

Declared as: python:aix:aix.lexer.core.Lexer.tokenize

Alias for lex used by tests and callers.

Returns

Result of this operation: alias for lex used by tests and callers.; Type: TokenList

Search documentation

Type to search.