method tokenize

tokenize() -> TokenList

Source: packages/aix/src/aix/lexer/core.py:381

Alias for lex used by tests and callers.

Returns

Type: TokenList