method tokenize

tokenize() -> TokenList

Source: packages/aix/src/aix/lexer/core.py:381

Declared as: python:aix:aix.lexer.core.Lexer.tokenize

Alias for lex used by tests and callers.

Returns

Type: TokenList