method lex

lex() -> TokenList

Source: packages/aix/src/aix/lexer/core.py:370

Declared as: python:aix:aix.lexer.core.Lexer.lex

Tokenize configured source and return a token stream.

Returns

Type: TokenList