method lex

lex() -> TokenList

Source: packages/arx/src/arx/lexer/core.py:713

Declared as: python:arx:arx.lexer.core.Lexer.lex

Create a list of tokens from input source.

Returns

Type: TokenList