API reference
python:arx:arx.lexer.TokenList
class TokenList
TokenList(tokens: list[Token])
Source: packages/arx/src/arx/lexer/core.py:247
Declared as: python:arx:arx.lexer.core.TokenList
Class for handle a List of tokens.
Attributes
-
tokens — Type: list[Token]
-
position — Type: int
-
cur_tok — Type: Token
Methods
-
__init__ — Instantiate a TokenList object.
-
__iter__ — Overload the iterator operation.
-
__next__ — Overload the next method used by the iteration.
-
get_next_token — Provide a simple token buffer.
-
get_token — Get the next token.