Same as Surface.Lexer.token_list_language_agnostic, but with tokens specialized to English.

Main lexing function used in code blocks

Main lexing function used outside code blocks

Entry point of the lexer, distributes to lex_code_en or lex_law_en depending of Surface.Lexer.is_code.