Module lexer

Source

Structsยง

Lexer ๐Ÿ”’

Enumsยง

Token

Functionsยง

consume_any ๐Ÿ”’
consume_token ๐Ÿ”’
Return the token at the start of input.
is_blankspace ๐Ÿ”’
Returns whether or not a char is a blankspace (Unicode Pattern_White_Space)
is_comment_end ๐Ÿ”’
Returns whether or not a char is a comment end (Unicode Pattern_White_Space excluding U+0020, U+0009, U+200E and U+200F) https://www.w3.org/TR/WGSL/#line-break
is_word_part ๐Ÿ”’
Returns whether or not a char is a word part (Unicode XID_Continue)
is_word_start ๐Ÿ”’
Returns whether or not a char is a word start (Unicode XID_Start + โ€˜_โ€™)

Type Aliasesยง

TokenSpan ๐Ÿ”’