Scanner state: reads a stream into a sequence of typed tokens. More...
#include <scanner.h>
Data Fields | |
| sys_iostream_t * | stream |
| source (private) | |
| sys_scanner_flags_t | flags |
| flags given to init() (private) | |
| ptrdiff_t | start |
| absolute stream position where the current More... | |
| size_t | bytes |
| length of the current token, in bytes | |
| size_t | runes |
| number of runes in the current token | |
| sys_scanner_class_t | isa |
| classification of the current token | |
Scanner state: reads a stream into a sequence of typed tokens.
Records only where the current token starts and how long it is - it never allocates or limits a token's length itself (whether that holds for the stream as a whole depends on its backend). Use sys_scanner_token() to read its actual text.
| ptrdiff_t sys_scanner_t::start |