Read one token using the full preprocessor, with all its behaviors.

Vec3

Consume a token and return true it if matches, otherwise false

Expect an identifier token with the given content, and consume it.

Convenience routine to access the diagnostic sink

Consume one token from an input stream

void Error(int id, const String & msg, const CodePosition & pos) { diagnostics.Add(Diagnostic(msg, id, pos, Severity::Error));

Read one token with macro-expansion enabled.

Peek one token type from an input stream

Consume a token and return true if it matches, otherwise check for end-of-file and expect that token (potentially producing an error) and return true