Method new

core/src/lexer.rs:257–259

Creates a new `TokenSpan` from its parts.

(token: Token, pos: LineCol, length: usize)

impl TokenSpan {
    /// Creates a new `TokenSpan` from its parts.
    fn new(token: Token, pos: LineCol, length: usize) -> Self {
        Self { token, pos, length }
    }
}

/// Tokenizer that breaks an input stream into a sequence of language tokens.