MCPcopy Create free account
hub / github.com/denoland/rust-urlpattern / add_token

Method add_token

src/tokenizer.rs:81–96  ·  view source on GitHub ↗
(
    &mut self,
    kind: TokenType,
    next_pos: usize,
    value_pos: usize,
    value_len: usize,
  )

Source from the content-addressed store, hash-verified

79 // Ref: https://wicg.github.io/urlpattern/#add-a-token
80 #[inline]
81 fn add_token(
82 &mut self,
83 kind: TokenType,
84 next_pos: usize,
85 value_pos: usize,
86 value_len: usize,
87 ) {
88 let range = value_pos..(value_pos + value_len);
89 let value = &self.input[range];
90 self.token_list.push(Token {
91 kind,
92 index: self.index,
93 value,
94 });
95 self.index = next_pos;
96 }
97
98 // Ref: https://wicg.github.io/urlpattern/#process-a-tokenizing-error
99 fn process_tokenizing_error(

Callers 2

tokenizeFunction · 0.80

Calls

no outgoing calls

Tested by

no test coverage detected