MCPcopy Create free account
hub / github.com/atomicdotdev/atomic / new

Method new

atomic-core/src/record/workflow/crdt/tokenize/mod.rs:50–55  ·  view source on GitHub ↗

Creates a new tokenizer with default options.

(content: &'a [u8])

Source from the content-addressed store, hash-verified

48impl<'a> ContentTokenizer<'a> {
49 /// Creates a new tokenizer with default options.
50 pub fn new(content: &'a [u8]) -> Self {
51 Self {
52 content,
53 options: TokenizeOptions::default(),
54 }
55 }
56
57 /// Creates a new tokenizer with the given options.
58 pub fn with_options(content: &'a [u8], options: TokenizeOptions) -> Self {

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected