MCPcopy Create free account
hub / github.com/atomicdotdev/atomic / default

Method default

atomic-core/src/diff/token/config.rs:65–73  ·  view source on GitHub ↗

Returns the default configuration with all features enabled. This is equivalent to `TokenizerConfig::code()` and provides full code-aware tokenization suitable for most programming languages.

()

Source from the content-addressed store, hash-verified

63 /// This is equivalent to `TokenizerConfig::code()` and provides
64 /// full code-aware tokenization suitable for most programming languages.
65 fn default() -> Self {
66 Self {
67 merge_whitespace: true,
68 recognize_operators: true,
69 recognize_strings: true,
70 recognize_numbers: true,
71 recognize_comments: true,
72 }
73 }
74}
75
76impl TokenizerConfig {

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected