MCPcopy Create free account
hub / github.com/catboost/catboost / SwapSubtokens

Method SwapSubtokens

library/cpp/tokenizer/nlpparserbase.h:80–82  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

78 NlpType = NLP_WORD;
79 }
80 void SwapSubtokens(TTokenStructure& other) {
81 Subtokens.swap(other);
82 }
83 // returns length of all subtokens including prefix of the first subtoken and suffix of the last subtoken
84 size_t CorrectPositions() {
85 Y_ASSERT(!Subtokens.empty());

Callers 1

MakeMultitokenEntryMethod · 0.80

Calls 1

swapMethod · 0.45

Tested by

no test coverage detected