MCPcopy Create free account
hub / github.com/catboost/catboost / SetMultitoken

Method SetMultitoken

library/cpp/tokenizer/multitokenparser.h:22–24  ·  view source on GitHub ↗

used for deferring tokens in TReqTokenizer

Source from the content-addressed store, hash-verified

20
21 //! used for deferring tokens in TReqTokenizer
22 void SetMultitoken(const TWideToken& tok) {
23 Multitoken = tok;
24 }
25
26 const TWideToken& GetMultitoken() const {
27 return Multitoken;

Callers

nothing calls this directly

Calls 5

CheckMultitokenFunction · 0.85
EndPosMethod · 0.80
emptyMethod · 0.45
backMethod · 0.45
sizeMethod · 0.45

Tested by

no test coverage detected