MCPcopy Create free account
hub / github.com/catboost/catboost / FilterNumbers

Function FilterNumbers

library/cpp/text_processing/tokenizer/tokenizer.cpp:212–221  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

210
211template <typename StringType>
212static void FilterNumbers(TVector<StringType>* tokens) {
213 TVector<StringType> filteredTokens;
214 filteredTokens.reserve(tokens->size());
215 for (auto& token : *tokens) {
216 if (!IsNumber(token)) {
217 filteredTokens.emplace_back(token);
218 }
219 }
220 tokens->swap(filteredTokens);
221}
222
223static void SplitByDelimiter(
224 TStringBuf inputString,

Callers 2

SplitByDelimiterFunction · 0.85
TokenizeWithoutCopyMethod · 0.85

Calls 5

IsNumberFunction · 0.50
reserveMethod · 0.45
sizeMethod · 0.45
emplace_backMethod · 0.45
swapMethod · 0.45

Tested by

no test coverage detected