MCPcopy Create free account
hub / github.com/comaps/comaps / NormalizeAndTokenizeString

Function NormalizeAndTokenizeString

libs/indexer/search_string_utils.cpp:284–289  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

282}
283
284std::vector<UniString> NormalizeAndTokenizeString(std::string_view s)
285{
286 std::vector<UniString> tokens;
287 ForEachNormalizedToken(s, base::MakeBackInsertFunctor(tokens));
288 return tokens;
289}
290
291bool TokenizeStringAndCheckIfLastTokenIsPrefix(std::string_view s, std::vector<UniString> & tokens)
292{

Callers 13

operator()Method · 0.85
operator()Method · 0.85
GetSuggestionFunction · 0.85
TokensVectorMethod · 0.85
MatchFeatureByNameAndTypeFunction · 0.85
MatchFeatureByPostcodeFunction · 0.85
GetCategoryTypesFunction · 0.85
IsCategorialRequestFuzzyFunction · 0.85
FillCategoriesFunction · 0.85
UNIT_TESTFunction · 0.85
DocMethod · 0.85
GetScoreFunction · 0.85

Calls 2

ForEachNormalizedTokenFunction · 0.85
MakeBackInsertFunctorFunction · 0.85

Tested by 4

UNIT_TESTFunction · 0.68
DocMethod · 0.68
GetScoreFunction · 0.68
InitParamsMethod · 0.68