MCPcopy
hub / github.com/dgraph-io/dgraph / encodeToken

Function encodeToken

tok/tok.go:696–698  ·  view source on GitHub ↗
(tok string, typ byte)

Source from the content-addressed store, hash-verified

694}
695
696func encodeToken(tok string, typ byte) string {
697 return string(typ) + tok
698}
699
700// EncodeGeoTokens encodes the given list of tokens as geo tokens.
701func EncodeGeoTokens(tokens []string) {

Callers 15

TestFullTextTokenizerFunction · 0.85
TestFullTextTokenizerLangFunction · 0.85
TestTermTokenizerFunction · 0.85
TestTrigramTokenizerFunction · 0.85
TestFullTextTokenizerCJKChineseFunction · 0.85
TestFullTextTokenizerCJKKoreanFunction · 0.85
TestFullTextTokenizerCJKJapaneseFunction · 0.85
TestTermTokenizeCJKChineseFunction · 0.85
TestNGramTokenizerFunction · 0.85
TestNGramTokenizerSingleWordFunction · 0.85
TestNGramTokenizerStopwordsFunction · 0.85
TestNGramTokenizerStemmingFunction · 0.85

Calls

no outgoing calls

Tested by 14

TestFullTextTokenizerFunction · 0.68
TestFullTextTokenizerLangFunction · 0.68
TestTermTokenizerFunction · 0.68
TestTrigramTokenizerFunction · 0.68
TestFullTextTokenizerCJKChineseFunction · 0.68
TestFullTextTokenizerCJKKoreanFunction · 0.68
TestFullTextTokenizerCJKJapaneseFunction · 0.68
TestTermTokenizeCJKChineseFunction · 0.68
TestNGramTokenizerFunction · 0.68
TestNGramTokenizerSingleWordFunction · 0.68
TestNGramTokenizerStopwordsFunction · 0.68
TestNGramTokenizerStemmingFunction · 0.68