MCPcopy
hub / github.com/dgraph-io/dgraph / Identifier

Method Identifier

tok/tok.go:73–73  ·  view source on GitHub ↗

Identifier returns the prefix byte for this token type. This should be unique. The range 0x80 to 0xff (inclusive) is reserved for user-provided custom tokenizers.

()

Source from the content-addressed store, hash-verified

71 // unique. The range 0x80 to 0xff (inclusive) is reserved for user-provided
72 // custom tokenizers.
73 Identifier() byte
74
75 // IsSortable returns true if the tokenizer can be used for sorting/ordering.
76 IsSortable() bool

Callers 15

sortWithIndexFunction · 0.95
verifyStringIndexFunction · 0.95
verifyCustomIndexFunction · 0.65
pickTokenizerFunction · 0.65
getInequalityTokensFunction · 0.65
prefixesToDeleteTokensForFunction · 0.65
HasTokenizerMethod · 0.65
TestFullTextTokenizerFunction · 0.65
TestFullTextTokenizerLangFunction · 0.65
TestTermTokenizerFunction · 0.65
TestTrigramTokenizerFunction · 0.65
TestFullTextTokenizerCJKChineseFunction · 0.65

Implementers 15

BigFloatTokenizertok/tok.go
GeoTokenizertok/tok.go
IntTokenizertok/tok.go
FloatTokenizertok/tok.go
YearTokenizertok/tok.go
MonthTokenizertok/tok.go
DayTokenizertok/tok.go
HourTokenizertok/tok.go
TermTokenizertok/tok.go
ExactTokenizertok/tok.go
NGramTokenizertok/tok.go
FullTextTokenizertok/tok.go

Calls

no outgoing calls

Tested by 14

TestFullTextTokenizerFunction · 0.52
TestFullTextTokenizerLangFunction · 0.52
TestTermTokenizerFunction · 0.52
TestTrigramTokenizerFunction · 0.52
TestFullTextTokenizerCJKChineseFunction · 0.52
TestFullTextTokenizerCJKKoreanFunction · 0.52
TestFullTextTokenizerCJKJapaneseFunction · 0.52
TestTermTokenizeCJKChineseFunction · 0.52
TestNGramTokenizerFunction · 0.52
TestNGramTokenizerSingleWordFunction · 0.52
TestNGramTokenizerStopwordsFunction · 0.52
TestNGramTokenizerStemmingFunction · 0.52