MCPcopy Create free account

hub / github.com/NLPOptimize/flash-tokenizer / functions

Functions146 in github.com/NLPOptimize/flash-tokenizer

Methodoperator()
include/robin_hood.h:783
Methodoperator()
include/robin_hood.h:791
Methodoperator()
include/robin_hood.h:798
Methodoperator()
include/robin_hood.h:805
Methodoperator()
include/robin_hood.h:812
Methodoperator()
include/robin_hood.h:1150
Methodoperator()
include/robin_hood.h:1160
Methodoperator()
include/bert_tokenizer.h:527
Methodoperator*
include/robin_hood.h:1284
Methodoperator++
include/robin_hood.h:1278
Methodoperator->
include/robin_hood.h:979
Methodoperator->
include/robin_hood.h:1061
Methodoperator->
include/robin_hood.h:1288
Functionoperator<
include/robin_hood.h:674
Methodoperator<
include/bert_tokenizer.h:315
Functionoperator<=
include/robin_hood.h:684
Functionoperator==
include/robin_hood.h:666
Methodoperator==
include/robin_hood.h:1293
Methodoperator==
Checks if both tables contain the same entries. Order is irrelevant.
include/robin_hood.h:1709
Functionoperator>
include/robin_hood.h:680
Functionoperator>=
include/robin_hood.h:688
Methodoperator[]
include/robin_hood.h:1729
Methodpair
include/robin_hood.h:589
MethodperformAllocation
include/robin_hood.h:506
Methodrehash
reserves space for the specified number of elements. Makes sure the old data fits. exactly the same as reserve(c).
include/robin_hood.h:2072
MethodrehashPowerOfTwo
reserves space for at least the specified number of elements. only works if numBuckets if power of two True on success, false otherwise
include/robin_hood.h:2216
Functionreinterpret_cast_no_cast_align_warning
include/robin_hood.h:322
Methodreset
Deallocates all allocated memory.
include/robin_hood.h:404
Functionrotr
include/robin_hood.h:314
MethodshiftDown
include/robin_hood.h:1396
MethodshiftUp
Shift everything up by one element. Tries to move stuff around.
include/robin_hood.h:1376
Methodsize
include/robin_hood.h:245
Methodstring tokenize_chinese_chars
include/bert_tokenizer.h:344
Methodswap
include/robin_hood.h:451
Methodswap
include/robin_hood.h:1029
Methodswap
include/robin_hood.h:1112
Methodswap
Swaps everything between the two maps.
include/robin_hood.h:1675
MethodthrowOverflowError
include/robin_hood.h:2251
Methodtokenize
include/bert_tokenizer.h:446
Methodtry_emplace
include/robin_hood.h:1830
Methodtry_emplace_impl
include/robin_hood.h:2260
Methodtry_increase_info
include/robin_hood.h:2399
Functionunaligned_load
include/robin_hood.h:355
Methodvector<int> convert_by_vocab
include/bert_tokenizer.h:112
Method~BulkPoolAllocator
include/robin_hood.h:399
Method~Table
Destroys the map and all it's contents.
include/robin_hood.h:1703
← previous101–146 of 146, ranked by callers