Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/google/sentencepiece
/ functions
Functions
367 in github.com/google/sentencepiece
⨍
Functions
367
◇
Types & classes
60
Function
TEST
src/normalizer_test.cc:39
Function
TEST
src/word_model_trainer_test.cc:73
Method
ThreadPool
src/deps/threadpool.h:10
Function
ToNFD
src/builder.cc:89
Method
ToString
src/deps/status.cc:51
Method
Tokenize
src/pretokenizer_for_training_test.cc:29
Method
Train
src/unigram_model_trainer.cc:463
Method
Train
static
src/sentencepiece_trainer.cc:40
Method
Train
src/word_model_trainer.cc:28
Method
Train
src/trainer_interface.h:69
Method
Train
src/char_model_trainer.cc:25
Method
Trainer
src/word_model_trainer.h:31
Method
Trainer
src/char_model_trainer.h:27
Method
Trainer
src/bpe_model_trainer.h:32
Method
Trainer
src/unigram_model_trainer.h:66
Method
TrainerInterface
src/trainer_interface.cc:167
Method
TrainerModel
src/unigram_model_trainer.cc:66
Method
TrainerModel
src/unigram_model_trainer.h:39
Method
UpdateActiveSymbols
src/bpe_model_trainer.cc:145
Function
Utf8ToWide
src/util.cc:193
Function
WideToUtf8
src/util.cc:210
Method
WritableFile
src/filesystem.h:42
Method
code
src/deps/status.cc:49
Function
lexical_cast
src/util.h:82
Function
main
src/spm_export_vocab_main.cc:31
Function
main
src/compile_charsmap_main.cc:158
Function
main
src/spm_encode_main.cc:51
Function
main
src/spm_normalize_main.cc:47
Function
main
src/spm_decode_main.cc:36
Function
main
src/spm_train_main.cc:117
Method
message
src/deps/status.cc:40
Method
operator!=
src/deps/status.cc:38
Method
operator()
src/bpe_model.cc:52
Method
operator()
src/unigram_model.cc:257
Method
operator()
DJB hash function.
src/util.h:72
Method
operator==
src/deps/status.cc:36
Method
operator[]
Returns the element as an array.
src/freelist.h:49
Method
set_error_message
src/deps/status.cc:44
Method
status
src/filesystem.cc:49
Method
status
src/filesystem.cc:87
Method
status
Returns Status. Encode/Decode functions are valid only when status is OK.
src/model_interface.h:64
Method
status
src/pretokenizer_for_training_test.cc:33
Method
status
src/trainer_interface.h:71
Method
~Builder
src/builder.h:39
Method
~FreeList
src/freelist.h:30
Method
~Item
src/util_test.cc:364
Method
~Lattice
src/unigram_model.cc:58
Method
~MockPretokenizer
src/pretokenizer_for_training_test.cc:27
Method
~Model
src/char_model.cc:26
Method
~Model
src/word_model.cc:26
Method
~Model
src/bpe_model.cc:35
Method
~Model
src/unigram_model.cc:499
Method
~ModelInterface
src/model_interface.cc:27
Method
~Normalizer
src/normalizer.cc:46
Method
~PosixReadableFile
src/filesystem.cc:45
Method
~PosixWritableFile
src/filesystem.cc:83
Method
~PretokenizerForTrainingInterface
src/pretokenizer_for_training.h:31
Method
~RandomGeneratorStorage
src/util.cc:141
Method
~ReadableFile
src/filesystem.h:33
Method
~ReservoirSampler
src/util.h:333
Method
~SentencePieceProcessor
src/sentencepiece_processor.cc:51
Method
~SentencePieceTrainer
src/sentencepiece_trainer.h:93
Method
~Status
src/deps/status.cc:8
Method
~ThreadPool
src/deps/threadpool.h:11
Method
~TrainerInterface
src/trainer_interface.cc:174
Method
~TrainerModel
src/unigram_model_trainer.cc:70
Method
~WritableFile
src/filesystem.h:44
← previous
301–367 of 367, ranked by callers