Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/ceifa/tiktoken-node
/ functions
Functions
6 in github.com/ceifa/tiktoken-node
⨍
Functions
6
◇
Types & classes
3
↓ 1 callers
Method
decode
(&self, tokens: Vec<u32>)
src/lib.rs:22
↓ 1 callers
Method
encode
(&self, text: String)
src/lib.rs:13
Method
encode_batch
(&self, texts: Vec<String>)
src/lib.rs:33
Function
encoding_for_model
(model_name: String)
src/lib.rs:68
Function
get_encoding
( #[napi(ts_arg_type = "'gpt2' | 'r50k_base' | 'p50k_base' | 'p50k_edit' | 'cl100k_base'")] encoding:
src/lib.rs:48
Function
main
()
build.rs:3