Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/0hq/WebGPT
/ constructor
Method
constructor
tokenizer.js:26–28 ·
view source on GitHub ↗
()
Source
from the content-addressed store, hash-verified
24
25
class
SimpleTokenizer extends Tokenizer {
26
constructor() {
27
super();
28
}
29
30
async
load() {
31
console.log(
"Loading simple tokenizer..."
);
Callers
nothing calls this directly
Calls
no outgoing calls
Tested by
no test coverage detected