Method encode

core/llm/asyncEncoder.ts:6–6 · view source on GitHub ↗

(text: string)

Source from the content-addressed store, hash-verified

4
5	export interface AsyncEncoder {
6	encode(text: string): Promise<number[]>;
7	decode(tokens: number[]): Promise<string>;
8	close(): Promise<void>;
9	}

startFunction · 0.65

encodeMethod · 0.65

countTokensAsyncFunction · 0.65

countTokensFunction · 0.65

countFunction · 0.65

pruneStringFromBottomFunction · 0.65

pruneStringFromTopFunction · 0.65

mapCharactersToTokenIdsMethod · 0.65

decodeMethod · 0.65

testCaseMethod · 0.65

asyncEncoder.test.tsFile · 0.65

LlamaAsyncEncodercore/llm/asyncEncoder.ts

GPTAsyncEncodercore/llm/asyncEncoder.ts

NonWorkerAsyncEncodercore/llm/countTokens.ts

no outgoing calls

no test coverage detected