MCPcopy Index your code
hub / github.com/Noumena-Network/code / InferenceClient

Interface InferenceClient

src/services/api/inferenceClient.ts:45–49  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

43 * - `listModels()` async iteration shape
44 */
45export interface InferenceClient {
46 createMessage(...args: InferenceCreateMessageArgs): InferenceCreateMessageResult
47 countTokens(...args: InferenceCountTokensArgs): InferenceCountTokensResult
48 listModels(...args: InferenceListModelsArgs): InferenceListModelsResult
49}
50
51class AnthropicInferenceClient implements InferenceClient {
52 constructor(private readonly anthropic: Anthropic) {}

Callers 14

sideQueryFunction · 0.65
makeTestQueryFunction · 0.65
verifyApiKeyFunction · 0.65
queryModelFunction · 0.65
countTokensMethod · 0.65
refreshModelCapabilitiesFunction · 0.65

Implementers 2

AnthropicInferenceClientsrc/services/api/inferenceClient.ts
OpenAICompatInferenceClientsrc/services/api/openAICompatInference

Calls

no outgoing calls

Tested by

no test coverage detected