Universal sample for evaluation.

A single translation sample with source, reference, and hypothesis.

Specification for a translation prompt.

Result from translation with timing information.

Timing information from client/proxy/worker chain. Request flow: client → proxy → worker → (LLM) → worker → proxy → client

Cache for translation results using DuckDB. Uses thread-local connections for thread safety.

Result from task.run() with optional metadata.

Configuration for translation requests.

Evaluation results for a language pair.

Stats for a single model evaluation.

Data for a single language pair evaluation.

NB! Changes break ABI

Per-service rate tracker (handles PID changes by resetting on restart)

Generic cache for task outputs using DuckDB. Schema: - task: task name (translate, summarize, etc.) - input_hash: hash of inp

Thread-safe synchronous interface for caching attestation verification results Used during SSL verification callback (which is synchronous)

Chapter 7.3 Attestation Table 23. ATTESTATION_REPORT Structure

Command line argument parsing