Prefix a unique nonce so every measured run is a true cache miss.

Prefix a unique nonce so every measured run is a true cache miss.

Prefix a unique nonce so every measured run is a true cache miss.

Return the current wall-clock instant as an aware UTC ``datetime``. This is the **single source of CLI timestamps** for the whole package. Ev

Single Ollama /api/chat call with keep_alive=-1. Always returns the same metrics dict shape as MLXRunner.generate(), so the same `run_warm_is

Single Ollama /api/chat call with keep_alive=-1. Always returns the same metrics dict shape as MLXRunner.generate(), so the same `run_warm_is

Boot MLX runner, send one prompt, shut down. Returns metrics.

Single Ollama /api/chat call, returns metrics.

Invoke Pi in non-interactive JSON mode, parse agent_end event.

Invoke Pi in non-interactive JSON mode, parse agent_end event.

Return a slightly jittered speed so each mock run looks fresh.

Create a fresh temp dir with any required fixtures copied in.

Create a fresh temp dir with any required fixtures copied in.

Create a new queue subscribed to events for ``session_id``.

Collapse whitespace and truncate for display.

Remove a previously-subscribed queue. Safe to call repeatedly.

Quick Pi call to ensure model/provider are valid and the model is loaded.

Quick Pi call to ensure model/provider are valid and the model is loaded.

Backward compat: bare strings are coerced to default-chart CompletionRefs. The original CLI shipped ``complete_groups: ["alpha", "bravo"]``.

Read lines off ``stream`` and push (stamped_point_or_control, ts) tuples. The reader stamps ``client_ts`` the moment it pops a line so the time

* Apply a single live datapoint with the §14.4 newer-wins guard. * * Comparison is direct string comparison on the ISO-8601 timestamps — bot

* Apply metadata for a (chart, group) pair. Merges into existing — * the backend already performs the deep merge, so we just replace.

* Wipe all live values but keep the dataset list. Each dataset's status * is reset to `pending`; this is what the user sees after a `reset`

* Replace all session state from a fresh /stream snapshot. The backend * delivers `points` already as latest-per-cell ordered by `client_ts`,

Reset everything — used by BenchmarkPage on unmount before reconnect.

Clear flash signal for a chart (called by BenchmarkCard after animation).

Return a FastAPI TestClient bound to an isolated DB + broker. We monkeypatch ``LIVEBENCH_DB_PATH`` so the lifespan opens the temp DB, then po

Mark one or more groups as complete for a session.

Open a sqlite3 connection in WAL mode with foreign keys enabled. ``check_same_thread=False`` so the FastAPI event loop and uvicorn worker thr

Return one ``DatasetState`` per ``(chart, group)`` pair defined in the config. Status derivation (spec §4.1, chart-aware): - ``complete``

Emit one or many datapoints to a session.

Return all metadata for a session as ``{"chart_id:group_key": data_dict, ...}``.

Accept a batch of datapoints and/or group completions for a session.

Insert a batch of datapoints and return their stored forms. Assigns ``seq`` monotonically as ``current_max + 1, +2, +3, ...`` inside a single

Return the newest-by-``client_ts`` datapoint for each (chart, group, metric) cell. Uses the ``ix_datapoints_cell_client_ts`` index. Cells with no

List all benchmarks registered with the server.

Return one summary dict per benchmark for ``GET /benchmarks``. Each dict carries surface fields (``session_id``, ``title``, ``subtitle``, ``b

Start a real Uvicorn server in a daemon thread; seed a sample session.

Load every ``*.yaml`` file in ``path``. Returns a list of ``(benchmark_file, source_path)`` tuples, sorted by file name for deterministic ord

UPSERT completion rows; return ``(CompletionRef, completed_at)`` per ref. Uses a single server timestamp for the whole batch so all completions

Return the current max ``seq`` for a session, or 0 if empty.

Emit metadata for a (chart, group) pair.

Run the spec §4.1 migration. Idempotent — safe to call on every boot.

Patch ``LiveBenchClient`` everywhere the commands import it.

Broadcast a ping event to all active SSE subscribers.

Ping the backend and broadcast to all connected frontends.

Return all datapoints for a session with ``seq > last_seq``, in seq order. Used by the SSE stream to replay missed events after a ``Last-Event-ID

Delete all datapoints + completions for a session; bump ``updated_at``. The ``benchmarks`` row itself is preserved — config is owned by YAML.

Reset a benchmark session (wipes points + datasets).

Show config + latest-per-cell values + per-group status for a session.

SSE endpoint for a single session.

Read JSONL from stdin and POST batches to /ingest until EOF.