Returns the username and command utterance.

Creates or loads a chroma database

Creates or loads a FAISS index

Insert smaller image into larger canvas

Polls the registered conditions and runs the associated code. Intended to be run in subprocess. Communicates with the main process using conn

Runs the baseline with the provided command

Runs the llm with the provided command

Runs the agent with the provided command

Find indices of all occurrences of short_string in long_string.

convert a function handle to string and append it to code_define program string

Retrieve all logs for a given test.

Run on agent action.

Run on agent end.

Print out that we finished a chain.

Print out that we are entering a chain.

Check if the polling function has found anything.

Loads config from yaml file

Add the desired testcases to the test register

Run the LLM on the given prompt and input.

Run the LLM on the given prompt and input.

Run the LLM on the given prompt and input.

Run condition server in an asyncio loop.

Save an object to disk as a yaml file

save raw LLM response

save final results in a csv file