Clone the necessary subset of the repo into a temporary workspace.

Preprocess the data by tokenizing.

Process a single JSONL entry.

Write sample_src to temp file (sample.c), run generator -> sample.cstr, run solver -> sample.h, read header, return header text.

Replace the exact reference_function text with inferred_function. Returns the updated source and a boolean indicating if replacement happene

Generate filesystem-safe case identifier.

Save model checkpoint, optimizer, LR scheduler and intermedidate running states.

Save as JSON format

Copy the workspace benchmark directory into the case directory.

Generates sequences of token ids using the specified model and generation parameters. Adapted from https://huggingface.co/THUDM/chatglm3-6b/b

Compute Jaccard similarity over identifier patterns (func*, type*, var*, field*) between candidate and ground truth code. Returns:

Persist reusable artifacts for a case.

Write JSON and Markdown summary reports.

Args: instances (`Sequence[Dict[str, List[int]]]`): Mini-batch samples, each sample is stored in an individual d

Decoder attetion mask

Re-define LLaMA-2 `LlamaAttention` forward method using flash-attention.

Compute reward based on identifier naming similarity using Qwen3 embeddings. Returns score^2 to sharpen the reward signal.

Compute reward based on identifier naming similarity using GTE embeddings. Returns score^2 to sharpen the reward signal.

Ignore helper to skip evaluation artifacts when copying benchmark dirs.

Implements the NEFTune forward pass for the model using forward hooks. Note this works only for torch.nn.Embedding layers. This method is sli

Write sample_src to temp file (sample.c), run generator -> sample.cstr, run solver -> sample.h, read header, return header text.

Formard function for RMS Norm

Streaming chat responses generation with a given model and tokenizer. Args: model (Any): The language model to generate responses.