Return the correct single answer grading judge.

Initialize session and return the search results page

Creates a log file and logging object for the corresponding session ID

Resize tokenizer and embedding. Note: This is the unoptimized version that may make your embedding size not be divisible by 64.

Takes an action, updates WebShop environment, and returns (observation, reward, done, info) Arguments: action (`str`): An ac

Run a PPO optimisation step given a list of queries, model responses, and rewards. Args: queries (List[`torch.LongTensor

Train one PPO minibatch Args: logprobs (`torch.FloatTensor`): Log probabilities of the model, shape [bat

Constructor for simulated server serving WebShop application Arguments: filter_goals (`func`) -- Select specific goa

Add speaker and start/end signal on each round.

Check if the input data is valid for training. Args: batch_size (int): Batch size from the config file.

Calculate loss for each sample in the dataset and save turn_values Args: model: Loaded model dataset: Dataset de

graph: 表示的是environment state program: 表示的是动作执行的文本 id: 表示的是agent的id specific_objects: 表示的是交互过的物体以及对应的id last_obj_id: 表示的是上一

Concatenate the chosen and rejected inputs into a single tensor. Args: batch: A batch of data. Must contain the keys 'chosen_inpu

Strip HTML of tags and add separators to convert observation into simple mode

Creates and saves a model card for a TRL model. Args: path (`str`): The path to save the model card to. model_name (`

Simulate group-wise dequantization.

Render and return HTML for done page

Compute the DPO loss for a batch of policy and reference model log probabilities. Args: policy_chosen_logps: Log probabilities of

Generates a redeem code corresponding to the session ID for an MTurk worker once the session is completed