Applies a monkey patch to the forward method of a given model class to enable Ulysses sequence parallelism input slicing.

Applies a monkey patch to the forward method of a given model class to enable Ulysses sequence parallelism input slicing.

Process validation metrics into a structured format with statistical analysis. This function organizes validation metrics by data source

Remove the LaTeX boxed command from a string. Args: s: String with format "\\boxed{content}" Returns: The content inside the

Rotates half the hidden dims of the input.

Rotates half the hidden dims of the input.

Rotates half the hidden dims of the input.

Rotates half the hidden dims of the input.

Set ulysses sequence parallel process group.

Update the module config with the override_config_kwargs. Args: module_config: The module config from Huggingface Transformers. ov

Binds worker methods to the WorkerGroup based on registered attributes. Args: user_defined_cls (type): The class containing metho

Binds worker methods to the WorkerGroup based on registered attributes. Args: user_defined_cls (type): The class containing metho

broadcast tensor in tp shards across mp_group

broadcast tensor in tp shards across mp_group

broadcast tensor in tp shards across mp_group

broadcast tensor in tp shards across mp_group

broadcast tensor in tp shards across mp_group

broadcast tensor in tp shards across mp_group

Execute a method on a single worker remotely. Args: worker: The worker actor handle method_name: Name of the method t

Execute a method on a single worker remotely. Args: worker: The worker actor handle method_name: Name of the method t

fetch tensor in tp shards

fetch tensor in tp shards

fetch tensor in tp shards

fetch tensor in tp shards

Get current memory usage.

Get current memory usage.

TODO: optimize this. Technically, we only need one broadcast

TODO: optimize this. Technically, we only need one broadcast

Build the memory buffer given weight_buffer_meta Args: weight_buffer_meta: contains mapping from name to a dictionary containing shape an

Build the memory buffer given weight_buffer_meta Args: weight_buffer_meta: contains mapping from name to a dictionary containing shape an

for cuda memory alignment, make sure alignment by 128-bits

for cuda memory alignment, make sure alignment by 128-bits

Compute reward for a batch of data. Args: data: DataProto object containing the input data. reward_fn: Reward function to com

Compute reward for a batch of data. Args: data: DataProto object containing the input data. reward_fn: Reward function to com