update the average flops for forwarding each data sample, \ for most models and tasks, \ the averaging is not needed as the i

Track the number of bytes downloaded.

The handler for time up: modify the currency timestamp \ and check the trigger condition

Calculates the weighted average of models.

calculate the message bytes to be sent/received :return: tuple of bytes of the message to be sent and received

Instantiate a DataLoader via config. Args: dataset: dataset from which to load the data. config: configs containing batch_si

:return: model_parameters (dict): {model_name: model_val}

This function builds an instance of trainer. Arguments: model: model used in FL course data: data used in FL course

Parse yaml format configuration to generate search space Arguments: config_path (str): the path of the yaml file. Return:

Load object from Redis via pickle.

Run the hooks_set and maintain the mode Arguments: mode: running mode of client, chosen from train/val/test Note:

Save object to Redis via pickle.

Prepare the initial configurations based on the search space.

Set up the client

Set up the server

check the validness of the configuration instance Args: check_cfg: whether enable checks

Filters out the common keys of kwarg that are not in kwarg. Args: func: function to be filtered kwarg: dict to filter R

This function builds an instance of scheduler. Args: optimizer: optimizer to be scheduled type: type of scheduler **

Load a cfg. Args: cfg_file_obj_or_str (str or file): Supports loading from: - A file obje

Lower text and remove punctuation, articles and extra whitespace.

To optimize the hyperparameters, that is, executing the HPO algorithm and then returning the results.

print help info for a specific given ``arg_name`` or \ for all arguments if not given ``arg_name`` Args: arg_nam

To bind a message type with a handling function. Arguments: msg_type (str): The defined message type callbac

To Save the best evaluation results.

r""" Save data to disk. Source: \ https://github.com/omarfoq/FedEM/blob/main/data/femnist/generate_data.py Args: train_data: x of

Perform symmetric uniform dequantization Args: state_dict: dict of model parameter (torch_model.state_dict) Returns: The

Perform symmetric uniform quantization to weight in conv & fc layers Args: state_dict: dict of model parameter (torch_model.state_dic

To terminate the FL course

A functions to trim repeated rows that may appear when optimizing. This is necessary to avoid the sklearn GP object from breaking :param

Check the validity of the user (whether in black list, etc).

The behaviors of server when receiving enough evaluating results

Perform federated aggregation and update the global model

The behaviors for starting a new training round

Arguments: last_model (dict): the state of last round. local_updated_models (list): each element is (data_size, model

To check the message_buffer. When enough messages are receiving, some events (such as perform aggregation, evaluation, and move to

To check whether all the clients have joined in the FL course.

Arguments: config (dict): key is cfg node name, value is the specified value. Returns: results (list): cmd args

r"""Get sample index list for each client from the Dirichlet distribution. https://github.com/FedML-AI/FedML/blob/master/fedml_core/non_iid pa

Args: cfg: fs cfg config: sampled trial CS.Configuration budget: budget round for this trial client_cfgs: client-