Utility function to add an accumulator for a parameter Args: block: the block in which the loss tensor is present nam

flush all trainer param to root_scope

Check whether the fetched outputs of the origin program and the optimized program are the same. For inference model, the par

Register a forward post-hook for Layer. The hook will be called after `forward` function has been computed. It should have the foll

This API can be used to get ``default main program`` which store the descriptions of Ops and tensors. For example ``z = paddle.add(x, y)

Insert a sublayer before a given index in the list. Parameters: index (int): index to insert. sublayer (Laye

\brief Returns the name of the class for type traits. \return The name of the class.

Registers a tensor as buffer into the layer. `buffer` is a non-trainable tensor and will not be updated by optimizer, but is

Saves given tensors that backward need. Use ``saved_tensor`` in the `backward` to get the saved tensors. Note: This API

Get the tensors stored by ``save_for_backward``. Returns: list of Tensors or None: If context contains tensors stored by

Generate a unique PDNode's name with name_scope and id. The format is {name_scope}/{repr}/{id}/{name}

barrier all workers in current distributed job

check the dtype is fp16 or the dtype is bf16 :param dtype: instance of core.VarDesc.VarType :return: True if dtype is one of

Create a new and duplicated IrGraph. Warns: The method only clones the graph structure, not its attributes. Ret

:api_attr: Static Graph Get the global/default scope instance. There are a lot of APIs use :code:`global_scope` as its default value, e.

Register a forward pre-hook for Layer. The hook will be called before `forward` function has been computed. It should have the foll

r""" Transform time in ns to time in unit.

Wrap a literal value in a ConstantVariable. Args: value(Any): The literal value to be wrapped. Returns: