MCPcopy Create free account

hub / github.com/deepspeedai/DeepSpeed / functions

Functions10,922 in github.com/deepspeedai/DeepSpeed

⨍ Functions 10,922◇ Types & classes 1,850↳ Endpoints 34
↓ 3 callersMethodgV_strideM
csrc/deepspeed4science/evoformer_attn/kernel_backward.h:274
↓ 3 callersMethodgen_workspace
(self, num_layers, num_heads, batch_size, prompt_len, hidden_dim, mp_size, external_cache,
deepspeed/ops/transformer/inference/op_binding/workspace.py:37
↓ 3 callersMethodgetGradBuffer
csrc/includes/deepcompile.h:294
↓ 3 callersFunctionget_annotations
Retrieves annotations from a Python object. In python >=3.14 this is a thin wrapper around the `annotationlib.get_annotations` function
deepspeed/compat.py:31
↓ 3 callersFunctionget_attn_mask_stride
infer stride of attention mask memory layout based on the model type.
csrc/transformer/inference/csrc/pt_binding.cpp:41
↓ 3 callersMethodget_axis_comm_lists
Construct lists suitable for a communicator group along axis ``axis``. Example: >>> topo = Topo(axes=['pipe', 'data', 'model'],
deepspeed/runtime/pipe/topology.py:127
↓ 3 callersMethodget_axis_list
Returns the list of global ranks whose coordinate in an axis is idx. For example: >>> X = ProcessTopology(axes=['x', 'y'], dims=[
deepspeed/runtime/pipe/topology.py:193
↓ 3 callersMethodget_buffer
(self)
deepspeed/io/base_io_buffer.py:28
↓ 3 callersFunctionget_ccl_reduce_op
csrc/cpu/comm/ccl.cpp:168
↓ 3 callersMethodget_checkpoint_info
(self, info_key=CHECKPOINT_INFO_KEY)
deepspeed/checkpoint/deepspeed_checkpoint.py:169
↓ 3 callersMethodget_cmd
(self, environment, active_resources)
deepspeed/launcher/multinode_runner.py:150
↓ 3 callersMethodget_compile_backend
(self)
accelerator/hpu_accelerator.py:319
↓ 3 callersMethodget_data_parallel_rank
Which pipeline this rank resides in.
deepspeed/runtime/pipe/topology.py:428
↓ 3 callersFunctionget_deepspeed_model
(model)
tests/unit/model_parallelism/test_configurable_parallel_pp.py:24
↓ 3 callersMethodget_difficulty
(self, global_steps)
deepspeed/runtime/data_pipeline/curriculum_scheduler.py:143
↓ 3 callersFunctionget_file_size
csrc/aio/common/deepspeed_aio_utils.cpp:104
↓ 3 callersMethodget_gas_from_user_config
(self)
deepspeed/autotuning/autotuner.py:983
↓ 3 callersFunctionget_global_norm_of_tensors
Get norm of an iterable of tensors. This is adapted from torch.nn.utils.clip_grad.clip_grad_norm_ and added functionality to handle model par
deepspeed/runtime/utils.py:878
↓ 3 callersFunctionget_gradient_clipping
(param_dict)
deepspeed/runtime/config.py:242
↓ 3 callersMethodget_hp_fragment_address
(self)
deepspeed/utils/tensor_fragment.py:49
↓ 3 callersFunctionget_inactive_params
(param_list)
deepspeed/runtime/utils.py:1104
↓ 3 callersFunctionget_index_by_graph_id
(graph_order, target_graph_id)
deepspeed/compile/util.py:481
↓ 3 callersMethodget_kv_requirements
(self, sequence: DSSequenceDescriptor, max_new_tokens: int, max_new_blocks: int)
deepspeed/inference/v2/model_implementations/exaone4_5/model.py:158
↓ 3 callersFunctionget_label_id_node
(gm: GraphModule)
deepspeed/compile/util.py:568
↓ 3 callersFunctionget_list
(val)
deepspeed/autotuning/utils.py:74
↓ 3 callersMethodget_locks
(size, dev)
deepspeed/ops/sparse_attention/matmul.py:259
↓ 3 callersFunctionget_log_level
(param_dict)
deepspeed/runtime/config.py:652
↓ 3 callersMethodget_lr
(self)
deepspeed/runtime/lr_schedules.py:871
↓ 3 callersMethodget_lr_ratio
(self)
deepspeed/runtime/lr_schedules.py:839
↓ 3 callersFunctionget_mapping_to_flat_buffer
(tensors: List[torch.Tensor])
deepspeed/runtime/zero/utils.py:194
↓ 3 callersMethodget_mask
(self, pruning_type='sparse')
deepspeed/compression/basic_layer.py:528
↓ 3 callersFunctionget_module_duration
(module)
deepspeed/profiling/flops_profiler/profiler.py:1196
↓ 3 callersFunctionget_module_macs
(module)
deepspeed/profiling/flops_profiler/profiler.py:1188
↓ 3 callersFunctionget_no_copy_ops
()
deepspeed/compile/util.py:94
↓ 3 callersMethodget_offset
(self)
deepspeed/io/base_io_buffer.py:31
↓ 3 callersMethodget_param_comm_dtype
(self, param)
deepspeed/runtime/base_optimizer.py:376
↓ 3 callersFunctionget_partition_weights
Return the amount of weight in each partition.
tests/unit/runtime/utils/test_partition.py:91
↓ 3 callersMethodget_pipe_parallel_world_size
The number of stages in the pipeline.
deepspeed/runtime/pipe/topology.py:417
↓ 3 callersFunctionget_position_id_node
(gm: GraphModule)
deepspeed/compile/util.py:576
↓ 3 callersMethodget_prefix
(self)
op_builder/inference_cutlass_builder.py:59
↓ 3 callersMethodget_prefix
(self)
op_builder/ragged_ops.py:60
↓ 3 callersFunctionget_rank
Returns the rank of the current process in the provided ``group`` or the default group if none was provided. Rank is a unique identifier
deepspeed/comm/comm.py:709
↓ 3 callersMethodget_result
Get result from worker process with optional event type validation. Args: expected_event_type (str, optional): Expected
deepspeed/runtime/superoffload/superoffload_utils.py:244
↓ 3 callersFunctionget_runnable_nodes
(scheduled: List[Node], unscheduled: List[Node])
deepspeed/compile/list_schedule.py:81
↓ 3 callersFunctionget_sdpa_nodes
(gm: GraphModule)
deepspeed/compile/util.py:553
↓ 3 callersMethodget_sequence_parallel_group
(self)
deepspeed/runtime/engine.py:1007
↓ 3 callersFunctionget_sized_buffers
(buffer_list, num_elems_list)
deepspeed/runtime/swap_tensor/utils.py:236
↓ 3 callersMethodget_slice_parallel_rank
(self)
deepspeed/runtime/pipe/topology.py:456
↓ 3 callersMethodget_swap_tensors
(self)
deepspeed/runtime/swap_tensor/utils.py:75
↓ 3 callersMethodget_theta
(self)
deepspeed/runtime/progressive_layer_drop.py:32
↓ 3 callersFunctionget_topology
(mp, pp, world_size)
tests/unit/model_parallelism/test_configurable_parallel_pp.py:39
↓ 3 callersMethodget_total_flops
Returns the total flops of the model. Args: as_string (bool, optional): whether to output the flops as string. Defaults to False.
deepspeed/profiling/flops_profiler/profiler.py:232
↓ 3 callersFunctionget_weight_norm
Get norm of an iterable of parameters. This is adapted from torch.nn.utils.clip_grad.clip_grad_norm_ and added functionality to handle model
deepspeed/runtime/utils.py:537
↓ 3 callersFunctiongraph_process
(replay_first_step, func, *args, **kwargs)
deepspeed/runtime/utils.py:92
↓ 3 callersMethodhasGatheredParam
csrc/includes/deepcompile.h:439
↓ 3 callersFunctionhas_inf_or_nan
(x)
tests/unit/runtime/half_precision/test_zero_optim_overflow.py:16
↓ 3 callersFunctionhas_moe_layers
(m: nn.Module)
deepspeed/moe/utils.py:15
↓ 3 callersMethodhas_reduce_scatter_tensor
(self)
deepspeed/comm/torch.py:162
↓ 3 callersFunctionhook
(module, input)
deepspeed/compression/helper.py:290
↓ 3 callersFunctioninit_distributed
Initialize dist backend, potentially performing MPI discovery if needed Arguments: dist_backend: Optional (str). torch distributed backe
deepspeed/comm/comm.py:792
↓ 3 callersMethodinit_process_group
(self)
deepspeed/comm/backend.py:44
↓ 3 callersMethodinit_timers
(self)
deepspeed/runtime/swap_tensor/optimizer_utils.py:213
↓ 3 callersMethodisPersistent
csrc/includes/deepcompile.h:303
↓ 3 callersFunctionis_autocast_initialized
()
deepspeed/runtime/torch_autocast.py:65
↓ 3 callersMethodis_available
(self)
accelerator/cuda_accelerator.py:232
↓ 3 callersFunctionis_compile_supported
()
deepspeed/runtime/compiler.py:32
↓ 3 callersMethodis_data_parallel_writer
(self, dp_rank)
deepspeed/runtime/checkpoint_engine/checkpoint_engine.py:47
↓ 3 callersFunctionis_deepcompile_supported
()
deepspeed/compile/util.py:31
↓ 3 callersMethodis_first_stage
True if the configured ``stage_id`` is the first stage in the pipeline.
deepspeed/runtime/pipe/schedule.py:102
↓ 3 callersFunctionis_functorch_transforming
True when called under torch.func.grad / vmap / jacrev / etc.
deepspeed/utils/torch.py:30
↓ 3 callersMethodis_last_stage
True if the configured ``stage_id`` is the last stage in the pipeline.
deepspeed/runtime/pipe/schedule.py:107
↓ 3 callersMethodis_moe_group
(self, group)
deepspeed/runtime/zero/stage_1_and_2.py:744
↓ 3 callersFunctionis_profile_incomplete
(graph: Graph)
deepspeed/compile/profilers/graph_profile.py:74
↓ 3 callersFunctionis_rocm_pytorch
()
tests/unit/common.py:35
↓ 3 callersMethodis_synchronized_device
(self)
accelerator/supa_accelerator.py:21
↓ 3 callersMethodis_synchronized_device
(self)
accelerator/sdaa_accelerator.py:53
↓ 3 callersMethodis_synchronized_device
(self)
accelerator/cpu_accelerator.py:42
↓ 3 callersMethodis_synchronized_device
(self)
accelerator/mlu_accelerator.py:23
↓ 3 callersMethodis_synchronized_device
(self)
accelerator/npu_accelerator.py:29
↓ 3 callersMethodis_synchronized_device
(self)
accelerator/xpu_accelerator.py:32
↓ 3 callersMethodis_synchronized_device
(self)
accelerator/cuda_accelerator.py:52
↓ 3 callersMethodjit_load
(self, verbose=True)
op_builder/builder.py:545
↓ 3 callersFunctionlayer_norm
(a, weight, bias, eps)
deepspeed/ops/transformer/inference/triton/layer_norm.py:167
↓ 3 callersFunctionlayer_norm_residual
(a, input_bias, residual, weight, bias, eps)
deepspeed/ops/transformer/inference/triton/layer_norm.py:199
↓ 3 callersMethodlazy_initialization
(self, key_states: torch.Tensor, value_states: torch.Tensor)
deepspeed/utils/static_cache.py:54
↓ 3 callersFunctionload
(module, prefix)
deepspeed/module_inject/load_checkpoint.py:46
↓ 3 callersMethodload
csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h:276
↓ 3 callersFunctionload_module_recursive
(module, prefix='', level=0)
deepspeed/module_inject/load_checkpoint.py:222
↓ 3 callersMethodload_moe_state_dict
(checkpoint_path, tag, state_dict,
deepspeed/runtime/engine.py:3813
↓ 3 callersMethodload_with_byte_offset
Loads a fragment from memory
csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h:819
↓ 3 callersMethodloss_scale
(self)
deepspeed/runtime/engine.py:1277
↓ 3 callersMethodmake_attn_layer
Builds the attention layer for the model. This sets the `self.attn` attribute.
deepspeed/inference/v2/model_implementations/inference_transformer_base.py:317
↓ 3 callersMethodmake_attn_out_layer
Instantiates the linear projection layer for the attention output linear layer. This sets the `self.attn_out` attribute.
deepspeed/inference/v2/model_implementations/inference_transformer_base.py:399
↓ 3 callersFunctionmake_graph_from_schedule
(scheduled: List[Node])
deepspeed/compile/list_schedule.py:24
↓ 3 callersFunctionmake_metadata_filename
Make a filename for a metadata file. Arguments: rank: Rank of the file. n_ranks: Total number of ranks. Returns:
deepspeed/inference/v2/model_implementations/flat_model_helpers.py:73
↓ 3 callersMethodmake_qkv_layer
Instantiates the linear projection layer for the QKV linear layer. This sets the `self.qkv` attribute.
deepspeed/inference/v2/model_implementations/inference_transformer_base.py:286
↓ 3 callersMethodmake_unembedding_layer
Performs setup and creates an unembedding layer. This implementation assumes normalization prior to the LM head projection. If this d
deepspeed/inference/v2/model_implementations/inference_transformer_base.py:248
↓ 3 callersFunctionmask_nan_or_inf_with_val_inplace
(input, device=None, val=-1.)
deepspeed/runtime/utils.py:870
↓ 3 callersMethodmax_memory_cached
(self, device_index=None)
accelerator/hpu_accelerator.py:135
↓ 3 callersFunctionmaybe_copy_geglu
(module, sd, weight_quantizer, mp_replace, dst_name, src_names)
deepspeed/module_inject/policy.py:189
← previousnext →1,001–1,100 of 10,922, ranked by callers