Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/ArchieGertsman/spark-sched-sim
/ functions
Functions
248 in github.com/ArchieGertsman/spark-sched-sim
⨍
Functions
248
◇
Types & classes
41
Method
completed
(self)
spark_sched_sim/components/stage.py:38
Method
completed
(self)
spark_sched_sim/components/job.py:50
Function
decima_example
()
examples.py:64
Method
durations
(key)
spark_sched_sim/data_samplers/tpch.py:163
Function
evaluate
scores: scores that the model assigned to each action at each step counts: count of available actions at each step selections: actions th
schedulers/decima/utils.py:26
Method
evaluate_actions
( self, obsns: Iterable[dict], actions: Iterable[tuple] )
schedulers/decima/scheduler.py:101
Function
fair_example
()
examples.py:49
Method
forward
Returns: a dict of representations at three different levels: node, dag, and global.
schedulers/decima/scheduler.py:152
Method
forward
returns a tensor of shape [num_nodes, embed_dim]
schedulers/decima/scheduler.py:191
Method
forward
returns a tensor of shape [num_dags, embed_dim]
schedulers/decima/scheduler.py:252
Method
forward
returns a tensor of shape [num_observations, embed_dim]
schedulers/decima/scheduler.py:265
Method
forward
returns a tensor of shape [num_nodes,]
schedulers/decima/scheduler.py:293
Method
forward
( self, dag_batch: pyg.data.Batch, h_dict: dict[str, Tensor], job_indices: Tensor )
schedulers/decima/scheduler.py:338
Method
get_children_stages
(self, stage: Stage)
spark_sched_sim/components/job.py:75
Method
info
(self)
spark_sched_sim/spark_sched_sim.py:240
Method
is_idle
(self)
spark_sched_sim/components/executor.py:28
Function
job_duration_percentiles
(env)
spark_sched_sim/metrics.py:21
Method
job_pool_key
(self)
spark_sched_sim/components/stage.py:34
Method
job_sequence
(self, max_time: float)
spark_sched_sim/data_samplers/data_sampler.py:16
Function
make_adj
returns a sparse COO adjacency matrix
schedulers/decima/utils.py:67
Function
make_dag_layer_edge_masks
returns a batch of edge masks of shape (msg passing depth, num edges), where the i'th mask indicates which edges participate in the i'th root-to-l
schedulers/decima/utils.py:238
Function
make_mlp
( input_dim: int, hid_dims: list[int], output_dim: int, act_cls: str, act_kwargs: dict[str
schedulers/decima/utils.py:45
Method
next_task_id
(self)
spark_sched_sim/components/stage.py:46
Method
num_active_jobs
(self)
spark_sched_sim/spark_sched_sim.py:236
Method
num_active_stages
(self)
spark_sched_sim/components/job.py:62
Method
num_completed_jobs
(self)
spark_sched_sim/spark_sched_sim.py:232
Method
num_saturated_tasks
(self)
spark_sched_sim/components/stage.py:42
Method
num_stages
(self)
spark_sched_sim/components/job.py:58
Function
obs_to_pyg
converts an env observation into a PyG `Batch` object
schedulers/decima/utils.py:88
Method
observation
(self, obs: dict[str, Any])
schedulers/decima/env_wrapper.py:69
Method
pool_key
(self)
spark_sched_sim/components/stage.py:30
Method
pool_key
(self)
spark_sched_sim/components/job.py:46
Method
reset
( self, seed: int | None = None, options: dict[str, Any] | None = None )
spark_sched_sim/spark_sched_sim.py:127
Method
reset
(self)
spark_sched_sim/components/executor_tracker.py:32
Method
reset
samples a new time limit prior to resetting
spark_sched_sim/wrappers/stochastic_time_limit.py:13
Method
reset
(self, np_random: np.random.Generator)
spark_sched_sim/data_samplers/data_sampler.py:12
Method
reset
(self, np_random: np.random.Generator)
spark_sched_sim/data_samplers/tpch.py:51
Function
sample
(logits: Tensor)
schedulers/decima/utils.py:19
Method
saturated
(self)
spark_sched_sim/components/job.py:54
Method
schedule
(self, obs: dict)
schedulers/heuristics/round_robin.py:14
Method
schedule
(self, obs: dict)
schedulers/heuristics/random_scheduler.py:16
Method
schedule
(self, obs: dict)
schedulers/decima/scheduler.py:72
Method
step
modifies `truncated` signal when time limit is reached
spark_sched_sim/wrappers/stochastic_time_limit.py:26
Method
task_duration
( self, job: Job, stage: Stage, task: Task, executor: Executor )
spark_sched_sim/data_samplers/data_sampler.py:20
Function
test_train
()
test/test_train.py:5
Method
train_on_rollouts
(self, rollout_buffers)
trainers/vpg.py:19
Method
train_on_rollouts
(self, rollout_buffers)
trainers/ppo.py:51
Method
window
lazy-init the window
spark_sched_sim/components/renderer.py:34
← previous
201–248 of 248, ranked by callers