MCPcopy
hub / github.com/chrislusf/glow / AddOneToAllStep

Method AddOneToAllStep

flow/context.go:80–94  ·  view source on GitHub ↗

the task should run on the source dataset shard input is nil for initial source dataset

(input *Dataset, output *Dataset)

Source from the content-addressed store, hash-verified

78// the task should run on the source dataset shard
79// input is nil for initial source dataset
80func (f *FlowContext) AddOneToAllStep(input *Dataset, output *Dataset) (step *Step) {
81 step = f.NewStep()
82 FromStepToDataset(step, output)
83 FromDatasetToStep(input, step)
84
85 // setup the network
86 task := step.NewTask()
87 if input != nil {
88 FromDatasetShardToTask(input.GetShards()[0], task)
89 }
90 for _, shard := range output.GetShards() {
91 FromTaskToDatasetShard(task, shard)
92 }
93 return
94}
95
96func (f *FlowContext) AddOneToEveryNStep(input *Dataset, n int, output *Dataset) (step *Step) {
97 step = f.NewStep()

Callers 1

SourceMethod · 0.95

Calls 7

NewStepMethod · 0.95
FromStepToDatasetFunction · 0.85
FromDatasetToStepFunction · 0.85
FromDatasetShardToTaskFunction · 0.85
FromTaskToDatasetShardFunction · 0.85
NewTaskMethod · 0.80
GetShardsMethod · 0.80

Tested by

no test coverage detected