MCPcopy Create free account

hub / github.com/baidu/bigflow / functions

Functions5,490 in github.com/baidu/bigflow

↓ 17 callersMethodcogroup
等同于 :func:`bigflow.transforms.cogroup(self, other, *others) <bigflow.transforms.cogroup>`, Args: other (PC
bigflow_python/python/bigflow/pcollection.py:97
↓ 17 callersMethodinput
flume/core/logical_plan.h:467
↓ 17 callersFunctionlist_get_item
bigflow_python/common/python.cpp:51
↓ 17 callersFunctionnew_tuple
bigflow_python/common/python.cpp:67
↓ 17 callersMethodprocessor
flume/runtime/common/entity_dag.cpp:289
↓ 17 callersMethodsave_reduce
Modified to support __transient__ on new objects Change only affects protocol level 2 (which is always used by PiCloud
bigflow_python/python/bigflow/core/serde/cloudpickle.py:595
↓ 17 callersMethodsplit
inner
bigflow_python/python/bigflow/input.py:241
↓ 16 callersMethodAddNormalFileFromBytes
flume/runtime/resource.cpp:198
↓ 16 callersMethodDiscard
flume/runtime/common/local_dataset.cpp:332
↓ 16 callersMethodGetCounter
flume/runtime/counter.cpp:59
↓ 16 callersMethodSink
flume/core/logical_plan.cpp:382
↓ 16 callersMethodglobal_scope
(self)
bigflow_python/python/bigflow/core/logical_plan.py:840
↓ 16 callersMethodis_discard
flume/planner/unit.cpp:122
↓ 16 callersFunctionmap
对PCollection中的每个元素做一对一映射 对给定的PCollection/PObject中的每个元素应用一个变换函数,以函数的返回结果 构造PCollection/PObject 假设输入类型为I,fn的期望签名为 fn(I) => O Arg
bigflow_python/python/bigflow/transforms.py:622
↓ 16 callersMethodnode
Return the internal node it holds. .. note:: End-users are not supposed to use this function. Returns: LogicalPla
bigflow_python/python/bigflow/ptype.py:104
↓ 16 callersMethodremained_buffer_size
flume/util/arena.h:154
↓ 15 callersFunctionPbNodeTag
flume/planner/testing/tag_desc.cpp:311
↓ 15 callersMethodRun
flume/planner/common/promote_partial_units_pass.cpp:276
↓ 15 callersMethodclone
flume/planner/unit.cpp:83
↓ 15 callersMethodcreate
no comments
bigflow_python/python/bigflow/test/test_base.py:202
↓ 15 callersMethodreduce
使用给定的fn将所有元素规约为单个元素, 等同于 :func:`bigflow.transforms.reduce(self, fn, *side_inputs, **options) <bigflow.transforms.redu
bigflow_python/python/bigflow/pcollection.py:365
↓ 15 callersMethodset
flume/planner/unit.h:184
↓ 14 callersFunctionAppendOrdered
flume/util/comparable.h:39
↓ 14 callersFunctionAsKeys
flume/runtime/common/memory_status_table_test.cpp:48
↓ 14 callersMethodBeginGroup
flume/runtime/common/executor_impl_test.cpp:521
↓ 14 callersFunctionExpectIs
flume/planner/common/load_logical_plan_pass_test.cpp:50
↓ 14 callersMethodFinishGroup
flume/runtime/common/executor_impl_test.cpp:525
↓ 14 callersMethodRemoveDependency
flume/planner/plan.cpp:99
↓ 14 callersMethodTupleSerde
bigflow_python/objectors/tuple_serde.h:45
↓ 14 callersMethoddatasets
flume/runtime/common/shuffle_runner.h:252
↓ 14 callersMethodemit
(self, record)
bigflow_python/python/bigflow/rpc/test/backend_parser_test.py:52
↓ 14 callersMethodprocess_with_side_inputs
Convert all SideInputs as prepared nodes in LogicalPlan Returns: LogicalPlan.Node: processed node
bigflow_python/python/bigflow/util/side_input_util.py:70
↓ 14 callersMethodremained_buffer
flume/util/arena.h:147
↓ 14 callersMethodunion
(self, a, b)
bigflow_python/python/bigflow/test/testdata_for_spark/disjointset.py:35
↓ 14 callersMethoduri
flume/core/logical_plan.h:341
↓ 13 callersMethodDebugString
flume/planner/plan.cpp:150
↓ 13 callersMethodRequireIterator
flume/runtime/common/partial_executor.cpp:67
↓ 13 callersMethodSetDatasetManager
flume/runtime/common/single_dispatcher.cpp:154
↓ 13 callersMethodWrite
flume/runtime/common/file_cache_manager.cpp:167
↓ 13 callersMethod__init__
init
bigflow_python/python/bigflow/serde.py:122
↓ 13 callersMethodaccumulate
等同于 :func:`bigflow.transforms.accumulate(self, zero, accumulate_fn, *side_inputs, **options) <bigflow.transforms.accumulate>`
bigflow_python/python/bigflow/pcollection.py:43
↓ 13 callersMethodcartesian
求当前算子与pvalues的笛卡尔积。 等价于 :func:`bigflow.transforms.cartesian(self, *pvalues, **options) <bigflow.transforms.cartesian>`
bigflow_python/python/bigflow/pobject.py:262
↓ 13 callersMethodcheck_sample
inner
bigflow_python/python/bigflow/test/serde_test.py:198
↓ 13 callersMethoddeserialize
bigflow_python/objectors/set_serde.cpp:77
↓ 13 callersMethodoperator[]
flume/planner/testing/plan_desc.cpp:142
↓ 13 callersMethodplan
(self)
bigflow_python/python/bigflow/core/logical_plan.py:162
↓ 12 callersFunctionAsDataNodeSet
flume/planner/common/task_flow_analysis_test.cpp:46
↓ 12 callersFunctionAsNodeSet
flume/planner/common/data_flow_analysis_test.cpp:33
↓ 12 callersMethodDispatchStream
flume/runtime/common/general_dispatcher.cpp:370
↓ 12 callersMethodIsInputDone
flume/runtime/common/shuffle_runner.h:257
↓ 12 callersFunctionPrettyTypeName
flume/util/reflection.h:382
↓ 12 callersMethodRemoveControl
flume/planner/plan.cpp:66
↓ 12 callersMethodReplaceFrom
flume/planner/plan.cpp:189
↓ 12 callersMethodRun
flume/planner/spark/merge_task_pass.cpp:137
↓ 12 callersMethodRun
flume/planner/common/build_common_executor_pass.cpp:137
↓ 12 callersMethodUpdate
flume/runtime/counter.cpp:39
↓ 12 callersMethodWrite
flume/runtime/io/gzip_file.cpp:76
↓ 12 callersMethodadd_file
Add a single file to be packed with the job at runtime. Args: file_path (str): path of file to add resource_pat
bigflow_python/python/bigflow/runtime/python_resource.py:50
↓ 12 callersMethodcurrent_block
flume/util/arena.h:165
↓ 12 callersMethoddone
flume/runtime/common/executor_impl.cpp:253
↓ 12 callersMethodempty
flume/core/entity.h:51
↓ 12 callersMethodfather
(self)
bigflow_python/python/bigflow/core/logical_plan.py:48
↓ 12 callersMethodfind_next
flume/util/bitset.h:348
↓ 12 callersMethodid
得到表示该Pipeline的唯一ID Returns: int: Pipeline ID
bigflow_python/python/bigflow/pipeline/pipeline_base.py:362
↓ 12 callersMethodis_null
flume/planner/common/util.h:70
↓ 12 callersMethodis_prepared
flume/core/logical_plan.h:430
↓ 12 callersMethodis_sorted
flume/core/logical_plan.h:182
↓ 12 callersMethodkey_serdes
返回Key的序列化/反序列化器
bigflow_python/python/bigflow/ptable.py:287
↓ 12 callersFunctionkeys
flume/runtime/common/file_cache_manager_test.cpp:42
↓ 12 callersMethodmax
取最大元素,等同于 :func:`bigflow.transforms.max(self, key) <bigflow.transforms.max>` Args: key (function, optional
bigflow_python/python/bigflow/pcollection.py:280
↓ 12 callersMethodorigin_serde
origin_serde
bigflow_python/python/bigflow/serde.py:126
↓ 12 callersMethodrepeatedly
set load node is infinite
bigflow_python/python/bigflow/core/logical_plan.py:428
↓ 12 callersMethodset_cpu
Set cpu limit for this node
bigflow_python/python/bigflow/core/logical_plan.py:202
↓ 12 callersMethodset_memory
Set memory limit for this node
bigflow_python/python/bigflow/core/logical_plan.py:195
↓ 12 callersMethodset_side_inputs
(self, *side_inputs)
bigflow_python/python/bigflow/core/entity.py:369
↓ 12 callersMethodto_proto_message
(self)
bigflow_python/python/bigflow/core/entity.py:247
↓ 12 callersMethodtransform
等同于 :func:`bigflow.transforms.transform(self, *args, **options) <bigflow.transforms.transform>`
bigflow_python/python/bigflow/pcollection.py:356
↓ 12 callersMethoduser_set
flume/planner/testing/plan_test_helper.h:388
↓ 12 callersMethodwith_concurrency
(self, concurrency)
bigflow_python/python/bigflow/core/logical_plan.py:346
↓ 11 callersMethodProcess
flume/planner/common/cache_util.cpp:127
↓ 11 callersMethodViewAsDirectory
flume/runtime/resource.cpp:321
↓ 11 callersMethod_value
(self)
bigflow_python/python/bigflow/ptable.py:130
↓ 11 callersMethodadd_from
(self, from_vertex)
bigflow_python/python/bigflow/core/tests/test_helper.py:176
↓ 11 callersMethoddone
tricks for enable using expression chain to construct ProcessNode
flume/core/logical_plan.h:589
↓ 11 callersMethodfind_first
flume/util/bitset.h:338
↓ 11 callersMethodis_descendant_of
flume/planner/unit.cpp:107
↓ 11 callersMethodis_partial
flume/core/logical_plan.h:427
↓ 11 callersFunctionis_tuple
bigflow_python/common/python.cpp:124
↓ 11 callersMethodkey
flume/runtime/spark/kv_buffer.cpp:82
↓ 11 callersFunctionkeys
flume/runtime/common/cache_iterator_test.cpp:45
↓ 11 callersMethodload
(self, split, emitter)
bigflow_python/python/bigflow/core/tests/test_helper.py:36
↓ 11 callersFunctionmax
得到输入PCollection中最大的元素 Args: pcollection (PCollection): 输入PCollection key (function, optional): 用于提取key的函数,与Python内置``max()``中的
bigflow_python/python/bigflow/transforms.py:712
↓ 11 callersMethodneed_set
flume/planner/testing/plan_test_helper.h:399
↓ 11 callersFunctionrecord
flume/runtime/common/file_cache_manager_test.cpp:89
↓ 11 callersMethodto_proto_message
(self)
bigflow_python/python/bigflow/core/logical_plan.py:992
↓ 10 callersMethodAllocate
flume/runtime/util/serialize_buffer.h:127
↓ 10 callersMethodAllocateBytes
flume/util/arena.h:169
↓ 10 callersMethodFinishShuffle
flume/runtime/common/shuffle_impl.h:176
↓ 10 callersFunctionListEntries
flume/runtime/common/memory_status_table_test.cpp:122
↓ 10 callersMethodPartitionOf
flume/core/testing/mock_partitioner.h:68
← previousnext →201–300 of 5,490, ranked by callers