MCPcopy Create free account

hub / github.com/baidu/bigflow / functions

Functions5,490 in github.com/baidu/bigflow

↓ 37 callersMethodNewIterator
flume/runtime/common/local_dataset.cpp:355
↓ 37 callersMethodidentity
flume/runtime/common/transfer_encoding_test.cpp:62
↓ 36 callersMethodInitialize
flume/runtime/common/entity_dag.h:205
↓ 36 callersMethodbegin
(self, keys, inputs, emitter)
bigflow_python/python/bigflow/core/example/word_cnt.py:56
↓ 36 callersMethodconfig
flume/core/testing/mock_base.h:62
↓ 36 callersFunctionmap
Transform map implementation :param pvalue: PType :param fn: UDF :param side_inputs: SideInputs :return:
bigflow_python/python/bigflow/transform_impls/map.py:26
↓ 35 callersMethodcount
返回元素的数量,等同于 :func:`bigflow.transforms.count(self) <bigflow.transforms.count>` Returns: PObject: 元素数量
bigflow_python/python/bigflow/pcollection.py:128
↓ 35 callersMethodend
flume/runtime/testing/mock_source.h:46
↓ 35 callersMethodrun
立刻运行Pipeline并等待结束 Raises: BigflowRuntimeException: 若运行期出错抛出此异常
bigflow_python/python/bigflow/pipeline/pipeline_base.py:262
↓ 34 callersMethodGetSource
flume/runtime/common/executor_base.cpp:140
↓ 34 callersMethodbegin_group
flume/runtime/common/executor_impl.cpp:221
↓ 34 callersMethodend_group
flume/runtime/common/shuffle_executor.cpp:83
↓ 34 callersMethodserde
Return the serde of the dataset Returns: LogicalPlan.Node: The serde.
bigflow_python/python/bigflow/ptype.py:115
↓ 34 callersFunctiontuple_set_item
bigflow_python/common/python.cpp:44
↓ 33 callersMethodRequireStream
flume/runtime/common/partial_executor.cpp:53
↓ 33 callersMethodany
flume/util/bitset.h:212
↓ 33 callersMethoddone
(self)
bigflow_python/python/bigflow/core/logical_plan.py:712
↓ 33 callersMethodset_debug_info
(self, debug_info)
bigflow_python/python/bigflow/core/logical_plan.py:168
↓ 33 callersMethodset_identity
flume/planner/unit.cpp:162
↓ 32 callersMethodEmitBinary
flume/runtime/common/single_dispatcher.cpp:294
↓ 32 callersMethod_test_this
tests _test_this: construct test dict
bigflow_python/python/bigflow/test/pobject_test.py:54
↓ 32 callersMethoddumps
bigflow_python/serde/cpickle_serde.cpp:81
↓ 32 callersMethodflatten
对于每个Key和Value中的每个元素(value 1, value 2, ... value m),构造(Key, value 1), (Key, value 2), ... (Key, value m),结果使用PCollection表示 Returns:
bigflow_python/python/bigflow/ptable.py:254
↓ 31 callersMethodDispatchObject
flume/runtime/testing/mock_source.h:142
↓ 31 callersMethodby
(self, loader_obj)
bigflow_python/python/bigflow/core/logical_plan.py:446
↓ 31 callersMethodis_infinite
Infinite/Finite of this node
bigflow_python/python/bigflow/core/logical_plan.py:209
↓ 31 callersMethodloads
bigflow_python/serde/cpickle_serde.cpp:73
↓ 31 callersMethodset
flume/runtime/spark/shuffle_protocol.h:60
↓ 30 callersMethodadd_input
flume/runtime/common/executor_impl_test.cpp:490
↓ 30 callersMethodend
(self)
bigflow_python/python/bigflow/core/example/word_cnt.py:66
↓ 30 callersFunctionlist_of
Return an optional list serde.
bigflow_python/python/bigflow/serde.py:739
↓ 29 callersMethodRegisterPass
flume/planner/pass_manager.h:447
↓ 29 callersMethodfrom_message
(pb_message)
bigflow_python/python/bigflow/core/entity.py:183
↓ 29 callersMethodidentity
flume/planner/unit.cpp:158
↓ 29 callersMethodrequest
Send a request to backend server
bigflow_python/python/bigflow/rpc/service.py:67
↓ 29 callersMethodset_size
Set data size of this node
bigflow_python/python/bigflow/core/logical_plan.py:187
↓ 28 callersMethodEmit
flume/runtime/common/entity_dag.cpp:139
↓ 28 callersMethodShuffle
flume/core/logical_plan.cpp:466
↓ 28 callersMethodset_effective_key_num
(self, number)
bigflow_python/python/bigflow/core/logical_plan.py:608
↓ 27 callersMethodDispatchObjectAndBinary
flume/runtime/testing/mock_source.h:152
↓ 27 callersMethodbegin
flume/runtime/testing/mock_source.h:45
↓ 26 callersMethodinput
(self)
bigflow_python/python/bigflow/util/reiterable_input.py:43
↓ 26 callersMethodsplit
(self, uri, splits)
bigflow_python/python/bigflow/core/tests/test_helper.py:33
↓ 25 callersMethodGetDataset
flume/runtime/common/local_dataset.cpp:167
↓ 25 callersMethodSetObjector
flume/runtime/common/single_dispatcher.cpp:158
↓ 25 callersMethodallow_partial_processing
(self)
bigflow_python/python/bigflow/core/logical_plan.py:541
↓ 25 callersMethodprocess
bigflow_python/processors/pipe_processor.cpp:305
↓ 25 callersMethodsum
将所有元素相加,等同于 :func:`bigflow.transforms.sum(self) <bigflow.transforms.sum>` Returns: PObject: 相加结果
bigflow_python/python/bigflow/pcollection.py:457
↓ 24 callersFunctionAsSources
flume/planner/local/local_planner_test.cpp:227
↓ 24 callersFunctionHideToftPathPassword
flume/util/path_util.cpp:104
↓ 24 callersMethod_assert_belongs_to
(self, node_or_scope, scope)
bigflow_python/python/bigflow/core/tests/logical_plan_test.py:60
↓ 24 callersMethodgenerate_tmp_path
generate a tmp path
bigflow_python/python/bigflow/test/test_base.py:134
↓ 23 callersMethodRequireObject
flume/runtime/testing/mock_listener.h:65
↓ 23 callersMethodadd
bigflow_python/register.cpp:91
↓ 23 callersMethodfinish_group
flume/runtime/common/executor_impl.cpp:233
↓ 23 callersMethodflatten_values
使用Value中的每个元素(value 1, value 2, ... value m),构造PCollection,等价于 ``self.extract_values()`` Returns: PCollection: 包含所有Value的
bigflow_python/python/bigflow/ptable.py:263
↓ 23 callersMethodshuffle
(self, scope, from_nodes)
bigflow_python/python/bigflow/core/logical_plan.py:930
↓ 22 callersMethodLoad
flume/runtime/io/io_format.cpp:325
↓ 22 callersMethodReadLineWithLineEnding
flume/runtime/io/gzip_file.cpp:191
↓ 22 callersMethodRun
flume/planner/common/add_common_executor_pass.cpp:484
↓ 22 callersFunctioncp_byte
bigflow_python/common/barshal_objector.cpp:84
↓ 22 callersMethodgroup_by_key
与 ``group_by`` 变换类似,但使用默认的key/value提取函数对元素分组 Args: **options: 可配置参数 Returns: PTable: 分组结果 >>
bigflow_python/python/bigflow/pcollection.py:252
↓ 22 callersMethodname
flume/runtime/resource.h:69
↓ 22 callersMethodnode_size
flume/core/logical_plan.h:82
↓ 22 callersMethodnone
flume/util/bitset.h:216
↓ 22 callersMethodset_scope_level
flume/runtime/common/shuffle_executor_test.cpp:90
↓ 22 callersMethodsplit
inner
bigflow_python/python/bigflow/test/io_test.py:42
↓ 21 callersMethodRun
flume/runtime/task.cpp:67
↓ 21 callersFunctionToList
flume/runtime/common/local_dataset_test.cpp:61
↓ 21 callersMethodbegin_group
flume/runtime/common/executor_impl_test.cpp:432
↓ 21 callersMethodlength
bigflow_python/common/side_input.cpp:39
↓ 21 callersMethodserialize
bigflow_python/objectors/set_serde.cpp:41
↓ 20 callersFunctionAppendOrdered
bigflow_python/common/comparable.h:40
↓ 20 callersMethodDispatch
flume/runtime/common/entity_dag.cpp:131
↓ 20 callersMethodGetEntry
flume/runtime/resource.cpp:163
↓ 20 callersMethodIsEof
flume/runtime/io/gzip_file.cpp:225
↓ 20 callersMethodStrSerde
bigflow_python/objectors/str_serde.h:41
↓ 20 callersFunctionmake_tuple
将所有输入的PObject合并成一个PObject(tuple)。 除返回值类型及输入类型都全是PObject外, 结果与 :func:`bigflow.transforms.cartesian(self, *pvalues, **
bigflow_python/python/bigflow/transforms.py:1423
↓ 20 callersMethodnested_level
返回该PTable的嵌套层级,即其Value中包含几个PTable Returns: int: 嵌套层级 >>> _pipeline.parallelize({"A": 1}).nested_level()
bigflow_python/python/bigflow/ptable.py:133
↓ 20 callersMethodset_config
(self, config)
bigflow_python/python/bigflow/core/entity.py:348
↓ 20 callersMethodsort
(self)
bigflow_python/python/bigflow/core/logical_plan.py:342
↓ 19 callersMethodDispatchBinary
flume/runtime/testing/mock_source.h:147
↓ 19 callersFunctionEmitTo
flume/runtime/common/local_dataset_test.cpp:51
↓ 19 callersMethodGetDependencyCounts
flume/planner/local/local_planner_test.cpp:103
↓ 19 callersMethodGetValue
flume/runtime/counter.cpp:35
↓ 19 callersMethoditems
(self)
bigflow_python/python/bigflow/pipeline/test/testdata/disjointset.py:46
↓ 19 callersMethodmatch_by
(self, key_reader_obj, key_reader=entity.Entity.key_reader)
bigflow_python/python/bigflow/core/logical_plan.py:724
↓ 19 callersMethodsort_by
(self, key_reader_obj)
bigflow_python/python/bigflow/core/logical_plan.py:266
↓ 19 callersMethodtotal_reserved_bytes
flume/util/arena.h:161
↓ 18 callersMethodDispatchIterator
flume/runtime/common/general_dispatcher.cpp:380
↓ 18 callersFunctionToList
flume/runtime/common/memory_dataset_test.cpp:36
↓ 18 callersMethodfilter
过滤元素,等同于 :func:`bigflow.transforms.filter(self, fn, *side_inputs, **options) <bigflow.transforms.filter>`, Args:
bigflow_python/python/bigflow/pcollection.py:159
↓ 18 callersMethodgroup_by
(self, key_reader_obj)
bigflow_python/python/bigflow/core/logical_plan.py:273
↓ 17 callersFunctionAsSet
flume/planner/testing/plan_test_helper.h:310
↓ 17 callersMethodBeginGroup
flume/runtime/common/executor_base_test.cpp:209
↓ 17 callersMethodFinishGroup
flume/runtime/common/executor_base_test.cpp:213
↓ 17 callersFunctionPbScopeTag
flume/planner/testing/tag_desc.cpp:119
↓ 17 callersMethodReadLine
flume/runtime/io/gzip_file.cpp:163
↓ 17 callersMethod__init__
(self, fn)
bigflow_python/python/bigflow/core/entity.py:239
↓ 17 callersMethod_assert_from
(self, to_node, from_node)
bigflow_python/python/bigflow/core/tests/logical_plan_test.py:63
← previousnext →101–200 of 5,490, ranked by callers