Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/baidu/bigflow
/ functions
Functions
5,490 in github.com/baidu/bigflow
⨍
Functions
5,490
◇
Types & classes
1,763
↓ 37 callers
Method
NewIterator
flume/runtime/common/local_dataset.cpp:355
↓ 37 callers
Method
identity
flume/runtime/common/transfer_encoding_test.cpp:62
↓ 36 callers
Method
Initialize
flume/runtime/common/entity_dag.h:205
↓ 36 callers
Method
begin
(self, keys, inputs, emitter)
bigflow_python/python/bigflow/core/example/word_cnt.py:56
↓ 36 callers
Method
config
flume/core/testing/mock_base.h:62
↓ 36 callers
Function
map
Transform map implementation :param pvalue: PType :param fn: UDF :param side_inputs: SideInputs :return:
bigflow_python/python/bigflow/transform_impls/map.py:26
↓ 35 callers
Method
count
返回元素的数量,等同于 :func:`bigflow.transforms.count(self) <bigflow.transforms.count>` Returns: PObject: 元素数量
bigflow_python/python/bigflow/pcollection.py:128
↓ 35 callers
Method
end
flume/runtime/testing/mock_source.h:46
↓ 35 callers
Method
run
立刻运行Pipeline并等待结束 Raises: BigflowRuntimeException: 若运行期出错抛出此异常
bigflow_python/python/bigflow/pipeline/pipeline_base.py:262
↓ 34 callers
Method
GetSource
flume/runtime/common/executor_base.cpp:140
↓ 34 callers
Method
begin_group
flume/runtime/common/executor_impl.cpp:221
↓ 34 callers
Method
end_group
flume/runtime/common/shuffle_executor.cpp:83
↓ 34 callers
Method
serde
Return the serde of the dataset Returns: LogicalPlan.Node: The serde.
bigflow_python/python/bigflow/ptype.py:115
↓ 34 callers
Function
tuple_set_item
bigflow_python/common/python.cpp:44
↓ 33 callers
Method
RequireStream
flume/runtime/common/partial_executor.cpp:53
↓ 33 callers
Method
any
flume/util/bitset.h:212
↓ 33 callers
Method
done
(self)
bigflow_python/python/bigflow/core/logical_plan.py:712
↓ 33 callers
Method
set_debug_info
(self, debug_info)
bigflow_python/python/bigflow/core/logical_plan.py:168
↓ 33 callers
Method
set_identity
flume/planner/unit.cpp:162
↓ 32 callers
Method
EmitBinary
flume/runtime/common/single_dispatcher.cpp:294
↓ 32 callers
Method
_test_this
tests _test_this: construct test dict
bigflow_python/python/bigflow/test/pobject_test.py:54
↓ 32 callers
Method
dumps
bigflow_python/serde/cpickle_serde.cpp:81
↓ 32 callers
Method
flatten
对于每个Key和Value中的每个元素(value 1, value 2, ... value m),构造(Key, value 1), (Key, value 2), ... (Key, value m),结果使用PCollection表示 Returns:
bigflow_python/python/bigflow/ptable.py:254
↓ 31 callers
Method
DispatchObject
flume/runtime/testing/mock_source.h:142
↓ 31 callers
Method
by
(self, loader_obj)
bigflow_python/python/bigflow/core/logical_plan.py:446
↓ 31 callers
Method
is_infinite
Infinite/Finite of this node
bigflow_python/python/bigflow/core/logical_plan.py:209
↓ 31 callers
Method
loads
bigflow_python/serde/cpickle_serde.cpp:73
↓ 31 callers
Method
set
flume/runtime/spark/shuffle_protocol.h:60
↓ 30 callers
Method
add_input
flume/runtime/common/executor_impl_test.cpp:490
↓ 30 callers
Method
end
(self)
bigflow_python/python/bigflow/core/example/word_cnt.py:66
↓ 30 callers
Function
list_of
Return an optional list serde.
bigflow_python/python/bigflow/serde.py:739
↓ 29 callers
Method
RegisterPass
flume/planner/pass_manager.h:447
↓ 29 callers
Method
from_message
(pb_message)
bigflow_python/python/bigflow/core/entity.py:183
↓ 29 callers
Method
identity
flume/planner/unit.cpp:158
↓ 29 callers
Method
request
Send a request to backend server
bigflow_python/python/bigflow/rpc/service.py:67
↓ 29 callers
Method
set_size
Set data size of this node
bigflow_python/python/bigflow/core/logical_plan.py:187
↓ 28 callers
Method
Emit
flume/runtime/common/entity_dag.cpp:139
↓ 28 callers
Method
Shuffle
flume/core/logical_plan.cpp:466
↓ 28 callers
Method
set_effective_key_num
(self, number)
bigflow_python/python/bigflow/core/logical_plan.py:608
↓ 27 callers
Method
DispatchObjectAndBinary
flume/runtime/testing/mock_source.h:152
↓ 27 callers
Method
begin
flume/runtime/testing/mock_source.h:45
↓ 26 callers
Method
input
(self)
bigflow_python/python/bigflow/util/reiterable_input.py:43
↓ 26 callers
Method
split
(self, uri, splits)
bigflow_python/python/bigflow/core/tests/test_helper.py:33
↓ 25 callers
Method
GetDataset
flume/runtime/common/local_dataset.cpp:167
↓ 25 callers
Method
SetObjector
flume/runtime/common/single_dispatcher.cpp:158
↓ 25 callers
Method
allow_partial_processing
(self)
bigflow_python/python/bigflow/core/logical_plan.py:541
↓ 25 callers
Method
process
bigflow_python/processors/pipe_processor.cpp:305
↓ 25 callers
Method
sum
将所有元素相加,等同于 :func:`bigflow.transforms.sum(self) <bigflow.transforms.sum>` Returns: PObject: 相加结果
bigflow_python/python/bigflow/pcollection.py:457
↓ 24 callers
Function
AsSources
flume/planner/local/local_planner_test.cpp:227
↓ 24 callers
Function
HideToftPathPassword
flume/util/path_util.cpp:104
↓ 24 callers
Method
_assert_belongs_to
(self, node_or_scope, scope)
bigflow_python/python/bigflow/core/tests/logical_plan_test.py:60
↓ 24 callers
Method
generate_tmp_path
generate a tmp path
bigflow_python/python/bigflow/test/test_base.py:134
↓ 23 callers
Method
RequireObject
flume/runtime/testing/mock_listener.h:65
↓ 23 callers
Method
add
bigflow_python/register.cpp:91
↓ 23 callers
Method
finish_group
flume/runtime/common/executor_impl.cpp:233
↓ 23 callers
Method
flatten_values
使用Value中的每个元素(value 1, value 2, ... value m),构造PCollection,等价于 ``self.extract_values()`` Returns: PCollection: 包含所有Value的
bigflow_python/python/bigflow/ptable.py:263
↓ 23 callers
Method
shuffle
(self, scope, from_nodes)
bigflow_python/python/bigflow/core/logical_plan.py:930
↓ 22 callers
Method
Load
flume/runtime/io/io_format.cpp:325
↓ 22 callers
Method
ReadLineWithLineEnding
flume/runtime/io/gzip_file.cpp:191
↓ 22 callers
Method
Run
flume/planner/common/add_common_executor_pass.cpp:484
↓ 22 callers
Function
cp_byte
bigflow_python/common/barshal_objector.cpp:84
↓ 22 callers
Method
group_by_key
与 ``group_by`` 变换类似,但使用默认的key/value提取函数对元素分组 Args: **options: 可配置参数 Returns: PTable: 分组结果 >>
bigflow_python/python/bigflow/pcollection.py:252
↓ 22 callers
Method
name
flume/runtime/resource.h:69
↓ 22 callers
Method
node_size
flume/core/logical_plan.h:82
↓ 22 callers
Method
none
flume/util/bitset.h:216
↓ 22 callers
Method
set_scope_level
flume/runtime/common/shuffle_executor_test.cpp:90
↓ 22 callers
Method
split
inner
bigflow_python/python/bigflow/test/io_test.py:42
↓ 21 callers
Method
Run
flume/runtime/task.cpp:67
↓ 21 callers
Function
ToList
flume/runtime/common/local_dataset_test.cpp:61
↓ 21 callers
Method
begin_group
flume/runtime/common/executor_impl_test.cpp:432
↓ 21 callers
Method
length
bigflow_python/common/side_input.cpp:39
↓ 21 callers
Method
serialize
bigflow_python/objectors/set_serde.cpp:41
↓ 20 callers
Function
AppendOrdered
bigflow_python/common/comparable.h:40
↓ 20 callers
Method
Dispatch
flume/runtime/common/entity_dag.cpp:131
↓ 20 callers
Method
GetEntry
flume/runtime/resource.cpp:163
↓ 20 callers
Method
IsEof
flume/runtime/io/gzip_file.cpp:225
↓ 20 callers
Method
StrSerde
bigflow_python/objectors/str_serde.h:41
↓ 20 callers
Function
make_tuple
将所有输入的PObject合并成一个PObject(tuple)。 除返回值类型及输入类型都全是PObject外, 结果与 :func:`bigflow.transforms.cartesian(self, *pvalues, **
bigflow_python/python/bigflow/transforms.py:1423
↓ 20 callers
Method
nested_level
返回该PTable的嵌套层级,即其Value中包含几个PTable Returns: int: 嵌套层级 >>> _pipeline.parallelize({"A": 1}).nested_level()
bigflow_python/python/bigflow/ptable.py:133
↓ 20 callers
Method
set_config
(self, config)
bigflow_python/python/bigflow/core/entity.py:348
↓ 20 callers
Method
sort
(self)
bigflow_python/python/bigflow/core/logical_plan.py:342
↓ 19 callers
Method
DispatchBinary
flume/runtime/testing/mock_source.h:147
↓ 19 callers
Function
EmitTo
flume/runtime/common/local_dataset_test.cpp:51
↓ 19 callers
Method
GetDependencyCounts
flume/planner/local/local_planner_test.cpp:103
↓ 19 callers
Method
GetValue
flume/runtime/counter.cpp:35
↓ 19 callers
Method
items
(self)
bigflow_python/python/bigflow/pipeline/test/testdata/disjointset.py:46
↓ 19 callers
Method
match_by
(self, key_reader_obj, key_reader=entity.Entity.key_reader)
bigflow_python/python/bigflow/core/logical_plan.py:724
↓ 19 callers
Method
sort_by
(self, key_reader_obj)
bigflow_python/python/bigflow/core/logical_plan.py:266
↓ 19 callers
Method
total_reserved_bytes
flume/util/arena.h:161
↓ 18 callers
Method
DispatchIterator
flume/runtime/common/general_dispatcher.cpp:380
↓ 18 callers
Function
ToList
flume/runtime/common/memory_dataset_test.cpp:36
↓ 18 callers
Method
filter
过滤元素,等同于 :func:`bigflow.transforms.filter(self, fn, *side_inputs, **options) <bigflow.transforms.filter>`, Args:
bigflow_python/python/bigflow/pcollection.py:159
↓ 18 callers
Method
group_by
(self, key_reader_obj)
bigflow_python/python/bigflow/core/logical_plan.py:273
↓ 17 callers
Function
AsSet
flume/planner/testing/plan_test_helper.h:310
↓ 17 callers
Method
BeginGroup
flume/runtime/common/executor_base_test.cpp:209
↓ 17 callers
Method
FinishGroup
flume/runtime/common/executor_base_test.cpp:213
↓ 17 callers
Function
PbScopeTag
flume/planner/testing/tag_desc.cpp:119
↓ 17 callers
Method
ReadLine
flume/runtime/io/gzip_file.cpp:163
↓ 17 callers
Method
__init__
(self, fn)
bigflow_python/python/bigflow/core/entity.py:239
↓ 17 callers
Method
_assert_from
(self, to_node, from_node)
bigflow_python/python/bigflow/core/tests/logical_plan_test.py:63
← previous
next →
101–200 of 5,490, ranked by callers