Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/baidu/bigflow
/ functions
Functions
5,490 in github.com/baidu/bigflow
⨍
Functions
5,490
◇
Types & classes
1,763
↓ 17 callers
Method
cogroup
等同于 :func:`bigflow.transforms.cogroup(self, other, *others) <bigflow.transforms.cogroup>`, Args: other (PC
bigflow_python/python/bigflow/pcollection.py:97
↓ 17 callers
Method
input
flume/core/logical_plan.h:467
↓ 17 callers
Function
list_get_item
bigflow_python/common/python.cpp:51
↓ 17 callers
Function
new_tuple
bigflow_python/common/python.cpp:67
↓ 17 callers
Method
processor
flume/runtime/common/entity_dag.cpp:289
↓ 17 callers
Method
save_reduce
Modified to support __transient__ on new objects Change only affects protocol level 2 (which is always used by PiCloud
bigflow_python/python/bigflow/core/serde/cloudpickle.py:595
↓ 17 callers
Method
split
inner
bigflow_python/python/bigflow/input.py:241
↓ 16 callers
Method
AddNormalFileFromBytes
flume/runtime/resource.cpp:198
↓ 16 callers
Method
Discard
flume/runtime/common/local_dataset.cpp:332
↓ 16 callers
Method
GetCounter
flume/runtime/counter.cpp:59
↓ 16 callers
Method
Sink
flume/core/logical_plan.cpp:382
↓ 16 callers
Method
global_scope
(self)
bigflow_python/python/bigflow/core/logical_plan.py:840
↓ 16 callers
Method
is_discard
flume/planner/unit.cpp:122
↓ 16 callers
Function
map
对PCollection中的每个元素做一对一映射 对给定的PCollection/PObject中的每个元素应用一个变换函数,以函数的返回结果 构造PCollection/PObject 假设输入类型为I,fn的期望签名为 fn(I) => O Arg
bigflow_python/python/bigflow/transforms.py:622
↓ 16 callers
Method
node
Return the internal node it holds. .. note:: End-users are not supposed to use this function. Returns: LogicalPla
bigflow_python/python/bigflow/ptype.py:104
↓ 16 callers
Method
remained_buffer_size
flume/util/arena.h:154
↓ 15 callers
Function
PbNodeTag
flume/planner/testing/tag_desc.cpp:311
↓ 15 callers
Method
Run
flume/planner/common/promote_partial_units_pass.cpp:276
↓ 15 callers
Method
clone
flume/planner/unit.cpp:83
↓ 15 callers
Method
create
no comments
bigflow_python/python/bigflow/test/test_base.py:202
↓ 15 callers
Method
reduce
使用给定的fn将所有元素规约为单个元素, 等同于 :func:`bigflow.transforms.reduce(self, fn, *side_inputs, **options) <bigflow.transforms.redu
bigflow_python/python/bigflow/pcollection.py:365
↓ 15 callers
Method
set
flume/planner/unit.h:184
↓ 14 callers
Function
AppendOrdered
flume/util/comparable.h:39
↓ 14 callers
Function
AsKeys
flume/runtime/common/memory_status_table_test.cpp:48
↓ 14 callers
Method
BeginGroup
flume/runtime/common/executor_impl_test.cpp:521
↓ 14 callers
Function
ExpectIs
flume/planner/common/load_logical_plan_pass_test.cpp:50
↓ 14 callers
Method
FinishGroup
flume/runtime/common/executor_impl_test.cpp:525
↓ 14 callers
Method
RemoveDependency
flume/planner/plan.cpp:99
↓ 14 callers
Method
TupleSerde
bigflow_python/objectors/tuple_serde.h:45
↓ 14 callers
Method
datasets
flume/runtime/common/shuffle_runner.h:252
↓ 14 callers
Method
emit
(self, record)
bigflow_python/python/bigflow/rpc/test/backend_parser_test.py:52
↓ 14 callers
Method
process_with_side_inputs
Convert all SideInputs as prepared nodes in LogicalPlan Returns: LogicalPlan.Node: processed node
bigflow_python/python/bigflow/util/side_input_util.py:70
↓ 14 callers
Method
remained_buffer
flume/util/arena.h:147
↓ 14 callers
Method
union
(self, a, b)
bigflow_python/python/bigflow/test/testdata_for_spark/disjointset.py:35
↓ 14 callers
Method
uri
flume/core/logical_plan.h:341
↓ 13 callers
Method
DebugString
flume/planner/plan.cpp:150
↓ 13 callers
Method
RequireIterator
flume/runtime/common/partial_executor.cpp:67
↓ 13 callers
Method
SetDatasetManager
flume/runtime/common/single_dispatcher.cpp:154
↓ 13 callers
Method
Write
flume/runtime/common/file_cache_manager.cpp:167
↓ 13 callers
Method
__init__
init
bigflow_python/python/bigflow/serde.py:122
↓ 13 callers
Method
accumulate
等同于 :func:`bigflow.transforms.accumulate(self, zero, accumulate_fn, *side_inputs, **options) <bigflow.transforms.accumulate>`
bigflow_python/python/bigflow/pcollection.py:43
↓ 13 callers
Method
cartesian
求当前算子与pvalues的笛卡尔积。 等价于 :func:`bigflow.transforms.cartesian(self, *pvalues, **options) <bigflow.transforms.cartesian>`
bigflow_python/python/bigflow/pobject.py:262
↓ 13 callers
Method
check_sample
inner
bigflow_python/python/bigflow/test/serde_test.py:198
↓ 13 callers
Method
deserialize
bigflow_python/objectors/set_serde.cpp:77
↓ 13 callers
Method
operator[]
flume/planner/testing/plan_desc.cpp:142
↓ 13 callers
Method
plan
(self)
bigflow_python/python/bigflow/core/logical_plan.py:162
↓ 12 callers
Function
AsDataNodeSet
flume/planner/common/task_flow_analysis_test.cpp:46
↓ 12 callers
Function
AsNodeSet
flume/planner/common/data_flow_analysis_test.cpp:33
↓ 12 callers
Method
DispatchStream
flume/runtime/common/general_dispatcher.cpp:370
↓ 12 callers
Method
IsInputDone
flume/runtime/common/shuffle_runner.h:257
↓ 12 callers
Function
PrettyTypeName
flume/util/reflection.h:382
↓ 12 callers
Method
RemoveControl
flume/planner/plan.cpp:66
↓ 12 callers
Method
ReplaceFrom
flume/planner/plan.cpp:189
↓ 12 callers
Method
Run
flume/planner/spark/merge_task_pass.cpp:137
↓ 12 callers
Method
Run
flume/planner/common/build_common_executor_pass.cpp:137
↓ 12 callers
Method
Update
flume/runtime/counter.cpp:39
↓ 12 callers
Method
Write
flume/runtime/io/gzip_file.cpp:76
↓ 12 callers
Method
add_file
Add a single file to be packed with the job at runtime. Args: file_path (str): path of file to add resource_pat
bigflow_python/python/bigflow/runtime/python_resource.py:50
↓ 12 callers
Method
current_block
flume/util/arena.h:165
↓ 12 callers
Method
done
flume/runtime/common/executor_impl.cpp:253
↓ 12 callers
Method
empty
flume/core/entity.h:51
↓ 12 callers
Method
father
(self)
bigflow_python/python/bigflow/core/logical_plan.py:48
↓ 12 callers
Method
find_next
flume/util/bitset.h:348
↓ 12 callers
Method
id
得到表示该Pipeline的唯一ID Returns: int: Pipeline ID
bigflow_python/python/bigflow/pipeline/pipeline_base.py:362
↓ 12 callers
Method
is_null
flume/planner/common/util.h:70
↓ 12 callers
Method
is_prepared
flume/core/logical_plan.h:430
↓ 12 callers
Method
is_sorted
flume/core/logical_plan.h:182
↓ 12 callers
Method
key_serdes
返回Key的序列化/反序列化器
bigflow_python/python/bigflow/ptable.py:287
↓ 12 callers
Function
keys
flume/runtime/common/file_cache_manager_test.cpp:42
↓ 12 callers
Method
max
取最大元素,等同于 :func:`bigflow.transforms.max(self, key) <bigflow.transforms.max>` Args: key (function, optional
bigflow_python/python/bigflow/pcollection.py:280
↓ 12 callers
Method
origin_serde
origin_serde
bigflow_python/python/bigflow/serde.py:126
↓ 12 callers
Method
repeatedly
set load node is infinite
bigflow_python/python/bigflow/core/logical_plan.py:428
↓ 12 callers
Method
set_cpu
Set cpu limit for this node
bigflow_python/python/bigflow/core/logical_plan.py:202
↓ 12 callers
Method
set_memory
Set memory limit for this node
bigflow_python/python/bigflow/core/logical_plan.py:195
↓ 12 callers
Method
set_side_inputs
(self, *side_inputs)
bigflow_python/python/bigflow/core/entity.py:369
↓ 12 callers
Method
to_proto_message
(self)
bigflow_python/python/bigflow/core/entity.py:247
↓ 12 callers
Method
transform
等同于 :func:`bigflow.transforms.transform(self, *args, **options) <bigflow.transforms.transform>`
bigflow_python/python/bigflow/pcollection.py:356
↓ 12 callers
Method
user_set
flume/planner/testing/plan_test_helper.h:388
↓ 12 callers
Method
with_concurrency
(self, concurrency)
bigflow_python/python/bigflow/core/logical_plan.py:346
↓ 11 callers
Method
Process
flume/planner/common/cache_util.cpp:127
↓ 11 callers
Method
ViewAsDirectory
flume/runtime/resource.cpp:321
↓ 11 callers
Method
_value
(self)
bigflow_python/python/bigflow/ptable.py:130
↓ 11 callers
Method
add_from
(self, from_vertex)
bigflow_python/python/bigflow/core/tests/test_helper.py:176
↓ 11 callers
Method
done
tricks for enable using expression chain to construct ProcessNode
flume/core/logical_plan.h:589
↓ 11 callers
Method
find_first
flume/util/bitset.h:338
↓ 11 callers
Method
is_descendant_of
flume/planner/unit.cpp:107
↓ 11 callers
Method
is_partial
flume/core/logical_plan.h:427
↓ 11 callers
Function
is_tuple
bigflow_python/common/python.cpp:124
↓ 11 callers
Method
key
flume/runtime/spark/kv_buffer.cpp:82
↓ 11 callers
Function
keys
flume/runtime/common/cache_iterator_test.cpp:45
↓ 11 callers
Method
load
(self, split, emitter)
bigflow_python/python/bigflow/core/tests/test_helper.py:36
↓ 11 callers
Function
max
得到输入PCollection中最大的元素 Args: pcollection (PCollection): 输入PCollection key (function, optional): 用于提取key的函数,与Python内置``max()``中的
bigflow_python/python/bigflow/transforms.py:712
↓ 11 callers
Method
need_set
flume/planner/testing/plan_test_helper.h:399
↓ 11 callers
Function
record
flume/runtime/common/file_cache_manager_test.cpp:89
↓ 11 callers
Method
to_proto_message
(self)
bigflow_python/python/bigflow/core/logical_plan.py:992
↓ 10 callers
Method
Allocate
flume/runtime/util/serialize_buffer.h:127
↓ 10 callers
Method
AllocateBytes
flume/util/arena.h:169
↓ 10 callers
Method
FinishShuffle
flume/runtime/common/shuffle_impl.h:176
↓ 10 callers
Function
ListEntries
flume/runtime/common/memory_status_table_test.cpp:122
↓ 10 callers
Method
PartitionOf
flume/core/testing/mock_partitioner.h:68
← previous
next →
201–300 of 5,490, ranked by callers