Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/baidu/bigflow
/ functions
Functions
5,490 in github.com/baidu/bigflow
⨍
Functions
5,490
◇
Types & classes
1,763
↓ 10 callers
Method
RemoveUnit
flume/planner/plan.cpp:117
↓ 10 callers
Method
RequireBinary
flume/runtime/testing/mock_listener.h:73
↓ 10 callers
Method
Run
flume/planner/spark/init_rdd_info_pass.cpp:130
↓ 10 callers
Method
Run
flume/planner/common/cache_analysis.cpp:60
↓ 10 callers
Method
Serialize
flume/runtime/io/io_format.cpp:60
↓ 10 callers
Method
Setup
flume/runtime/common/shuffle_impl.h:145
↓ 10 callers
Method
StartShuffle
flume/runtime/common/shuffle_impl.h:169
↓ 10 callers
Method
add_dispatcher
flume/runtime/common/executor_impl_test.cpp:565
↓ 10 callers
Method
add_file
向Pipeline添加单个文件,使得该文件能够在运行期被访问 Args: source (str): 需要添加的文件路径或者比特数据流 resource_path (str): 计算引擎运行时访问该文件的本地路径, 应是相
bigflow_python/python/bigflow/pipeline/pipeline_base.py:108
↓ 10 callers
Method
change_identity
flume/planner/unit.cpp:166
↓ 10 callers
Method
concurrency
flume/core/logical_plan.h:184
↓ 10 callers
Method
deserialize
deserialize
bigflow_python/python/bigflow/serde.py:136
↓ 10 callers
Method
emit
bigflow_python/processors/processor.cpp:120
↓ 10 callers
Method
end_sub_group
flume/runtime/common/executor_impl.h:359
↓ 10 callers
Method
father
flume/core/logical_plan.h:181
↓ 10 callers
Method
get
inner function
bigflow_python/python/bigflow/pipeline/spark_pipeline.py:75
↓ 10 callers
Function
is_list
bigflow_python/common/python.cpp:116
↓ 10 callers
Function
iterator
bigflow_python/common/iterator.h:57
↓ 10 callers
Method
leave_scope
(self)
bigflow_python/python/bigflow/core/logical_plan.py:242
↓ 10 callers
Function
list_len
bigflow_python/common/python.cpp:71
↓ 10 callers
Method
partition
对输出结果进行分组 Args: n (int): 输出结果的分组个数,具体表现为产生n个输出文件,文件内容为各组数据 partition_fn (callable): 用于指定分组方式的函数 Retur
bigflow_python/python/bigflow/output.py:205
↓ 10 callers
Method
setConfig
no comment
bigflow_python/python/bigflow/test/test_base.py:231
↓ 10 callers
Method
set_is_prepared
flume/core/logical_plan.h:431
↓ 9 callers
Method
AcquireArena
flume/runtime/common/local_dataset.cpp:375
↓ 9 callers
Method
AddCachedNodeId
flume/runtime/session.cpp:48
↓ 9 callers
Method
BeginKeys
flume/runtime/common/file_cache_manager.cpp:157
↓ 9 callers
Method
CombineWith
process this node in COMMON scope
flume/core/logical_plan.h:286
↓ 9 callers
Method
DirectOutputs
flume/planner/local/local_planner_test.cpp:123
↓ 9 callers
Method
Done
bigflow_python/functors/py_functor_caller.cpp:44
↓ 9 callers
Method
GetAllUnits
flume/planner/plan.cpp:125
↓ 9 callers
Method
GetStatus
flume/runtime/backend.cpp:218
↓ 9 callers
Method
IsAcceptMore
flume/runtime/common/single_dispatcher.cpp:177
↓ 9 callers
Method
Next
flume/runtime/common/cache_iterator.cpp:110
↓ 9 callers
Method
Run
flume/planner/spark/build_transfer_executor_pass.cpp:152
↓ 9 callers
Function
Serialize
flume/runtime/common/write_cache_executor_test.cpp:92
↓ 9 callers
Method
SetCachePathForId
flume/runtime/session.cpp:65
↓ 9 callers
Function
TaskMessageOf
flume/planner/monitor/build_physical_plan_pass.cpp:49
↓ 9 callers
Method
Tell
flume/runtime/io/gzip_file.cpp:159
↓ 9 callers
Method
ToString
flume/util/reflection_test.cpp:163
↓ 9 callers
Method
Union
flume/planner/pass_manager.cpp:96
↓ 9 callers
Method
add_node
flume/core/logical_plan.h:228
↓ 9 callers
Method
add_record
flume/runtime/common/transfer_encoding_test.cpp:68
↓ 9 callers
Method
add_split
flume/runtime/common/split_combiner.cpp:31
↓ 9 callers
Method
all
flume/util/bitset.h:220
↓ 9 callers
Method
begin_group
bigflow_python/processors/pipe_processor.cpp:286
↓ 9 callers
Function
cp_long
bigflow_python/common/barshal_objector.cpp:92
↓ 9 callers
Method
empty
(self)
bigflow_python/python/bigflow/rpc/backend_parser.py:111
↓ 9 callers
Method
end_group
bigflow_python/processors/pipe_processor.cpp:347
↓ 9 callers
Method
finish_group
flume/runtime/common/executor_impl.h:68
↓ 9 callers
Method
from_size
flume/core/logical_plan.h:539
↓ 9 callers
Method
ignore_group
(self)
bigflow_python/python/bigflow/core/logical_plan.py:600
↓ 9 callers
Function
key
flume/runtime/spark/cache_input_executor_test.cpp:71
↓ 9 callers
Function
of
创建FieldsDictSerde,用来序列化、反序列化有指定字段的字典。 因为字段已知,则key无需序列化,序列化出来的数据会小于marshal序列化后的结果。 Args: fields_to_types (dict): 可以传入一个字段名组成的列表,
bigflow_python/python/bigflow/schema.py:80
↓ 9 callers
Function
record
flume/runtime/common/cache_iterator_test.cpp:92
↓ 9 callers
Method
ref
flume/runtime/common/partial_executor.cpp:238
↓ 9 callers
Method
set_shuffle_type
(self, value)
bigflow_python/python/bigflow/core/logical_plan.py:678
↓ 9 callers
Method
setup
bigflow_python/objectors/set_serde.cpp:29
↓ 9 callers
Method
sinker
(self)
bigflow_python/python/bigflow/core/logical_plan.py:507
↓ 9 callers
Function
sort
对于输入PCollection,将其进行排序 Args: pcollection (PCollection): 输入PCollection reverse (bool): 若True则降序排列,否则为升序排列 Returns: P
bigflow_python/python/bigflow/transforms.py:840
↓ 9 callers
Method
take
给定PCollection中的任意n个元素,等同于 :func:`bigflow.transforms.take` Args: n (int or PObject): 元素数量 **options: 可配置参数
bigflow_python/python/bigflow/pcollection.py:385
↓ 9 callers
Method
value
flume/runtime/spark/kv_buffer.cpp:86
↓ 9 callers
Method
vertex
flume/planner/testing/plan_desc.cpp:80
↓ 8 callers
Method
AddSunkNodeId
flume/runtime/session.cpp:44
↓ 8 callers
Method
Close
flume/runtime/io/io_format.cpp:1085
↓ 8 callers
Method
Done
bigflow_python/delegators/python_processor_delegator.cpp:75
↓ 8 callers
Method
Dump
flume/runtime/common/local_dataset.cpp:385
↓ 8 callers
Method
EndGroup
flume/runtime/common/write_cache_executor.cpp:87
↓ 8 callers
Method
EndKeys
flume/runtime/common/file_cache_manager.cpp:172
↓ 8 callers
Method
Read
flume/runtime/common/file_cache_manager.cpp:119
↓ 8 callers
Method
Register
flume/planner/pass_manager.h:263
↓ 8 callers
Method
SourcesBetween
flume/planner/local/local_planner_test.cpp:107
↓ 8 callers
Method
ToProtoMessage
flume/core/logical_plan.cpp:91
↓ 8 callers
Method
WithConcurrency
flume/core/logical_plan.h:221
↓ 8 callers
Method
WriteRecord
flume/runtime/io/io_format.cpp:1254
↓ 8 callers
Method
__set_scope_type
(self, scope_type)
bigflow_python/python/bigflow/core/logical_plan.py:785
↓ 8 callers
Method
as_type
通过kv_deserializer反序列化读取的(Key, Value) kv_deserializer的期望签名为: kv_deserializer(key: str, value: str) => object
bigflow_python/python/bigflow/input.py:548
↓ 8 callers
Method
close
(self)
bigflow_python/python/bigflow/core/tests/test_helper.py:83
↓ 8 callers
Method
encode
flume/core/timer_queue.h:72
↓ 8 callers
Function
find_or_insert_vertex
(node_id, vertices)
bigflow_python/python/bigflow/core/tests/test_helper.py:194
↓ 8 callers
Method
get_dealt_side_inputs_tuple
(side_input_tuple)
bigflow_python/python/bigflow/util/side_input_util.py:61
↓ 8 callers
Method
has_next
flume/runtime/spark/kv_buffer.cpp:64
↓ 8 callers
Method
key_reader
(self)
bigflow_python/python/bigflow/core/logical_plan.py:681
↓ 8 callers
Method
loader
(self)
bigflow_python/python/bigflow/core/logical_plan.py:443
↓ 8 callers
Method
replace
flume/runtime/common/executor_impl.cpp:207
↓ 8 callers
Method
runner
flume/runtime/common/executor_impl.h:329
↓ 8 callers
Method
set_init_hook
向Pipeline设置一个初始化钩子,使得Pipeline能够在进程启动时依次执行(按钩子名字排序) Args: name (str): 钩子名称, 用户应使用 str 作为钩子名字, 同时钩子应使用 ascii 码中字符.
bigflow_python/python/bigflow/pipeline/pipeline_base.py:172
↓ 8 callers
Function
split_of
flume/runtime/common/split_combiner_test.cpp:51
↓ 8 callers
Method
test
flume/util/bitset.h:207
↓ 8 callers
Method
to_plan
flume/planner/testing/plan_desc.cpp:201
↓ 8 callers
Function
transform
对给定PCollection进行任意的变换,结果为另一个PCollection transform有两种形式,形式一: 基本原型为`transform(pcollection, initializer, transformer, finalizer, *side_in
bigflow_python/python/bigflow/transforms.py:986
↓ 8 callers
Function
tuple_len
bigflow_python/common/python.cpp:75
↓ 7 callers
Function
CacheRecordObjectorEntity
flume/planner/common/cache_util.h:153
↓ 7 callers
Method
Clear
flume/runtime/util/object_holder.h:45
↓ 7 callers
Method
DebugString
flume/planner/spark/spark_planner.cpp:193
↓ 7 callers
Function
EffectiveKeyNum
flume/planner/testing/tag_desc.cpp:385
↓ 7 callers
Method
GetScopeLevel
flume/runtime/common/single_dispatcher.cpp:168
↓ 7 callers
Function
GetToftStylePath
flume/util/path_util.cpp:43
↓ 7 callers
Method
GetWriter
flume/runtime/common/file_cache_manager.cpp:223
↓ 7 callers
Method
IntSerde
bigflow_python/objectors/int_serde.h:41
↓ 7 callers
Function
IsHdfsPath
flume/util/path_util.cpp:99
← previous
next →
301–400 of 5,490, ranked by callers