MCPcopy Create free account

hub / github.com/baidu/bigflow / functions

Functions5,490 in github.com/baidu/bigflow

⨍ Functions 5,490◇ Types & classes 1,763
↓ 3 callersMethodif_infinite
Get infinte of from_nodes in the scope
bigflow_python/python/bigflow/core/logical_plan.py:223
↓ 3 callersMethodinitialize_interpreter
bigflow_python/python_interpreter.cpp:149
↓ 3 callersMethodinner_most_type
返回其最内部Value的类型 Returns: class: 最内部Value类型，PCollection或PObject >>> _pipeline.parallelize({"A": 1}).inner_most_typ
bigflow_python/python/bigflow/ptable.py:148
↓ 3 callersMethodinput_scope_level
flume/runtime/common/executor_impl.h:57
↓ 3 callersMethodintersection
返回与另一个PCollection的交集 Args: other (PCollection): 另一个PCollection Returns: PCollection: 表示交集的PCollection
bigflow_python/python/bigflow/pcollection.py:637
↓ 3 callersMethodis_cover_by
(self, scope)
bigflow_python/python/bigflow/core/logical_plan.py:114
↓ 3 callersMethodis_ignore_group
flume/core/logical_plan.h:472
↓ 3 callersMethodload
create load node
bigflow_python/python/bigflow/core/logical_plan.py:849
↓ 3 callersFunctionof
创建FieldsDictSerde，用来序列化、反序列化有指定字段的字典。 因为字段已知，则key无需序列化，序列化出来的数据会小于marshal序列化后的结果。 Args: fields_to_types: 可以传入一个字段名组成的列表， 也
bigflow_python/python/bigflow/future/fields.py:61
↓ 3 callersMethodplan
flume/planner/testing/plan_test_helper.h:370
↓ 3 callersMethodprepare_before_processing
(self)
bigflow_python/python/bigflow/core/logical_plan.py:545
↓ 3 callersMethodprocess
(self, scope=None, from_nodes=None)
bigflow_python/python/bigflow/core/logical_plan.py:879
↓ 3 callersMethodput
flume/runtime/spark/kv_buffer.cpp:43
↓ 3 callersMethodserialize
serialize
bigflow_python/python/bigflow/future/fields.py:45
↓ 3 callersMethodset_is_ignore_group
flume/core/logical_plan.h:473
↓ 3 callersMethodsetup
flume/runtime/common/executor_impl.h:223
↓ 3 callersMethodsink_by
(self, sink_obj)
bigflow_python/python/bigflow/core/logical_plan.py:257
↓ 3 callersMethodsize
flume/util/arena.h:125
↓ 3 callersMethodsort_by
通过key_read_fn获取key，并根据key对数据进行排序(默认为升序) Args: key_reader_fn (callable): 用户获取key的函数 reverse (bool): 是否降序排序
bigflow_python/python/bigflow/output.py:177
↓ 3 callersMethodstart
bigflow_python/rpc/bigflow_server.cpp:189
↓ 3 callersMethodstop
flume/runtime/spark/spark_driver.cpp:283
↓ 3 callersMethodtask_index
flume/runtime/spark/shuffle_protocol.h:44
↓ 3 callersFunctiontmp_keys
flume/runtime/spark/spark_cache_manager_test.cpp:76
↓ 3 callersFunctionto_piece
flume/runtime/common/cache_iterator_test.cpp:59
↓ 3 callersMethodtransform_from_node
内部接口
bigflow_python/python/bigflow/input.py:330
↓ 3 callersFunctiontuple_of
Return an optional tuple serde.
bigflow_python/python/bigflow/serde.py:732
↓ 3 callersFunctiontype_string
bigflow_python/common/python.cpp:283
↓ 3 callersMethodunion
(self, scope=None, nodes=None)
bigflow_python/python/bigflow/core/logical_plan.py:905
↓ 3 callersFunctionvec_foreach
bigflow_python/common/python.h:87
↓ 3 callersFunctionwrapper_of_udf
(select_fields)
bigflow_python/python/bigflow/schema.py:317
↓ 3 callersFunctionwrite_exception_to_file
bigflow_python/common/python.cpp:342
↓ 2 callersFunctionAddCopyRelationship
flume/planner/monitor/add_fixed_task_unit_pass.cpp:89
↓ 2 callersMethodAddDependency
flume/planner/plan.cpp:80
↓ 2 callersMethodAddDynamicLibrary
flume/runtime/resource.cpp:250
↓ 2 callersMethodAddJavaLibraryFromBytes
flume/runtime/resource.cpp:267
↓ 2 callersMethodAddPythonLibrary
flume/runtime/resource.cpp:275
↓ 2 callersMethodAllocate
flume/util/arena.h:176
↓ 2 callersMethodAllocateHandle
flume/runtime/common/general_dispatcher.cpp:211
↓ 2 callersMethodAppend
flume/runtime/common/local_dataset.cpp:302
↓ 2 callersFunctionBOOST_FOREACH
flume/runtime/common/entity_dag.cpp:576
↓ 2 callersMethodBeginGroup
flume/core/testing/processor_test_helper.cpp:52
↓ 2 callersMethodBeginGroup
flume/runtime/spark/hadoop_input_executor.cpp:77
↓ 2 callersMethodBeginGroup
flume/runtime/local/local_input_executor.cpp:54
↓ 2 callersMethodBeginGroup
bigflow_python/processors/processor.h:199
↓ 2 callersFunctionBuildExecutorDag
flume/planner/graph_helper.h:80
↓ 2 callersFunctionBuildScopeTree
flume/planner/graph_helper.h:65
↓ 2 callersFunctionCacheReaderPbEntity
flume/planner/common/cache_util.h:145
↓ 2 callersMethodCartesianFn
bigflow_python/functors/cartesian_fn.cpp:37
↓ 2 callersMethodCheckMemoryUsage
flume/runtime/common/local_dataset.cpp:401
↓ 2 callersMethodClose
bigflow_python/delegators/python_io_delegator.cpp:199
↓ 2 callersFunctionConstructExecutorMessage
flume/runtime/common/sinker_executor_test.cpp:44
↓ 2 callersFunctionConstructExecutorMessage
flume/runtime/common/loader_executor_test.cpp:60
↓ 2 callersMethodCreateExecutor
flume/runtime/local/local_executor_factory.cpp:47
↓ 2 callersMethodDebugString
flume/planner/local/local_planner.cpp:170
↓ 2 callersFunctionDefaultSparkHomePath
flume/util/config_util.cpp:55
↓ 2 callersFunctionDefaultTempHDFSPath
flume/util/config_util.cpp:60
↓ 2 callersMethodDeserialize
flume/planner/common/cache_util.cpp:70
↓ 2 callersMethodDeserialize
flume/runtime/io/io_format.cpp:79
↓ 2 callersMethodDictSerde
bigflow_python/objectors/dict_serde.h:41
↓ 2 callersMethodDone
flume/runtime/spark/spark_cache_iterator.cpp:104
↓ 2 callersMethodDone
flume/runtime/common/partial_executor.cpp:61
↓ 2 callersMethodDone
flume/runtime/testing/string_iterator.h:65
↓ 2 callersFunctionEncodeString
flume/planner/common/cache_util.cpp:28
↓ 2 callersMethodEndGroup
bigflow_python/processors/processor.h:231
↓ 2 callersMethodExtractValueFn
bigflow_python/functors/extract_value_fn.cpp:36
↓ 2 callersFunctionFindReaderInTask
flume/planner/monitor/build_reader_writer_pass.cpp:78
↓ 2 callersFunctionFindTaskByType
flume/planner/monitor/build_reader_writer_pass.cpp:88
↓ 2 callersMethodFinishGroup
flume/runtime/spark/hadoop_input_executor.cpp:82
↓ 2 callersMethodFlatMapProcessor
bigflow_python/processors/flatmap_processor.h:45
↓ 2 callersMethodFullJoinInitializeFn
bigflow_python/functors/full_join_fn.cpp:53
↓ 2 callersFunctionGenerateLabelString
flume/planner/common/draw_plan_pass.cpp:116
↓ 2 callersFunctionGetAbsolutePath
flume/runtime/local/local_backend_test.cpp:120
↓ 2 callersMethodGetCacheManager
flume/runtime/backend.cpp:190
↓ 2 callersMethodGetFactory
flume/util/reflection.h:219
↓ 2 callersMethodGetInstance
flume/runtime/common/entity_dag.cpp:152
↓ 2 callersMethodGetScopeVisitor
flume/runtime/common/memory_status_table.cpp:90
↓ 2 callersMethodGetSource
flume/runtime/spark/cache_input_executor.cpp:95
↓ 2 callersMethodGetSource
flume/runtime/common/executor_impl_test.cpp:516
↓ 2 callersMethodGetSource
flume/runtime/common/executor_impl.h:279
↓ 2 callersFunctionGetSparkTaskLogDirectory
flume/runtime/spark/jni/jni_task.cpp:60
↓ 2 callersMethodGetValue
flume/service/common/profiler_util.h:62
↓ 2 callersMethodGetWriter
flume/runtime/spark/spark_cache_manager.cpp:112
↓ 2 callersMethodHadoopClient
flume/runtime/platform/hadoop_client.cpp:49
↓ 2 callersMethodHasNext
bigflow_python/delegators/python_processor_delegator.cpp:55
↓ 2 callersMethodHasNext
bigflow_python/common/iterator.h:37
↓ 2 callersMethodIdlPacketSerde
bigflow_python/objectors/idl_packet_serde.h:38
↓ 2 callersFunctionInitBaiduFlume
flume/flume.cpp:44
↓ 2 callersFunctionInitPreparedTask
flume/planner/monitor/add_fixed_task_unit_pass.cpp:94
↓ 2 callersMethodInitialize
flume/runtime/local/local_executor_factory.cpp:39
↓ 2 callersMethodInitialize
flume/runtime/common/local_dataset.cpp:151
↓ 2 callersMethodInput
flume/core/logical_plan.h:422
↓ 2 callersMethodIsAlive
flume/util/process_launcher.cpp:140
↓ 2 callersFunctionIsStreamUnit
flume/planner/monitor/build_reader_writer_pass.cpp:57
↓ 2 callersFunctionIsUser
flume/planner/spark/merge_task_pass.cpp:97
↓ 2 callersMethodLaunch
flume/runtime/spark/spark_backend.cpp:136
↓ 2 callersFunctionLevelKeyReaderEntity
flume/planner/common/cache_util.cpp:164
↓ 2 callersFunctionLevelPartitionerEntity
flume/planner/common/cache_util.cpp:169
↓ 2 callersMethodListEntries
flume/runtime/common/memory_status_table.cpp:40
↓ 2 callersMethodLogicalPlan
flume/core/logical_plan.cpp:53
↓ 2 callersMethodMerge
flume/runtime/counter.cpp:92
← previousnext →701–800 of 5,490, ranked by callers