MCPcopy Create free account
hub / github.com/baidu/bigflow / read

Method read

bigflow_python/python/bigflow/pipeline/pipeline_base.py:208–246  ·  view source on GitHub ↗

将外部存储的数据映射为一个PCollection，并在运行时读取数据 Args: source (Source): 表示外部存储的Source实例 Returns: PCollection: 读取结果

(self, source)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 15

parallelizeMethod · 0.95
resource_library.pyFile · 0.80
bigflow_group_top_n.pyFile · 0.80
group_top_n.pyFile · 0.80
uv.pyFile · 0.80
avg.pyFile · 0.80
white_black_list.pyFile · 0.80
save_fileMethod · 0.80
test_text_fileMethod · 0.80
test_text_file_syncMethod · 0.80
test_schema_text_fileMethod · 0.80
test_sequence_fileMethod · 0.80

Calls 10

mapFunction · 0.50
reduceFunction · 0.50
ofMethod · 0.45
_transform_uriMethod · 0.45
as_typeMethod · 0.45
byMethod · 0.45
loadMethod · 0.45
set_sizeMethod · 0.45
get_sizeMethod · 0.45
transform_from_nodeMethod · 0.45

Tested by 15

test_text_fileMethod · 0.64
test_text_file_syncMethod · 0.64
test_schema_text_fileMethod · 0.64
test_sequence_fileMethod · 0.64
test_sequence_file_syncMethod · 0.64
test_gz_fileMethod · 0.64
test_sequence_file_invalidMethod · 0.64
test_sequence_file_serdeMethod · 0.64
wildcard_caseMethod · 0.64
test_partitionedMethod · 0.64
test_commitMethod · 0.64
test_split_string_to_typesMethod · 0.64