MCPcopy Create free account
hub / github.com/baidu/bigflow / agg

Function agg

bigflow_python/python/bigflow/schema.py:435–491  ·  view source on GitHub ↗

把PCollection的全部数据进行聚合 Args: pcollection (SchemaPCollection): 输入数据集SchemaPCollection(用来表示结构化的,带字段的PCollection), 可以当作每个元素是一个dict的PCollection来用 agg_fn (callable): 一个函数,表示对每个字段进行怎么样的聚合,该函数将传入一个dict类型的参数,dict的key是所有的字段名,每个value是一个 PCollection,表示该字段的全部数据。 用户需要返回一个di

(pcollection, agg_fn, *args)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers

nothing calls this directly

Calls 6

_is_tuple_serdeFunction · 0.85
_pack_udfFunction · 0.85
_get_fieldsMethod · 0.80
serdeMethod · 0.45
applyMethod · 0.45

Tested by

no test coverage detected