MCPcopy Create free account
hub / github.com/baidu/bigflow / distinct

Method distinct

bigflow_python/python/bigflow/pcollection.py:142–157  ·  view source on GitHub ↗

元素去重,等同于 :func:`bigflow.transforms.distinct(self) ` Args: **options: 可配置选项 Returns: PCollection: 不重复元素,以PCollection给出 >>> p.parallelize([2, 2, 1, 9, 3, 3]).distinct().get() [2, 3, 1, 9]

(self)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 3

distinctFunction · 0.80
count_distinctFunction · 0.80
test_distinct_sumMethod · 0.80

Calls

no outgoing calls

Tested by 1

test_distinct_sumMethod · 0.64