User can override post_process method to do some post_process.

用户可以重写该方法。 进行前处理，默认不处理

Return an protobuf serde Warning: this is not optional

get recent job cmds

set parallelize serde

run all tests

Registered with the dispatch to handle all function types. Determines what kind of function obj is (e.g. lambda, defined at interacti

Inner logic to save instance. Based off pickle.save_inst Supports __transient__

Serialize the processor This method is used for stream processing, Override this function to dump status info so that it can be resumed on failover.

no comments

用户可以重写该方法。 该方法对每条数据调用一次

根据数据实际值对数据进行排序(默认为升序) Args: reverse (bool): 是否降序排序 Returns: FileBase: 返回self

使用给定的key对元素排序，等同于 :func:`bigflow.transforms.sort_by(self, fn, reverse) <bigflow.transforms.sort_by>` Args:

test

Flatten all the test cases(methods) in the suite into a generator :param suite: TestSuite, may contain another TestSuite :return: Generator

对于输入PCollection，求其所有包含元素相加的结果 Args: pcollection (PCollection): 输入PCollection **options: 可配置参数 Returns: PObject: 表示

Send the rpc command to the other end to suspend the logical plan Args: Raises: error.BigflowRPCException: if any error happened

Case: test unary operations

将元素与其他PCollection/PObject中的所有元素共同构成PCollection 等同于 ``transforms.union(self, other, *others)`` Args: other (PCollec

get vertex num

对元素根据Window分组 Args: window (Window): 用于分组的Window **options: 可配置选项 Returns: PTable: 分组结果

对输出文件进行压缩 Args: compression_type (str): 压缩格式，目前仅支持"gzip" Returns: TextFile: 返回self

Returns a 3 element tuple describing the xrange start, step, and len respectively Note: Only guarentees that elements of xrange are the same.