Get the final metadata for the dask.dataframe Parameters ---------- to_read_columns : list All the columns to end up with, includ

A reduction to count the number of elements, excluding nans

Operands to include in the node label by `visualize`

Normalize user and file-provided column and index names Parameters ---------- user_columns : None, str or list of str data_columns :

Return a list of ``(result_column, func, input_column)`` tuples. Spec can be - a function - a list of functions - a dictionary

Get the DataFrame corresponding to one path and one key (which should not contain any wildcards).

Return a list of open-file objects given a list of input-file paths. WARNING: This utility is experimental, and is meant for internal ``d

Optimize slices 1. Fuse repeated slices, like x[5:][2:6] -> x[7:11] This is generally not very important since we are fusing those tasks any

Get new chunks for array with overlap.

Get new chunks for array with overlap.

Parse string signatures for a generalized universal function. Arguments --------- signature : string Generalized universal f

Given a total and a divisor, return two tuples: A tuple containing `divisor` repeated the number of times it divides `total`, and length-1 or empt

In which partition does this value lie? >>> _partition_of_index_value([0, 5, 10], 3) 0 >>> _partition_of_index_value([0, 5, 10], 8) 1

Return defaultdict of division and values pairs Each key corresponds to the division which values are index values belong to the division.

Process a match to determine if it is correct, and to find the correct substitution that will convert the term into the pattern. Parameters

Parse the statistics for a group of files

Read in a pyarrow table

Read arrow table from file path. Used by `ArrowDatasetEngine._read_table` when no filters are specified (otherwise fragments are converted di

Register sizeof implementations exposed by the entry_point mechanism.

Returns a DataFrame with columns corresponding to each column or index level in columns_or_index. If included, the column corresponding

Helper function to place an object on a context stack

order ints before strings before nulls in 1d arrays

Sums elements of the input array, and returns the square(s) of that sum. Parameters ---------- a : array_like Input array.

Squares each element of the input array, and returns the sum(s) of that. Parameters ---------- a : array_like Input array.

The task for the i'th partition Parameters ---------- index: The index of the partition of this dataframe