Normalize a python object and merge all sub-graphs. - Replace ``Delayed`` with their keys - Convert literals to things the schedulers can han

Return the canonical name for a key. Handles user choice of '-' or '_' conventions by standardizing on whichever version was set first. If a

Build a :doc:`delayed` which waits until all chunks of the input collection(s) have been computed before returning None. Parameters -----

Concatenate arrays along an existing axis Given a sequence of dask Arrays form a new dask Array by stacking them along an existing dimen

Complex-conjugate all elements. Refer to :func:`dask.array.conj` for full documentation. See Also -------- dask.arra

Generic function for cumulative reduction Parameters ---------- func: callable Cumulative function like np.cumsum or np.cumprod

Decorator to attach original class's docstring to the wrapped method. The output structure will be: top line of docstring, disclaimer about this

Get elements from global config If ``override_with`` is not None this value will be passed straight back. Useful for getting kwarg defau

Infer the collection names from the dask keys, under the assumption that all keys are either tuples with matching first element, and that element

Map a function across all blocks of a dask array. Note that ``map_blocks`` will attempt to automatically determine the output array type by c

Apply Python function on each DataFrame partition. Parameters ---------- func : function Function applied to each partition.

Optimizes the DataFrame. Runs the optimizer with all steps over the DataFrame and wraps the result in a new DataFrame collection. Onl

High level optimization of stacked Blockwise layers For operations that have multiple Blockwise operations one after the other, like ``x.T +

Tokenize user input into GraphNode objects Note: This is similar to `convert_legacy_task` but does not - compare any values to a global set o

Computes a deterministic index mapping each record to a partition. Identical rows are mapped to the same partition. Parameters ----

Approximate row-wise and precise column-wise quantiles of DataFrame Parameters ---------- q : list/array of floats, default 0

Return elements from bag with probability of ``prob``. Parameters ---------- prob : float A float between 0 and 1

Read SQL query into a DataFrame. If neither ``divisions`` or ``npartitions`` is given, the memory footprint of the first few rows will b

Sign correction to ensure deterministic output from SVD. This function is useful for orienting eigenvectors such that they all lie in a share

Convert blocks of bytes to a dask.dataframe This accepts a list of lists of values of bytes where each list corresponds to one file, and the

Convert chunks from Dask Array into an SVG Image Parameters ---------- chunks: tuple size: int Rough size

Direct Tall-and-Skinny QR algorithm As presented in: A. Benson, D. Gleich, and J. Demmel. Direct QR factorizations for tall-and-

Returns the variance of the array elements, along given axis. Refer to :func:`dask.array.var` for full documentation. See Also

Visualize the profiling run in a bokeh plot. See also -------- dask.diagnostics.profile_visualize.visualize

Wait until computation has finished This is a compatibility alias for ``dask.distributed.wait``. If it is applied onto Dask collections witho

Recursively concatenate nested lists of arrays along axes Each entry in axes corresponds to each level of the nested list. The length of axe

Check if an fsspec file-system is local

Create empty DataFrame or Series which has correct dtype

Tensor operation: Generalized inner and outer products A broad class of blocked algorithms and patterns can be specified with a concise multi

Find block dimensions from arguments Parameters ---------- argpairs : iterable name, ijk index pairs numblocks : dict

Compute the current divisions of the DataFrame. This method triggers immediate computation. If you find yourself running this command

Generate descriptive statistics. Dask computes percentiles (used for the ``25%``, ``50%``, and ``75%`` statistics) using an **approxi

Render a task graph using dot. If `filename` is not None, write a file to disk with the specified name and extension. If no extension is

Count number of occurrences of each distinct element. >>> import dask.bag as db >>> b = db.from_sequence(['Alice', 'Bob', 'Alice'])

Read any sliceable array into a Dask Dataframe Uses getitem syntax to pull slices out of the array. The array need not be a NumPy array but

Create Dask DataFrame from many Dask Delayed objects .. warning:: ``from_delayed`` should only be used if the objects that create

Create a DataFrame collection from a custom function map. ``from_map`` is the preferred option when reading from data sources that are not na

Fuse stacked slices together Fuse a pair of repeated slices into a single slice: >>> fuse_slice(slice(1000, 2000), slice(10, 15)) slice(

Get an instance of the appropriate lock for a certain situation based on scheduler used.

Version of inspect.getargspec that works with partial and warps.

Same as hash_buffer, but returns its result in hex-encoded form.

Is x hashable? Examples -------- >>> ishashable(1) True >>> ishashable([1]) False See Also -------- iskey

Returns the keys in `keys` that are also in `tasks` Examples -------- >>> inc = lambda x: x + 1 >>> add = lambda x, y: x + y >>>

Maximum element

Provide an informative message when the user is asked to provide metadata

Return the minimum along a given axis. Refer to :func:`dask.array.min` for full documentation. See Also -------- das