Temporarily set configuration values within a context manager Parameters ---------- arg : mapping or None, optional A mapping of

Parallel Dask Array A parallel nd-array comprised of many numpy arrays arranged in a grid. This constructor is for advanced uses only. For

Task graph composed of layers of dependent subgraphs This object encodes a Dask task graph that is composed of layers of dependent subgraphs,

Represents a value to be computed by dask. Equivalent to the output from a single key in a dask graph.

Parallel collection of Python objects Examples -------- Create Bag from sequence >>> import dask.bag as db >>> b = db.from_seque

Abstract repartitioning expression

Fully materialized layer of `Layer` Parameters ---------- mapping: Mapping The mapping between keys and tasks, typically a dask g

Column Selection

Simple single dispatch.

A progress bar for dask. Parameters ---------- minimum : int, optional Minimum time threshold in seconds before displaying a prog

Encapsulates properties of a family of columns with the same dtype. Different method can be specified for integer dtype ("poisson", "uniform",

Defines a dataset with random data, such as which columns and data types to generate Notes ----- This API is still experimental, and will

A Serializable per-process Lock This wraps a normal ``threading.Lock`` object and satisfies the same interface. However, this lock can also

A sequence of expressions This is used to be able to optimize multiple collections combined, e.g. when being computed simultaneously with ``d

Column Assignment

Select one or more partitions

Variant of operator.itemgetter that supports equality tests

Use cache for computation Examples -------- >>> cache = Cache(1e9) # doctest: +SKIP The cache can be used locally as a context man

Base class for using the callback mechanism Create a callback with functions of the following signatures: >>> def start(dsk): ... pa

Traverser interface for tasks. Class for storing the state while performing a preorder-traversal of a task. Parameters ----------

Tensor Operation This is a lazily constructed mapping for tensor operation graphs. This defines a dictionary using an operation and an indexi

Column Selection

Merge / join two dataframes This is an abstract class. It will be transformed into a concrete implementation before graph construction.

A profiler for resource use. Records the following each timestep 1. Time in seconds since the epoch 2. Memory usage in MB

Helper class to wrap backend data The primary purpose of this class is to provide caching outside the ``FromPandas`` class.

Produce chunk shapes given a chunk index

Produce slice(s) into the full-sized array given a chunk index

NotImplementedError and AttributeError

A profiler for dask execution at the scheduler cache level. Records the following information for each task: 1. Key 2. Task

Simple backend dispatch for collection-creation functions

Limited size mapping, evicting the least recently looked-up key when full

Returns a tuple of partition lengths

Repartition to specific divisions

Reset the index of a Series or DataFrame

Abstract shuffle class Parameters ---------- frame: Expr The DataFrame-like expression to shuffle. partitioning_index: str, l

A small serializable object to wrap literal values without copying

If serialized, will return non-buffered partd. Otherwise returns a buffered partd

Return a callable object that calls the given method on its operand. Unlike the builtin `operator.methodcaller`, instances of this class are

Context manager that removes irrelevant stack elements from traceback. * omits frames from modules that match `admin.traceback.shorten` * alw

Partition-wise aggregation component of `ApplyConcatApply` This class is used within `ApplyConcatApply._lower`. See Also -------- App

Simple HighLevelGraph array overlap layer. Lazily computed High-level graph layer for a array overlap operations. Parameters ----------

A good example of writing a trivial blockwise operation

An array-like interface to the blocks of an array. ``BlockView`` provides an array-like interface to the blocks of a dask array. Numpy-style

Dictionary-based Blockwise-IO argument This is a dictionary-backed instance of ``BlockwiseDep``. The purpose of this class is to simplify the

Custom property-like object (descriptor) for caching accessors. Parameters ---------- name : str The namespace this will be

A class that "mocks" ndarray by encapsulating an ndarray and using protocols to "look like" an ndarray. Basically tests whether Dask work