PandasOnDaskDataframePartitionManager

This class is the specific implementation of PandasDataframePartitionManager using Dask as the execution engine. This class is responsible for partition manipulation and applying a function to block/row/column partitions.

Public API

class modin.core.execution.dask.implementations.pandas_on_dask.partitioning.PandasOnDaskDataframePartitionManager

The class implements the interface in PandasDataframePartitionManager.

classmethod get_objects_from_partitions(partitions)

Get the objects wrapped by partitions in parallel.

This function assumes that each partition in partitions contains a single block.

Parameters

partitions (np.ndarray) – NumPy array with PandasDataframePartition-s.

Returns

The objects wrapped by partitions.

Return type

list

classmethod wait_partitions(partitions)

Wait on the objects wrapped by partitions in parallel, without materializing them.

This method will block until all computations in the list have completed.

Parameters

partitions (np.ndarray) – NumPy array with PandasDataframePartition-s.