Generic Ray-based members

Objects which are storage format agnostic but require specific Ray implementation are placed in modin.core.execution.ray.generic.

Their purpose is to implement certain parallel I/O operations and to serve as a foundation for building storage format specific objects:

class modin.core.execution.ray.generic.io.RayIO

Base class for doing I/O operations over Ray.

class modin.core.execution.ray.generic.partitioning.GenericRayDataframePartitionManager

The class implements the interface in PandasDataframePartitionManager.

classmethod to_numpy(partitions, **kwargs)

Convert partitions into a NumPy array.

Parameters

• partitions (NumPy array) – A 2-D array of partitions to convert to local NumPy array.

• **kwargs (dict) – Keyword arguments to pass to each partition .to_numpy() call.

Return type

NumPy array