Generic Ray-based members

Objects which are backend-agnostic but require specific Ray implementation are placed in modin.engines.ray.generic.

Their purpose is to implement certain parallel I/O operations and to serve as a foundation for building backend-specific objects:

class modin.engines.ray.generic.io.RayIO

Base class for doing I/O operations over Ray.

classmethod to_csv(qc, **kwargs)

Write records stored in the qc to a CSV file.

Parameters
  • qc (BaseQueryCompiler) – The query compiler of the Modin dataframe that we want to run to_csv on.

  • **kwargs (dict) – Parameters for pandas.to_csv(**kwargs).

classmethod to_sql(qc, **kwargs)

Write records stored in the qc to a SQL database.

Parameters
  • qc (BaseQueryCompiler) – The query compiler of the Modin dataframe that we want to run to_sql on.

  • **kwargs (dict) – Parameters for pandas.to_sql(**kwargs).

class modin.engines.ray.generic.frame.partition_manager.GenericRayFramePartitionManager

The class implements the interface in PandasFramePartitionManager.

classmethod to_numpy(partitions, **kwargs)

Convert partitions into a NumPy array.

Parameters
  • partitions (NumPy array) – A 2-D array of partitions to convert to local NumPy array.

  • **kwargs (dict) – Keyword arguments to pass to each partition .to_numpy() call.

Returns

Return type

NumPy array