Generic Ray-based members¶
Objects which are backend-agnostic but require specific Ray implementation
are placed in modin.engines.ray.generic
.
Their purpose is to implement certain parallel I/O operations and to serve as a foundation for building backend-specific objects:
GenericRayFramePartitionManager
– implements parallelto_numpy()
.
- class modin.engines.ray.generic.io.RayIO¶
Base class for doing I/O operations over Ray.
- classmethod to_csv(qc, **kwargs)¶
Write records stored in the qc to a CSV file.
- Parameters
qc (BaseQueryCompiler) – The query compiler of the Modin dataframe that we want to run
to_csv
on.**kwargs (dict) – Parameters for
pandas.to_csv(**kwargs)
.
- classmethod to_sql(qc, **kwargs)¶
Write records stored in the qc to a SQL database.
- Parameters
qc (BaseQueryCompiler) – The query compiler of the Modin dataframe that we want to run
to_sql
on.**kwargs (dict) – Parameters for
pandas.to_sql(**kwargs)
.
- class modin.engines.ray.generic.frame.partition_manager.GenericRayFramePartitionManager¶
The class implements the interface in PandasFramePartitionManager.
- classmethod to_numpy(partitions, **kwargs)¶
Convert partitions into a NumPy array.
- Parameters
partitions (NumPy array) – A 2-D array of partitions to convert to local NumPy array.
**kwargs (dict) – Keyword arguments to pass to each partition
.to_numpy()
call.
- Returns
- Return type
NumPy array