How to use the modin.engines.dask.pandas_on_dask_futures.frame.partition.PandasOnDaskFramePartition function in modin

To help you get started, we’ve selected a few modin examples, based on popular ways it is used in public projects.

Secure your code as it's written. Use Snyk Code to scan source code in minutes - no build needed - and fix issues immediately.

github modin-project / modin / modin / engines / dask / pandas_on_dask_futures / frame / partition.py View on Github external
"""Apply some callable function to the data in this partition.

        Note: It is up to the implementation how kwargs are handled. They are
            an important part of many implementations. As of right now, they
            are not serialized.

        Args:
            func: The lambda to apply (may already be correctly formatted)

        Returns:
             A new `BaseFramePartition` containing the object that has had `func`
             applied to it.
        """
        call_queue = self.call_queue + [[func, kwargs]]
        future = self.client.submit(apply_list_of_funcs, call_queue, self.future)
        return PandasOnDaskFramePartition(future)
github modin-project / modin / modin / engines / dask / pandas_on_dask_futures / frame / partition.py View on Github external
def add_to_apply_calls(self, func, **kwargs):
        return PandasOnDaskFramePartition(
            self.future, call_queue=self.call_queue + [[func, kwargs]]
        )
github modin-project / modin / modin / engines / dask / pandas_on_dask_futures / frame / partition.py View on Github external
def __copy__(self):
        return PandasOnDaskFramePartition(
            self.future, self._length_cache, self._width_cache
        )