Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Ray provides a scheduler for Dask (i.e. dask-on-ray) which allows you to build data analyses using Dask’s collections and execute the underlying tasks on a Ray cluster.

You can set up either a local Ray cluster or a pre-defined cluster across multiple nodes. 

To enable dask-on-ray, simply call the helper  "enable_dask_on_ray()" after inilizing initialising the ray cluster.

import ray
from ray.util.dask import ray_dask_get, enable_dask_on_ray, disable_dask_on_ray

ray.init() # local Ray cluster.
#ray.init(address='auto') # connect to the predefinedpre-defined Ray cluster.

enable_dask_on_ray()

...