advanced.rst 833 B

1234567891011121314151617
  1. Advanced Topics
  2. ===============
  3. Skipping Checkpoints
  4. --------------------
  5. Ray Workflows provides strong fault tolerance and exactly-once execution semantics by checkpointing. However, checkpointing could be time consuming, especially when you have large inputs and outputs for workflow tasks. When exactly-once execution semantics is not required, you can skip some checkpoints to speed up your workflow.
  6. Checkpoints can be skipped by specifying ``checkpoint=False``:
  7. .. code-block:: python
  8. data = read_data.options(**workflow.options(checkpoint=False)).bind(10)
  9. This example skips checkpointing the output of ``read_data``. During recovery, ``read_data`` would be executed again if recovery requires its output.
  10. If the output of a task is another task (i.e., for dynamic workflows), we skip checkpointing the entire task.