Justin Yu 2e37a2af45 [Templates] Unify the batch inference template with an existing Data example (#36401) 1 年之前
..
01_batch_inference 2e37a2af45 [Templates] Unify the batch inference template with an existing Data example (#36401) 1 年之前
02_many_model_training 3e5cd965f1 [Templates] Update for ray 2.5.0 (#36367) 1 年之前
03_serving_stable_diffusion 3e5cd965f1 [Templates] Update for ray 2.5.0 (#36367) 1 年之前
configs 11370b63a9 [Templates] Remove `runtime_env` usage and use a custom docker image when needed (#35475) 1 年之前
testing 3e5cd965f1 [Templates] Update for ray 2.5.0 (#36367) 1 年之前
README.md 11370b63a9 [Templates] Remove `runtime_env` usage and use a custom docker image when needed (#35475) 1 年之前
templates.yaml 3e5cd965f1 [Templates] Update for ray 2.5.0 (#36367) 1 年之前

README.md

Ray Starter Templates

These templates are a set of minimal examples that are quick and easy to run and customize.

Although the templates may include some machine learning framework-specific code, the individual code blocks are meant to be swapped in with your own application logic. The templates just serve as skeletons that showcase popular applications of Ray.

Running on a Ray Cluster

Coming soon...

Contributing Guide

To add a template:

  1. Add your template as a directory somewhere in doc/source/templates.

    For example:

    ray/
        doc/source/templates/
            <name-of-your-template>/
                README.md
                <name-of-your-template>.ipynb
                requirements.txt  (Optional)
            templates.yaml
    

    Your template does not need to be a Jupyter notebook. It can also be presented as a Python script with README instructions of how to run.

    1. Add a release test for the template in release/release_tests.yaml (for both AWS and GCE).

    See the section on workspace templates for an example. Note that the cluster env and compute config are a little different for release tests. Use the files in the doc/source/templates/testing/release folder.

    The release test compute configs contain placeholders for regions and cloud ids that our CI infra will fill in. The cluster env builds a nightly docker image with all the required dependencies.

    1. Add an entry to doc/source/templates/templates.yaml that links to your template.

    See the top of the templates.yaml file for something to copy-paste and fill in your own values.

    When you specify the template's compute config, see doc/source/templates/configs for shared configs. You can also create custom compute configs (of the same format as these shared ones).

    For handling dependencies:

    • If your template requires any special dependencies that are not included in a base image that you chose, be sure to list and provide instructions to install the necessary dependencies within the notebook. See 02_many_model_training for an example.

    • If your template requires a custom docker image, be sure to mention this in the README and link the docker image URL somewhere. See 03_serving_stable_diffusion for an example.

    1. Run a validation script on templates.yaml to make sure that the paths you specified are all valid and all yamls are properly formatted.

    Note: This will also run in CI, but you can check quickly by running the validation script.

    $ python doc/source/templates/testing/validate.py
    Success!
    
  2. Success! Your template is ready for review.