Justin Yu 2e37a2af45 [Templates] Unify the batch inference template with an existing Data example (#36401) | 1 年之前 | |
---|---|---|
.. | ||
01_batch_inference | 2e37a2af45 [Templates] Unify the batch inference template with an existing Data example (#36401) | 1 年之前 |
02_many_model_training | 3e5cd965f1 [Templates] Update for ray 2.5.0 (#36367) | 1 年之前 |
03_serving_stable_diffusion | 3e5cd965f1 [Templates] Update for ray 2.5.0 (#36367) | 1 年之前 |
configs | 11370b63a9 [Templates] Remove `runtime_env` usage and use a custom docker image when needed (#35475) | 1 年之前 |
testing | 3e5cd965f1 [Templates] Update for ray 2.5.0 (#36367) | 1 年之前 |
README.md | 11370b63a9 [Templates] Remove `runtime_env` usage and use a custom docker image when needed (#35475) | 1 年之前 |
templates.yaml | 3e5cd965f1 [Templates] Update for ray 2.5.0 (#36367) | 1 年之前 |
These templates are a set of minimal examples that are quick and easy to run and customize.
Although the templates may include some machine learning framework-specific code, the individual code blocks are meant to be swapped in with your own application logic. The templates just serve as skeletons that showcase popular applications of Ray.
Coming soon...
To add a template:
Add your template as a directory somewhere in doc/source/templates
.
For example:
ray/
doc/source/templates/
<name-of-your-template>/
README.md
<name-of-your-template>.ipynb
requirements.txt (Optional)
templates.yaml
Your template does not need to be a Jupyter notebook. It can also be presented as a
Python script with README
instructions of how to run.
release/release_tests.yaml
(for both AWS and GCE).See the section on workspace templates for an example. Note that the cluster env and
compute config are a little different for release tests. Use the files in the
doc/source/templates/testing/release
folder.
The release test compute configs contain placeholders for regions and cloud ids that our CI infra will fill in. The cluster env builds a nightly docker image with all the required dependencies.
doc/source/templates/templates.yaml
that links to your template.See the top of the templates.yaml
file for something to copy-paste and fill in your own values.
When you specify the template's compute config, see doc/source/templates/configs
for shared configs. You can also create custom compute configs (of the same format as these shared ones).
For handling dependencies:
If your template requires any special dependencies that are not included in a
base image that you chose, be sure to list and provide instructions to install
the necessary dependencies within the notebook.
See 02_many_model_training
for an example.
If your template requires a custom docker image, be sure to mention this in the
README
and link the docker image URL somewhere. See 03_serving_stable_diffusion
for an example.
templates.yaml
to make sure that the paths you specified are all valid and all yamls are properly formatted.Note: This will also run in CI, but you can check quickly by running the validation script.
$ python doc/source/templates/testing/validate.py
Success!
Success! Your template is ready for review.