Amog Kamsetty c63e429a90 [CI] Don't run Docker CI on every PR (#32886) | 1 年之前 | |
---|---|---|
.. | ||
hooks | 503e197f8c [CI] Upload macOS bazel test files (#25744) | 2 年之前 |
README.md | ee2a8da87a [ci] Move to new hierarchical docker structure + pipeline (#28641) | 2 年之前 |
copy_files.py | 2b270fd9cb apply isort uniformly for a subset of directories (#25824) | 2 年之前 |
pipeline.arm64.yml | c63e429a90 [CI] Don't run Docker CI on every PR (#32886) | 1 年之前 |
pipeline.build.yml | c63e429a90 [CI] Don't run Docker CI on every PR (#32886) | 1 年之前 |
pipeline.gpu.yml | ed3f3c0822 [RLlib] PolicyMap LRU cache enhancements: Swap out policies (instead of GC'ing and recreating) + use Ray object store (instead of file system). (#29513) | 1 年之前 |
pipeline.gpu_large.yml | e314cf2bf5 [CI] Update horovod, install after `ml_docker` (#30919) | 1 年之前 |
pipeline.macos.yml | bf5e721780 [core] Add opt-in flag for Windows and OSX clusters, update ray start output to match docs (#32409) | 1 年之前 |
pipeline.ml.yml | 4cc3a537c0 [Datasets] Streaming executor fixes #3 (#32836) | 1 年之前 |
pipeline.test.yml | 39a730c21a [air] Run some release tests as smoke tests in CI (#29173) | 2 年之前 |
pipeline.windows.yml | 64c8f43451 [core]Update boost in ray deps (#32550) | 1 年之前 |
This directory contains buildkite pipelines used to start CI tests.
Each step contains a buildkite step that is parsed and executed according to the Buildkite pipeline specification.
An extra optional field conditions
is defined, which includes conditions under which tests are run.
The script ci/pipeline/determine_tests_to_run.py
determines changed files in a PR and only kicks off
tests that include at least one of the conditions. If no condition is specified, the test is always run.
A special case is the NO_WHEELS_REQUIRED
condition. If this is present, it indicates that the test can
be run with the latest available binaries - in this case the test can be started early, as it will re-use
the latest branch image and only check out the current code revision in the PR. This early kick off will
only trigger on PR builds, not on branch builds.
This directory should be considered with respect to the docker images located in ci/docker
.
pipeline.build.yml
contains jobs that require build dependencies. This includes all tests that re-build
Ray (e.g. when switching Python versions). The tests are run on the build.Dockerfile
image.pipeline.test.yml
contains jobs that only require an installed Ray and a small subset of dependencies,
notably exlcuding ML libraries such as Tensorflow or Torch. The tests are run on the test.Dockerfile
image.pipeline.ml.yml
contains jobs that require ML libraries Tensorflow and Torch to be available. The tests
are run on the ml.Dockerfile
image.pipeline.gpu.yml
contains jobs that require one GPU. The tests are run on the gpu.Dockerfile
image.pipeline.gpu.large.yml
contains jobs that require multi-GPUs (currently 4). The tests are run on the gpu.Dockerfile
image.