Jiajun Yao b69b9299e6 [Core] Fix check failure RAY_CHECK(it != current_tasks_.end()); (#47659) 1 week ago
..
bisect 364e65ec96 [ci][bisect/1] add bisect for linux+windows tests (#45178) 5 months ago
hooks 5b0b51af37 [ci] restrict artifacts cleanup o linux only (#44802) 6 months ago
macos fbbd4433fb [ci] add keys for all flaky test jobs (#46075) 4 months ago
release a8caff68d7 [py12] build ray image (#46649) 2 months ago
release-automation 4f79361548 [release] Upload the binary without `.zip` extension (#46876) 2 months ago
.sunset_civ1_linux e27ffa0408 [civ1] leave a mark to indicate sunsetting (#42062) 10 months ago
README.md ee2a8da87a [ci] Move to new hierarchical docker structure + pipeline (#28641) 2 years ago
_forge.rayci.yml a8caff68d7 [py12] build ray image (#46649) 2 months ago
base.rayci.yml 779ee56092 [py312] ml gpu tests (#46970) 2 months ago
build.rayci.yml a8caff68d7 [py12] build ray image (#46649) 2 months ago
cicd.rayci.yml a8762f30bb [ci] migrate reef test to use test_in_docker (#45239) 5 months ago
copy_files.py 806f79a6f3 [ci] drop typings in copy_files.py (#40202) 1 year ago
core.rayci.yml b69b9299e6 [Core] Fix check failure RAY_CHECK(it != current_tasks_.end()); (#47659) 1 week ago
data.rayci.yml b6011591f7 [data] change data17 to datal (#47082) 2 months ago
kuberay.rayci.yml c94d8c3d2b [ci][microcheck] add a few cheap tests to microcheck (#45657) 4 months ago
lint.rayci.yml e32eb38e38 [doc][ml] add missing tune public API references + api policy lint checker (#47138) 1 month ago
linux_aarch64.rayci.yml 578d0408e8 [build] python 3.12 aarch images (#47733) 1 month ago
macos.rayci.yml 5347a9b1ad [ci] move macos to postmerge-macos pipeline (#43711) 7 months ago
ml.rayci.yml 779ee56092 [py312] ml gpu tests (#46970) 2 months ago
others.rayci.yml eac96b503a [py312] Fix or skip tests+examples for Tune dependencies that do not support py312 (#46761) 2 months ago
releasebuild.rayci.yml 746b55c4c7 [release] add release build + microbenchmark.was test to postmerge (#42621) 8 months ago
rllib.rayci.yml bb15a35bfd [rllib] remove tf2 tests on pipeline (#47304) 1 month ago
rllib_contrib.rayci.yml 72e8618e90 [ci] give rllib_contrib test group a sort key (#44009) 7 months ago
serve.rayci.yml d1ee314438 [py12] serve tests (#46671) 3 months ago
serverless.rayci.yml 98ea08ecc5 [ci] run windows tests on postmerge only (#43574) 7 months ago
windows.rayci.yml 42a4cb4f38 [ci] split window serve jobs into two (#46595) 3 months ago

README.md

Buildkite pipelines

This directory contains buildkite pipelines used to start CI tests.

Each step contains a buildkite step that is parsed and executed according to the Buildkite pipeline specification.

Conditions

An extra optional field conditions is defined, which includes conditions under which tests are run. The script ci/pipeline/determine_tests_to_run.py determines changed files in a PR and only kicks off tests that include at least one of the conditions. If no condition is specified, the test is always run.

A special case is the NO_WHEELS_REQUIRED condition. If this is present, it indicates that the test can be run with the latest available binaries - in this case the test can be started early, as it will re-use the latest branch image and only check out the current code revision in the PR. This early kick off will only trigger on PR builds, not on branch builds.

Pipelines

This directory should be considered with respect to the docker images located in ci/docker.

  • pipeline.build.yml contains jobs that require build dependencies. This includes all tests that re-build Ray (e.g. when switching Python versions). The tests are run on the build.Dockerfile image.
  • pipeline.test.yml contains jobs that only require an installed Ray and a small subset of dependencies, notably exlcuding ML libraries such as Tensorflow or Torch. The tests are run on the test.Dockerfile image.
  • pipeline.ml.yml contains jobs that require ML libraries Tensorflow and Torch to be available. The tests are run on the ml.Dockerfile image.
  • pipeline.gpu.yml contains jobs that require one GPU. The tests are run on the gpu.Dockerfile image.
  • pipeline.gpu.large.yml contains jobs that require multi-GPUs (currently 4). The tests are run on the gpu.Dockerfile image.