Jiajun Yao b69b9299e6 [Core] Fix check failure RAY_CHECK(it != current_tasks_.end()); (#47659) 1 周之前
..
bisect 364e65ec96 [ci][bisect/1] add bisect for linux+windows tests (#45178) 5 月之前
hooks 5b0b51af37 [ci] restrict artifacts cleanup o linux only (#44802) 6 月之前
macos fbbd4433fb [ci] add keys for all flaky test jobs (#46075) 4 月之前
release a8caff68d7 [py12] build ray image (#46649) 2 月之前
release-automation 4f79361548 [release] Upload the binary without `.zip` extension (#46876) 2 月之前
.sunset_civ1_linux e27ffa0408 [civ1] leave a mark to indicate sunsetting (#42062) 10 月之前
README.md ee2a8da87a [ci] Move to new hierarchical docker structure + pipeline (#28641) 2 年之前
_forge.rayci.yml a8caff68d7 [py12] build ray image (#46649) 2 月之前
base.rayci.yml 779ee56092 [py312] ml gpu tests (#46970) 2 月之前
build.rayci.yml a8caff68d7 [py12] build ray image (#46649) 2 月之前
cicd.rayci.yml a8762f30bb [ci] migrate reef test to use test_in_docker (#45239) 5 月之前
copy_files.py 806f79a6f3 [ci] drop typings in copy_files.py (#40202) 1 年之前
core.rayci.yml b69b9299e6 [Core] Fix check failure RAY_CHECK(it != current_tasks_.end()); (#47659) 1 周之前
data.rayci.yml b6011591f7 [data] change data17 to datal (#47082) 2 月之前
kuberay.rayci.yml c94d8c3d2b [ci][microcheck] add a few cheap tests to microcheck (#45657) 4 月之前
lint.rayci.yml e32eb38e38 [doc][ml] add missing tune public API references + api policy lint checker (#47138) 1 月之前
linux_aarch64.rayci.yml 578d0408e8 [build] python 3.12 aarch images (#47733) 1 月之前
macos.rayci.yml 5347a9b1ad [ci] move macos to postmerge-macos pipeline (#43711) 7 月之前
ml.rayci.yml 779ee56092 [py312] ml gpu tests (#46970) 2 月之前
others.rayci.yml eac96b503a [py312] Fix or skip tests+examples for Tune dependencies that do not support py312 (#46761) 2 月之前
releasebuild.rayci.yml 746b55c4c7 [release] add release build + microbenchmark.was test to postmerge (#42621) 8 月之前
rllib.rayci.yml bb15a35bfd [rllib] remove tf2 tests on pipeline (#47304) 1 月之前
rllib_contrib.rayci.yml 72e8618e90 [ci] give rllib_contrib test group a sort key (#44009) 7 月之前
serve.rayci.yml d1ee314438 [py12] serve tests (#46671) 3 月之前
serverless.rayci.yml 98ea08ecc5 [ci] run windows tests on postmerge only (#43574) 7 月之前
windows.rayci.yml 42a4cb4f38 [ci] split window serve jobs into two (#46595) 3 月之前

README.md

Buildkite pipelines

This directory contains buildkite pipelines used to start CI tests.

Each step contains a buildkite step that is parsed and executed according to the Buildkite pipeline specification.

Conditions

An extra optional field conditions is defined, which includes conditions under which tests are run. The script ci/pipeline/determine_tests_to_run.py determines changed files in a PR and only kicks off tests that include at least one of the conditions. If no condition is specified, the test is always run.

A special case is the NO_WHEELS_REQUIRED condition. If this is present, it indicates that the test can be run with the latest available binaries - in this case the test can be started early, as it will re-use the latest branch image and only check out the current code revision in the PR. This early kick off will only trigger on PR builds, not on branch builds.

Pipelines

This directory should be considered with respect to the docker images located in ci/docker.

  • pipeline.build.yml contains jobs that require build dependencies. This includes all tests that re-build Ray (e.g. when switching Python versions). The tests are run on the build.Dockerfile image.
  • pipeline.test.yml contains jobs that only require an installed Ray and a small subset of dependencies, notably exlcuding ML libraries such as Tensorflow or Torch. The tests are run on the test.Dockerfile image.
  • pipeline.ml.yml contains jobs that require ML libraries Tensorflow and Torch to be available. The tests are run on the ml.Dockerfile image.
  • pipeline.gpu.yml contains jobs that require one GPU. The tests are run on the gpu.Dockerfile image.
  • pipeline.gpu.large.yml contains jobs that require multi-GPUs (currently 4). The tests are run on the gpu.Dockerfile image.