-
Notifications
You must be signed in to change notification settings - Fork 798
[CI] Backward-compatibility testing against sycl-rel-6_3
#19761
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Looks like we have three runners with `pvc` label and only one of them has `build` on it too (and we have three more non-`pvc` `build` runners), so I wouldn't expect `pvc` tasks to be a bottleneck.
@@ -83,7 +83,8 @@ jobs: | |||
name: Read compatibility testing exclude list | |||
runs-on: [Linux, build] | |||
outputs: | |||
FILTER: ${{ steps.result.outputs.FILTER }} | |||
FILTER_6_2: ${{ steps.result.outputs.FILTER_6_2 }} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
any way we could call this from a matrix so dont ned to add a new variable for every release?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't think we want that actually. Matrix would result in multiple jobs spawning instead of allocating a runner just once here. Also, we will be dropping those with every major/abi-breaking release, so it won't grow that much.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
got it, thanks
Failures are unrelated - those jobs weren't affected by the changes. SPIR-V Backend looks flaky and BMG was infrastructural. |
intel#19719 and intel#19761 added pre-commit jobs to run E2E tests pre-built with latest "open-source" releases against the newly built sycl-toolchain libraries. Those can fail if either an actual break is happenning or if the test was doing some `FileCheck`ing and that output has changed in some way (which might not be an actual ABI break). However, I think the testing is still good enough to require an explicit approvals by folks in charge of ABI breaking changes. For the case of just output change the author should be able to convince owners that the change isn't ABI-breaking relatively easily.
…19820) #19719 and #19761 added pre-commit jobs to run E2E tests pre-built with latest "open-source" releases against the newly built sycl-toolchain libraries. Those can fail if either an actual break is happenning or if the test was doing some `FileCheck`ing and that output has changed in some way (which might not be an actual ABI break). However, I think the testing is still good enough to require an explicit approvals by folks in charge of ABI breaking changes. For the case of just output change the author should be able to convince owners that the change isn't ABI-breaking relatively easily.
Looks like we have three runners with
pvc
label and only one of them hasbuild
on it too (and we have three more non-pvc
build
runners), so I wouldn't expectpvc
tasks to be a bottleneck.