Running Tests on CI¶
Contributors with write access to the repository can trigger full runs in the
same CI systems used to produce results for wpt.fyi. The runs
are triggered by pushing to branch names on the form triggers/$browser_$channel
and the results will be automatically submitted to wpt.fyi.
This is useful when making infrastructure changes that could affect very many tests, in order to avoid regressions.
Note: Full runs use a lot of CI resources, so please take care to not trigger them more than necessary.
Instructions:
Base your changes on a commit for which there are already results in wpt.fyi.
Determine which branch name to push to by looking for
refs/heads/triggers/
in.azure-pipelines.yml
and.taskcluster.yml
. For example, to trigger a full run of Safari Technology Preview, the branch name istriggers/safari_preview
.Force push to the branch, for example:
git push --force-with-lease origin HEAD:triggers/safari_preview
. The--force-with-lease
argument is to detect if someone else has just pushed. When this happens wait for the checkout step of their triggered run to finish before you force push again.
You can see if the run started from the commit status on GitHub’s commits listing (example) and if successful the results will show up on wpt.fyi within 10 minutes (example).