Kind of related to tektoncd/plumbing#2156, it would reduce cost and be slightly better integrated if we were switching to use GitHub workflow for this.

See tektoncd/pipeline: https://github.com/tektoncd/pipeline/blob/main/.github/workflows/e2e-matrix.yml.