AuroraMiddleware/skia2
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
344ec42f60
skia2/infra/bots/gen_tasks.go

917 lines
34 KiB
Go
Raw Normal View History

[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
// Copyright 2016 The Chromium Authors. All rights reserved.
// Use of this source code is governed by a BSD-style license that can be
// found in the LICENSE file.
package main
/*
Generate the tasks.json file.
*/
import (
"encoding/json"
"fmt"
"os"
"path"
"sort"
"strings"
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
"time"
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
"github.com/skia-dev/glog"
"go.skia.org/infra/go/util"
"go.skia.org/infra/task_scheduler/go/specs"
)
const (
Fix stragling Ubuntu dimensions BUG=skia: Change-Id: I2328190da7fc1f2db10bb87684fb3a3e95751ec5 Reviewed-on: https://skia-review.googlesource.com/6111 Reviewed-by: Eric Boren <borenet@google.com> Commit-Queue: Kevin Lubick <kjlubick@google.com>
2016-12-15 15:45:08 +00:00
DEFAULT_OS = DEFAULT_OS_LINUX
DEFAULT_OS_LINUX = "Ubuntu-14.04"
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
// Pool for Skia bots.
POOL_SKIA = "Skia"
// Name prefix for upload jobs.
PREFIX_UPLOAD = "Upload"
)
var (
// "Constants"
// Top-level list of all jobs to run at each commit.
JOBS = []string{
[nobuildbot] Explicitly name all jobs This makes it clearer which jobs we're running when looking at gen_tasks.go. Doesn't actually change any behavior. BUG=skia: Change-Id: Ie4fe639552bd673d3a605e03782a68b5e013cf1d Reviewed-on: https://skia-review.googlesource.com/4990 Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-18 13:24:21 +00:00
"Build-Mac-Clang-Arm7-Debug-iOS",
"Build-Mac-Clang-Arm7-Release-iOS",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Build-Mac-Clang-arm64-Debug-Android",
Add GN iOS builder. This gets up a bot to build for iOS via GN as much as we can right now. This is unlikely to be the long term structure of the iOS bots... by the time we add Test/Perf bots we'll likely need to have a gn_ios_flavor.py. But for now, this keeps the GN iOS build such as it is working. GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4457 Change-Id: Ideb10ae3f4ab5530ad153237a343dd5c0e7dd02f Reviewed-on: https://skia-review.googlesource.com/4457 Commit-Queue: Mike Klein <mtklein@chromium.org> Reviewed-by: Eric Boren <borenet@google.com>
2016-11-07 20:38:48 +00:00
"Build-Mac-Clang-arm64-Debug-GN_iOS",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Build-Mac-Clang-x86_64-Debug",
gen_tasks.go: Assert that all compile tasks are in the JOBS list Rather than auto-adding the Job, assert that it's listed. This enforces that the JOBS list is accurate. Add all missing compile Jobs to the list. BUG=skia: Change-Id: Ic7a90165ccac36baa52a4674798977021d6812d7 Reviewed-on: https://skia-review.googlesource.com/5848 Reviewed-by: Mike Klein <mtklein@chromium.org> Commit-Queue: Eric Boren <borenet@google.com>
2016-12-12 19:30:12 +00:00
"Build-Mac-Clang-x86_64-Debug-CommandBuffer",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Build-Mac-Clang-x86_64-Release",
gen_tasks.go: Assert that all compile tasks are in the JOBS list Rather than auto-adding the Job, assert that it's listed. This enforces that the JOBS list is accurate. Add all missing compile Jobs to the list. BUG=skia: Change-Id: Ic7a90165ccac36baa52a4674798977021d6812d7 Reviewed-on: https://skia-review.googlesource.com/5848 Reviewed-by: Mike Klein <mtklein@chromium.org> Commit-Queue: Eric Boren <borenet@google.com>
2016-12-12 19:30:12 +00:00
"Build-Mac-Clang-x86_64-Release-CommandBuffer",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Build-Ubuntu-Clang-arm-Debug-Android",
"Build-Ubuntu-Clang-arm-Release-Android",
"Build-Ubuntu-Clang-arm64-Debug-Android",
"Build-Ubuntu-Clang-arm64-Debug-Android_FrameworkDefs",
"Build-Ubuntu-Clang-arm64-Debug-Android_Vulkan",
"Build-Ubuntu-Clang-arm64-Release-Android",
"Build-Ubuntu-Clang-arm64-Release-Android_Vulkan",
"Build-Ubuntu-Clang-mips64el-Debug-Android",
"Build-Ubuntu-Clang-mips64el-Release-Android",
"Build-Ubuntu-Clang-mipsel-Debug-Android",
"Build-Ubuntu-Clang-mipsel-Release-Android",
"Build-Ubuntu-Clang-x64-Debug-Android",
"Build-Ubuntu-Clang-x64-Release-Android",
"Build-Ubuntu-Clang-x86-Debug-Android",
"Build-Ubuntu-Clang-x86-Debug-Android_Vulkan",
"Build-Ubuntu-Clang-x86-Release-Android",
"Build-Ubuntu-Clang-x86-Release-Android_Vulkan",
"Build-Ubuntu-Clang-x86_64-Debug",
gen_tasks.go: Assert that all compile tasks are in the JOBS list Rather than auto-adding the Job, assert that it's listed. This enforces that the JOBS list is accurate. Add all missing compile Jobs to the list. BUG=skia: Change-Id: Ic7a90165ccac36baa52a4674798977021d6812d7 Reviewed-on: https://skia-review.googlesource.com/5848 Reviewed-by: Mike Klein <mtklein@chromium.org> Commit-Queue: Eric Boren <borenet@google.com>
2016-12-12 19:30:12 +00:00
"Build-Ubuntu-Clang-x86_64-Debug-ASAN",
"Build-Ubuntu-Clang-x86_64-Debug-MSAN",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Build-Ubuntu-Clang-x86_64-Release",
gen_tasks.go: Assert that all compile tasks are in the JOBS list Rather than auto-adding the Job, assert that it's listed. This enforces that the JOBS list is accurate. Add all missing compile Jobs to the list. BUG=skia: Change-Id: Ic7a90165ccac36baa52a4674798977021d6812d7 Reviewed-on: https://skia-review.googlesource.com/5848 Reviewed-by: Mike Klein <mtklein@chromium.org> Commit-Queue: Eric Boren <borenet@google.com>
2016-12-12 19:30:12 +00:00
"Build-Ubuntu-Clang-x86_64-Release-TSAN",
[nobuildbot] Migrate all Linux GCE bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4994 Change-Id: Ib63f36b3803117d5357c8e70c572653afd151abe Reviewed-on: https://skia-review.googlesource.com/4994 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-18 18:10:51 +00:00
"Build-Ubuntu-GCC-x86-Debug",
"Build-Ubuntu-GCC-x86-Release",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Build-Ubuntu-GCC-x86_64-Debug",
[nobuildbot] Migrate all Linux GCE bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4994 Change-Id: Ib63f36b3803117d5357c8e70c572653afd151abe Reviewed-on: https://skia-review.googlesource.com/4994 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-18 18:10:51 +00:00
"Build-Ubuntu-GCC-x86_64-Debug-NoGPU",
gen_tasks.go: Assert that all compile tasks are in the JOBS list Rather than auto-adding the Job, assert that it's listed. This enforces that the JOBS list is accurate. Add all missing compile Jobs to the list. BUG=skia: Change-Id: Ic7a90165ccac36baa52a4674798977021d6812d7 Reviewed-on: https://skia-review.googlesource.com/5848 Reviewed-by: Mike Klein <mtklein@chromium.org> Commit-Queue: Eric Boren <borenet@google.com>
2016-12-12 19:30:12 +00:00
"Build-Ubuntu-GCC-x86_64-Debug-SK_USE_DISCARDABLE_SCALEDIMAGECACHE",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Build-Ubuntu-GCC-x86_64-Release",
[nobuildbot] Migrate all Linux GCE bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4994 Change-Id: Ib63f36b3803117d5357c8e70c572653afd151abe Reviewed-on: https://skia-review.googlesource.com/4994 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-18 18:10:51 +00:00
"Build-Ubuntu-GCC-x86_64-Release-ANGLE",
gen_tasks.go: Assert that all compile tasks are in the JOBS list Rather than auto-adding the Job, assert that it's listed. This enforces that the JOBS list is accurate. Add all missing compile Jobs to the list. BUG=skia: Change-Id: Ic7a90165ccac36baa52a4674798977021d6812d7 Reviewed-on: https://skia-review.googlesource.com/5848 Reviewed-by: Mike Klein <mtklein@chromium.org> Commit-Queue: Eric Boren <borenet@google.com>
2016-12-12 19:30:12 +00:00
"Build-Ubuntu-GCC-x86_64-Release-Fast",
[nobuildbot] Migrate all Linux GCE bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4994 Change-Id: Ib63f36b3803117d5357c8e70c572653afd151abe Reviewed-on: https://skia-review.googlesource.com/4994 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-18 18:10:51 +00:00
"Build-Ubuntu-GCC-x86_64-Release-Mesa",
"Build-Ubuntu-GCC-x86_64-Release-NoGPU",
"Build-Ubuntu-GCC-x86_64-Release-PDFium",
Add PDFium_SkiaPaths bot BUG=skia:6049 Change-Id: I90d06f9bb3d6180a0921130b9fe523733211e481 Reviewed-on: https://skia-review.googlesource.com/5849 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Reviewed-by: Cary Clark <caryclark@google.com>
2016-12-13 13:48:46 +00:00
"Build-Ubuntu-GCC-x86_64-Release-PDFium_SkiaPaths",
gen_tasks.go: Assert that all compile tasks are in the JOBS list Rather than auto-adding the Job, assert that it's listed. This enforces that the JOBS list is accurate. Add all missing compile Jobs to the list. BUG=skia: Change-Id: Ic7a90165ccac36baa52a4674798977021d6812d7 Reviewed-on: https://skia-review.googlesource.com/5848 Reviewed-by: Mike Klein <mtklein@chromium.org> Commit-Queue: Eric Boren <borenet@google.com>
2016-12-12 19:30:12 +00:00
"Build-Ubuntu-GCC-x86_64-Release-SKNX_NO_SIMD",
"Build-Ubuntu-GCC-x86_64-Release-Shared",
[nobuildbot] Remaining (non-CT) Linux bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=5187 Change-Id: Ibce633b602623510f3c43cca2862a97b41d45b52 Reviewed-on: https://skia-review.googlesource.com/5187 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-23 16:03:28 +00:00
"Build-Ubuntu-GCC-x86_64-Release-Valgrind",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Build-Win-Clang-arm64-Release-Android",
[nobuildbot] Win GCE bots BUG=skia: Change-Id: Id0d0319f68a1c6d970c13bb5b6006786ae04ffec Reviewed-on: https://skia-review.googlesource.com/5265 Reviewed-by: Ben Wagner <benjaminwagner@google.com>
2016-11-28 15:12:09 +00:00
"Build-Win-MSVC-x86-Debug",
"Build-Win-MSVC-x86-Debug-ANGLE",
"Build-Win-MSVC-x86-Debug-Exceptions",
"Build-Win-MSVC-x86-Debug-GDI",
"Build-Win-MSVC-x86-Release",
"Build-Win-MSVC-x86-Release-ANGLE",
"Build-Win-MSVC-x86-Release-GDI",
"Build-Win-MSVC-x86_64-Debug",
gen_tasks.go: Assert that all compile tasks are in the JOBS list Rather than auto-adding the Job, assert that it's listed. This enforces that the JOBS list is accurate. Add all missing compile Jobs to the list. BUG=skia: Change-Id: Ic7a90165ccac36baa52a4674798977021d6812d7 Reviewed-on: https://skia-review.googlesource.com/5848 Reviewed-by: Mike Klein <mtklein@chromium.org> Commit-Queue: Eric Boren <borenet@google.com>
2016-12-12 19:30:12 +00:00
"Build-Win-MSVC-x86_64-Debug-ANGLE",
"Build-Win-MSVC-x86_64-Debug-GDI",
"Build-Win-MSVC-x86_64-Debug-Vulkan",
[nobuildbot] Win GCE bots BUG=skia: Change-Id: Id0d0319f68a1c6d970c13bb5b6006786ae04ffec Reviewed-on: https://skia-review.googlesource.com/5265 Reviewed-by: Ben Wagner <benjaminwagner@google.com>
2016-11-28 15:12:09 +00:00
"Build-Win-MSVC-x86_64-Release",
gen_tasks.go: Assert that all compile tasks are in the JOBS list Rather than auto-adding the Job, assert that it's listed. This enforces that the JOBS list is accurate. Add all missing compile Jobs to the list. BUG=skia: Change-Id: Ic7a90165ccac36baa52a4674798977021d6812d7 Reviewed-on: https://skia-review.googlesource.com/5848 Reviewed-by: Mike Klein <mtklein@chromium.org> Commit-Queue: Eric Boren <borenet@google.com>
2016-12-12 19:30:12 +00:00
"Build-Win-MSVC-x86_64-Release-ANGLE",
"Build-Win-MSVC-x86_64-Release-GDI",
[nobuildbot] Win GCE bots BUG=skia: Change-Id: Id0d0319f68a1c6d970c13bb5b6006786ae04ffec Reviewed-on: https://skia-review.googlesource.com/5265 Reviewed-by: Ben Wagner <benjaminwagner@google.com>
2016-11-28 15:12:09 +00:00
"Build-Win-MSVC-x86_64-Release-Vulkan",
[nobuildbot] RecreateSKPs BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4836 Change-Id: Idee05a4b1ea909c5dc1de2e9ebc8c2f9631c78e2 Reviewed-on: https://skia-review.googlesource.com/4836 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2016-11-15 20:18:20 +00:00
"Housekeeper-Nightly-RecreateSKPs_Canary",
[nobuildbot] Housekeeper-PerCommit BUG=skia: Change-Id: I9a6a8970bd70dc52334fc44ed29ea942c29132fc Reviewed-on: https://skia-review.googlesource.com/5507 Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-12-02 16:01:33 +00:00
"Housekeeper-PerCommit",
Change iOS bots to new-style, no-buildbot bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4582 Change-Id: Ied11c727a491382fce113b6e02831a67d944ca2f Reviewed-on: https://skia-review.googlesource.com/4582 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Stephan Altmueller <stephana@google.com>
2016-11-09 19:03:20 +00:00
"Housekeeper-PerCommit-InfraTests",
[nobuildbot] RecreateSKPs BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4836 Change-Id: Idee05a4b1ea909c5dc1de2e9ebc8c2f9631c78e2 Reviewed-on: https://skia-review.googlesource.com/4836 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2016-11-15 20:18:20 +00:00
"Housekeeper-Weekly-RecreateSKPs",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Perf-Android-Clang-AndroidOne-CPU-MT6582-arm-Debug-Android",
"Perf-Android-Clang-AndroidOne-CPU-MT6582-arm-Release-Android",
"Perf-Android-Clang-AndroidOne-GPU-Mali400MP2-arm-Debug-Android",
"Perf-Android-Clang-AndroidOne-GPU-Mali400MP2-arm-Release-Android",
"Perf-Android-Clang-GalaxyS7-GPU-Adreno530-arm64-Debug-Android",
"Perf-Android-Clang-GalaxyS7-GPU-Adreno530-arm64-Debug-Android_Vulkan",
"Perf-Android-Clang-GalaxyS7-GPU-Adreno530-arm64-Release-Android",
"Perf-Android-Clang-GalaxyS7-GPU-Adreno530-arm64-Release-Android_Vulkan",
"Perf-Android-Clang-NVIDIA_Shield-GPU-TegraX1-arm64-Debug-Android",
"Perf-Android-Clang-NVIDIA_Shield-GPU-TegraX1-arm64-Debug-Android_Vulkan",
"Perf-Android-Clang-NVIDIA_Shield-GPU-TegraX1-arm64-Release-Android",
"Perf-Android-Clang-NVIDIA_Shield-GPU-TegraX1-arm64-Release-Android_Vulkan",
"Perf-Android-Clang-Nexus10-GPU-MaliT604-arm-Debug-Android",
"Perf-Android-Clang-Nexus10-GPU-MaliT604-arm-Release-Android",
"Perf-Android-Clang-Nexus5-GPU-Adreno330-arm-Debug-Android",
"Perf-Android-Clang-Nexus5-GPU-Adreno330-arm-Release-Android",
"Perf-Android-Clang-Nexus6p-GPU-Adreno430-arm64-Debug-Android",
"Perf-Android-Clang-Nexus6p-GPU-Adreno430-arm64-Debug-Android_Vulkan",
"Perf-Android-Clang-Nexus6p-GPU-Adreno430-arm64-Release-Android",
"Perf-Android-Clang-Nexus6p-GPU-Adreno430-arm64-Release-Android_Vulkan",
"Perf-Android-Clang-Nexus7-GPU-Tegra3-arm-Debug-Android",
"Perf-Android-Clang-Nexus7-GPU-Tegra3-arm-Release-Android",
"Perf-Android-Clang-NexusPlayer-CPU-Moorefield-x86-Debug-Android",
"Perf-Android-Clang-NexusPlayer-CPU-Moorefield-x86-Release-Android",
"Perf-Android-Clang-NexusPlayer-GPU-PowerVR-x86-Debug-Android",
"Perf-Android-Clang-NexusPlayer-GPU-PowerVR-x86-Debug-Android_Vulkan",
"Perf-Android-Clang-NexusPlayer-GPU-PowerVR-x86-Release-Android",
"Perf-Android-Clang-NexusPlayer-GPU-PowerVR-x86-Release-Android_Vulkan",
"Perf-Android-Clang-Pixel-GPU-Adreno530-arm64-Debug-Android",
"Perf-Android-Clang-Pixel-GPU-Adreno530-arm64-Debug-Android_Vulkan",
"Perf-Android-Clang-Pixel-GPU-Adreno530-arm64-Release-Android",
"Perf-Android-Clang-Pixel-GPU-Adreno530-arm64-Release-Android_Vulkan",
Move 6p arm64 CPU tests to Pixel C We have much more capacity on the Pixel Cs. BUG=skia: Change-Id: I65e136d5e2f44ec4bef9c168a86e706537878532 Reviewed-on: https://skia-review.googlesource.com/5755 Reviewed-by: Mike Klein <mtklein@chromium.org> Reviewed-by: Eric Boren <borenet@google.com> Commit-Queue: Kevin Lubick <kjlubick@google.com>
2016-12-09 16:11:33 +00:00
"Perf-Android-Clang-PixelC-CPU-TegraX1-arm64-Debug-Android",
"Perf-Android-Clang-PixelC-CPU-TegraX1-arm64-Release-Android",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Perf-Android-Clang-PixelC-GPU-TegraX1-arm64-Release-Android_Skpbench",
"Perf-Android-Clang-PixelC-GPU-TegraX1-arm64-Release-Android_Vulkan_Skpbench",
"Perf-Mac-Clang-MacMini4.1-GPU-GeForce320M-x86_64-Debug",
"Perf-Mac-Clang-MacMini4.1-GPU-GeForce320M-x86_64-Release",
"Perf-Mac-Clang-MacMini6.2-CPU-AVX-x86_64-Debug",
"Perf-Mac-Clang-MacMini6.2-CPU-AVX-x86_64-Release",
"Perf-Mac-Clang-MacMini6.2-GPU-HD4000-x86_64-Debug",
"Perf-Mac-Clang-MacMini6.2-GPU-HD4000-x86_64-Release",
[nobuildbot] Mac bots BUG=skia: Change-Id: I089a21941b65d4bb53e803c4d5081b26bda30f14 Reviewed-on: https://skia-review.googlesource.com/5210 Reviewed-by: Ben Wagner <benjaminwagner@google.com>
2016-11-28 12:22:18 +00:00
"Perf-Mac-Clang-MacMini6.2-GPU-HD4000-x86_64-Release-CommandBuffer",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Perf-Ubuntu-Clang-GCE-CPU-AVX2-x86_64-Debug",
[nobuildbot] Migrate all Linux GCE bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4994 Change-Id: Ib63f36b3803117d5357c8e70c572653afd151abe Reviewed-on: https://skia-review.googlesource.com/4994 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-18 18:10:51 +00:00
"Perf-Ubuntu-Clang-GCE-CPU-AVX2-x86_64-Debug-ASAN",
"Perf-Ubuntu-Clang-GCE-CPU-AVX2-x86_64-Debug-MSAN",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Perf-Ubuntu-Clang-GCE-CPU-AVX2-x86_64-Release",
[nobuildbot] Remaining (non-CT) Linux bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=5187 Change-Id: Ibce633b602623510f3c43cca2862a97b41d45b52 Reviewed-on: https://skia-review.googlesource.com/5187 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-23 16:03:28 +00:00
"Perf-Ubuntu-Clang-Golo-GPU-GT610-x86_64-Debug-ASAN",
[nobuildbot] Migrate all Linux GCE bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4994 Change-Id: Ib63f36b3803117d5357c8e70c572653afd151abe Reviewed-on: https://skia-review.googlesource.com/4994 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-18 18:10:51 +00:00
"Perf-Ubuntu-GCC-GCE-CPU-AVX2-x86-Debug",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Perf-Ubuntu-GCC-GCE-CPU-AVX2-x86_64-Debug",
[nobuildbot] Migrate all Linux GCE bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4994 Change-Id: Ib63f36b3803117d5357c8e70c572653afd151abe Reviewed-on: https://skia-review.googlesource.com/4994 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-18 18:10:51 +00:00
"Perf-Ubuntu-GCC-GCE-CPU-AVX2-x86_64-Debug-SK_USE_DISCARDABLE_SCALEDIMAGECACHE",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Perf-Ubuntu-GCC-GCE-CPU-AVX2-x86_64-Release",
[nobuildbot] CT bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=5183 Change-Id: I2d131415c912790cf1aeceaccc23be85ade7f5f0 Reviewed-on: https://skia-review.googlesource.com/5183 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-30 19:05:16 +00:00
"Perf-Ubuntu-GCC-GCE-CPU-AVX2-x86_64-Release-CT_BENCH_1k_SKPs",
"Perf-Ubuntu-GCC-Golo-GPU-GT610-x86_64-Release-CT_BENCH_1k_SKPs",
[nobuildbot] Remaining (non-CT) Linux bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=5187 Change-Id: Ibce633b602623510f3c43cca2862a97b41d45b52 Reviewed-on: https://skia-review.googlesource.com/5187 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-23 16:03:28 +00:00
"Perf-Ubuntu-GCC-ShuttleA-GPU-GTX550Ti-x86_64-Release-Valgrind",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Perf-Ubuntu-GCC-ShuttleA-GPU-GTX660-x86_64-Debug",
"Perf-Ubuntu-GCC-ShuttleA-GPU-GTX660-x86_64-Release",
Make all tasks specify an OS version Rename Win->Win10 where appropriate BUG=skia: Change-Id: I8692340cebf646e2cb0cb825e808b5ea1b695a8f Reviewed-on: https://skia-review.googlesource.com/5356 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Mike Klein <mtklein@chromium.org> Reviewed-by: Ben Wagner <benjaminwagner@google.com>
2016-12-02 17:09:10 +00:00
"Perf-Win10-MSVC-Golo-GPU-GT610-x86_64-Release",
"Perf-Win10-MSVC-NUC-GPU-IntelIris6100-x86_64-Debug-ANGLE",
"Perf-Win10-MSVC-NUC-GPU-IntelIris6100-x86_64-Release-ANGLE",
[nobuildbot] Rename Win bots back to Win8/Win10 BUG=skia: Change-Id: If66bdfc6cf15e11129048ee748430c3887132b75 Reviewed-on: https://skia-review.googlesource.com/5351 Reviewed-by: Mike Klein <mtklein@chromium.org> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-30 17:49:00 +00:00
"Perf-Win10-MSVC-ShuttleA-GPU-GTX660-x86_64-Debug",
"Perf-Win10-MSVC-ShuttleA-GPU-GTX660-x86_64-Debug-Vulkan",
"Perf-Win10-MSVC-ShuttleA-GPU-GTX660-x86_64-Release",
"Perf-Win10-MSVC-ShuttleA-GPU-GTX660-x86_64-Release-Vulkan",
Make all tasks specify an OS version Rename Win->Win10 where appropriate BUG=skia: Change-Id: I8692340cebf646e2cb0cb825e808b5ea1b695a8f Reviewed-on: https://skia-review.googlesource.com/5356 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Mike Klein <mtklein@chromium.org> Reviewed-by: Ben Wagner <benjaminwagner@google.com>
2016-12-02 17:09:10 +00:00
"Perf-Win10-MSVC-ShuttleC-GPU-GTX960-x86_64-Debug",
"Perf-Win10-MSVC-ShuttleC-GPU-GTX960-x86_64-Debug-ANGLE",
"Perf-Win10-MSVC-ShuttleC-GPU-GTX960-x86_64-Release",
"Perf-Win10-MSVC-ShuttleC-GPU-GTX960-x86_64-Release-ANGLE",
"Perf-Win10-MSVC-ShuttleC-GPU-iHD530-x86_64-Debug",
"Perf-Win10-MSVC-ShuttleC-GPU-iHD530-x86_64-Release",
"Perf-Win2k8-MSVC-GCE-CPU-AVX2-x86-Debug",
"Perf-Win2k8-MSVC-GCE-CPU-AVX2-x86_64-Debug",
"Perf-Win2k8-MSVC-GCE-CPU-AVX2-x86_64-Debug-GDI",
"Perf-Win2k8-MSVC-GCE-CPU-AVX2-x86_64-Release",
[nobuildbot] Rename Win bots back to Win8/Win10 BUG=skia: Change-Id: If66bdfc6cf15e11129048ee748430c3887132b75 Reviewed-on: https://skia-review.googlesource.com/5351 Reviewed-by: Mike Klein <mtklein@chromium.org> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-30 17:49:00 +00:00
"Perf-Win8-MSVC-ShuttleA-GPU-HD7770-x86_64-Debug",
"Perf-Win8-MSVC-ShuttleA-GPU-HD7770-x86_64-Release",
"Perf-Win8-MSVC-ShuttleB-GPU-HD4600-x86_64-Debug",
"Perf-Win8-MSVC-ShuttleB-GPU-HD4600-x86_64-Release",
Change iOS bots to new-style, no-buildbot bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4582 Change-Id: Ied11c727a491382fce113b6e02831a67d944ca2f Reviewed-on: https://skia-review.googlesource.com/4582 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Stephan Altmueller <stephana@google.com>
2016-11-09 19:03:20 +00:00
"Perf-iOS-Clang-iPadMini4-GPU-GX6450-Arm7-Debug",
"Perf-iOS-Clang-iPadMini4-GPU-GX6450-Arm7-Release",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Test-Android-Clang-AndroidOne-CPU-MT6582-arm-Debug-Android",
"Test-Android-Clang-AndroidOne-CPU-MT6582-arm-Release-Android",
"Test-Android-Clang-AndroidOne-GPU-Mali400MP2-arm-Debug-Android",
"Test-Android-Clang-AndroidOne-GPU-Mali400MP2-arm-Release-Android",
"Test-Android-Clang-GalaxyS7-GPU-Adreno530-arm64-Debug-Android",
"Test-Android-Clang-GalaxyS7-GPU-Adreno530-arm64-Debug-Android_Vulkan",
"Test-Android-Clang-GalaxyS7-GPU-Adreno530-arm64-Release-Android",
"Test-Android-Clang-GalaxyS7-GPU-Adreno530-arm64-Release-Android_Vulkan",
Add Galaxy Tab3 Test Perf won't work because J is too old. But, we can at least run tests. Since we only have one device, I decided to just do Debug instead of Debug/Release. We don't care about CPU things since we have much faster arm devices to handle that for us. BUG=skia: Change-Id: I11e6f13a128b627bc2f2b2878c39c0fda8d310a9 Reviewed-on: https://skia-review.googlesource.com/6027 Commit-Queue: Kevin Lubick <kjlubick@google.com> Reviewed-by: Mike Klein <mtklein@chromium.org>
2016-12-14 13:48:00 +00:00
"Test-Android-Clang-GalaxyTab3-GPU-Vivante-arm-Debug-Android",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Test-Android-Clang-NVIDIA_Shield-GPU-TegraX1-arm64-Debug-Android",
"Test-Android-Clang-NVIDIA_Shield-GPU-TegraX1-arm64-Debug-Android_Vulkan",
"Test-Android-Clang-NVIDIA_Shield-GPU-TegraX1-arm64-Release-Android",
"Test-Android-Clang-NVIDIA_Shield-GPU-TegraX1-arm64-Release-Android_Vulkan",
"Test-Android-Clang-Nexus10-GPU-MaliT604-arm-Debug-Android",
"Test-Android-Clang-Nexus10-GPU-MaliT604-arm-Release-Android",
"Test-Android-Clang-Nexus5-GPU-Adreno330-arm-Debug-Android",
"Test-Android-Clang-Nexus5-GPU-Adreno330-arm-Release-Android",
"Test-Android-Clang-Nexus6p-GPU-Adreno430-arm64-Debug-Android",
"Test-Android-Clang-Nexus6p-GPU-Adreno430-arm64-Debug-Android_Vulkan",
"Test-Android-Clang-Nexus6p-GPU-Adreno430-arm64-Release-Android",
"Test-Android-Clang-Nexus6p-GPU-Adreno430-arm64-Release-Android_Vulkan",
"Test-Android-Clang-Nexus7-GPU-Tegra3-arm-Debug-Android",
"Test-Android-Clang-Nexus7-GPU-Tegra3-arm-Release-Android",
"Test-Android-Clang-NexusPlayer-CPU-Moorefield-x86-Debug-Android",
"Test-Android-Clang-NexusPlayer-CPU-Moorefield-x86-Release-Android",
"Test-Android-Clang-NexusPlayer-GPU-PowerVR-x86-Debug-Android",
"Test-Android-Clang-NexusPlayer-GPU-PowerVR-x86-Debug-Android_Vulkan",
"Test-Android-Clang-NexusPlayer-GPU-PowerVR-x86-Release-Android",
"Test-Android-Clang-NexusPlayer-GPU-PowerVR-x86-Release-Android_Vulkan",
Move 6p arm64 CPU tests to Pixel C We have much more capacity on the Pixel Cs. BUG=skia: Change-Id: I65e136d5e2f44ec4bef9c168a86e706537878532 Reviewed-on: https://skia-review.googlesource.com/5755 Reviewed-by: Mike Klein <mtklein@chromium.org> Reviewed-by: Eric Boren <borenet@google.com> Commit-Queue: Kevin Lubick <kjlubick@google.com>
2016-12-09 16:11:33 +00:00
"Test-Android-Clang-PixelC-CPU-TegraX1-arm64-Debug-Android",
"Test-Android-Clang-PixelC-CPU-TegraX1-arm64-Release-Android",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Test-Android-Clang-PixelXL-GPU-Adreno530-arm64-Debug-Android",
"Test-Android-Clang-PixelXL-GPU-Adreno530-arm64-Debug-Android_Vulkan",
"Test-Android-Clang-PixelXL-GPU-Adreno530-arm64-Release-Android",
"Test-Android-Clang-PixelXL-GPU-Adreno530-arm64-Release-Android_Vulkan",
"Test-Mac-Clang-MacMini4.1-GPU-GeForce320M-x86_64-Debug",
"Test-Mac-Clang-MacMini4.1-GPU-GeForce320M-x86_64-Release",
"Test-Mac-Clang-MacMini6.2-CPU-AVX-x86_64-Debug",
"Test-Mac-Clang-MacMini6.2-CPU-AVX-x86_64-Release",
"Test-Mac-Clang-MacMini6.2-GPU-HD4000-x86_64-Debug",
[nobuildbot] Mac bots BUG=skia: Change-Id: I089a21941b65d4bb53e803c4d5081b26bda30f14 Reviewed-on: https://skia-review.googlesource.com/5210 Reviewed-by: Ben Wagner <benjaminwagner@google.com>
2016-11-28 12:22:18 +00:00
"Test-Mac-Clang-MacMini6.2-GPU-HD4000-x86_64-Debug-CommandBuffer",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Test-Mac-Clang-MacMini6.2-GPU-HD4000-x86_64-Release",
"Test-Ubuntu-Clang-GCE-CPU-AVX2-x86_64-Debug",
[nobuildbot] Migrate all Linux GCE bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4994 Change-Id: Ib63f36b3803117d5357c8e70c572653afd151abe Reviewed-on: https://skia-review.googlesource.com/4994 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-18 18:10:51 +00:00
"Test-Ubuntu-Clang-GCE-CPU-AVX2-x86_64-Debug-ASAN",
"Test-Ubuntu-Clang-GCE-CPU-AVX2-x86_64-Debug-MSAN",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Test-Ubuntu-Clang-GCE-CPU-AVX2-x86_64-Release",
[nobuildbot] Migrate all Linux GCE bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4994 Change-Id: Ib63f36b3803117d5357c8e70c572653afd151abe Reviewed-on: https://skia-review.googlesource.com/4994 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-18 18:10:51 +00:00
"Test-Ubuntu-Clang-GCE-CPU-AVX2-x86_64-Release-TSAN",
[nobuildbot] Remaining (non-CT) Linux bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=5187 Change-Id: Ibce633b602623510f3c43cca2862a97b41d45b52 Reviewed-on: https://skia-review.googlesource.com/5187 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-23 16:03:28 +00:00
"Test-Ubuntu-Clang-Golo-GPU-GT610-x86_64-Debug-ASAN",
"Test-Ubuntu-Clang-Golo-GPU-GT610-x86_64-Release-TSAN",
[nobuildbot] Migrate all Linux GCE bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4994 Change-Id: Ib63f36b3803117d5357c8e70c572653afd151abe Reviewed-on: https://skia-review.googlesource.com/4994 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-18 18:10:51 +00:00
"Test-Ubuntu-GCC-GCE-CPU-AVX2-x86-Debug",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Test-Ubuntu-GCC-GCE-CPU-AVX2-x86_64-Debug",
[nobuildbot] CT bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=5183 Change-Id: I2d131415c912790cf1aeceaccc23be85ade7f5f0 Reviewed-on: https://skia-review.googlesource.com/5183 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-30 19:05:16 +00:00
"Test-Ubuntu-GCC-GCE-CPU-AVX2-x86_64-Debug-CT_DM_100k_SKPs",
"Test-Ubuntu-GCC-GCE-CPU-AVX2-x86_64-Debug-CT_DM_1m_SKPs",
"Test-Ubuntu-GCC-GCE-CPU-AVX2-x86_64-Debug-CT_IMG_DECODE_100k_SKPs",
[nobuildbot] Migrate all Linux GCE bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4994 Change-Id: Ib63f36b3803117d5357c8e70c572653afd151abe Reviewed-on: https://skia-review.googlesource.com/4994 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-18 18:10:51 +00:00
"Test-Ubuntu-GCC-GCE-CPU-AVX2-x86_64-Debug-SK_USE_DISCARDABLE_SCALEDIMAGECACHE",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Test-Ubuntu-GCC-GCE-CPU-AVX2-x86_64-Release",
[nobuildbot] Migrate all Linux GCE bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4994 Change-Id: Ib63f36b3803117d5357c8e70c572653afd151abe Reviewed-on: https://skia-review.googlesource.com/4994 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-18 18:10:51 +00:00
"Test-Ubuntu-GCC-GCE-CPU-AVX2-x86_64-Release-Fast",
"Test-Ubuntu-GCC-GCE-CPU-AVX2-x86_64-Release-SKNX_NO_SIMD",
[nobuildbot] Remaining (non-CT) Linux bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=5187 Change-Id: Ibce633b602623510f3c43cca2862a97b41d45b52 Reviewed-on: https://skia-review.googlesource.com/5187 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-23 16:03:28 +00:00
"Test-Ubuntu-GCC-ShuttleA-GPU-GTX550Ti-x86_64-Release-Valgrind",
Remove redundant -GN bot suffixes. The GN in the name only matters for iOS bots now. All the others are GN-only. This revealed a couple redundant build bots: we had two each of Win x86_64 Debug and Release builders, one with -GN and one not. I have intentionally not resorted gen_tasks.go to keep the diff looking somewhat sane. I'd be happy to sort here or to follow up with a re-sort CL. Change-Id: I2f8a136a1fbde416739966e27685b52b94b50cf6 Reviewed-on: https://skia-review.googlesource.com/5545 Reviewed-by: Eric Boren <borenet@google.com>
2016-12-05 15:42:36 +00:00
"Test-Ubuntu-GCC-ShuttleA-GPU-GTX660-x86_64-Debug",
"Test-Ubuntu-GCC-ShuttleA-GPU-GTX660-x86_64-Release",
Make all tasks specify an OS version Rename Win->Win10 where appropriate BUG=skia: Change-Id: I8692340cebf646e2cb0cb825e808b5ea1b695a8f Reviewed-on: https://skia-review.googlesource.com/5356 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Mike Klein <mtklein@chromium.org> Reviewed-by: Ben Wagner <benjaminwagner@google.com>
2016-12-02 17:09:10 +00:00
"Test-Win10-MSVC-Golo-GPU-GT610-x86_64-Release",
"Test-Win10-MSVC-NUC-GPU-IntelIris6100-x86_64-Debug-ANGLE",
"Test-Win10-MSVC-NUC-GPU-IntelIris6100-x86_64-Release-ANGLE",
[nobuildbot] Rename Win bots back to Win8/Win10 BUG=skia: Change-Id: If66bdfc6cf15e11129048ee748430c3887132b75 Reviewed-on: https://skia-review.googlesource.com/5351 Reviewed-by: Mike Klein <mtklein@chromium.org> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-30 17:49:00 +00:00
"Test-Win10-MSVC-ShuttleA-GPU-GTX660-x86_64-Debug",
"Test-Win10-MSVC-ShuttleA-GPU-GTX660-x86_64-Debug-Vulkan",
"Test-Win10-MSVC-ShuttleA-GPU-GTX660-x86_64-Release",
Make all tasks specify an OS version Rename Win->Win10 where appropriate BUG=skia: Change-Id: I8692340cebf646e2cb0cb825e808b5ea1b695a8f Reviewed-on: https://skia-review.googlesource.com/5356 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Mike Klein <mtklein@chromium.org> Reviewed-by: Ben Wagner <benjaminwagner@google.com>
2016-12-02 17:09:10 +00:00
"Test-Win10-MSVC-ShuttleC-GPU-GTX960-x86_64-Debug",
"Test-Win10-MSVC-ShuttleC-GPU-GTX960-x86_64-Debug-ANGLE",
"Test-Win10-MSVC-ShuttleC-GPU-GTX960-x86_64-Release",
"Test-Win10-MSVC-ShuttleC-GPU-GTX960-x86_64-Release-ANGLE",
"Test-Win10-MSVC-ShuttleC-GPU-iHD530-x86_64-Debug",
"Test-Win10-MSVC-ShuttleC-GPU-iHD530-x86_64-Release",
"Test-Win2k8-MSVC-GCE-CPU-AVX2-x86-Debug",
"Test-Win2k8-MSVC-GCE-CPU-AVX2-x86-Release",
"Test-Win2k8-MSVC-GCE-CPU-AVX2-x86_64-Debug",
"Test-Win2k8-MSVC-GCE-CPU-AVX2-x86_64-Debug-GDI",
"Test-Win2k8-MSVC-GCE-CPU-AVX2-x86_64-Release",
"Test-Win2k8-MSVC-GCE-CPU-AVX2-x86_64-Release-GDI",
[nobuildbot] Rename Win bots back to Win8/Win10 BUG=skia: Change-Id: If66bdfc6cf15e11129048ee748430c3887132b75 Reviewed-on: https://skia-review.googlesource.com/5351 Reviewed-by: Mike Klein <mtklein@chromium.org> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-30 17:49:00 +00:00
"Test-Win8-MSVC-ShuttleA-GPU-HD7770-x86_64-Debug",
"Test-Win8-MSVC-ShuttleA-GPU-HD7770-x86_64-Release",
"Test-Win8-MSVC-ShuttleB-GPU-HD4600-x86_64-Debug",
"Test-Win8-MSVC-ShuttleB-GPU-HD4600-x86_64-Release",
Change iOS bots to new-style, no-buildbot bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4582 Change-Id: Ied11c727a491382fce113b6e02831a67d944ca2f Reviewed-on: https://skia-review.googlesource.com/4582 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Stephan Altmueller <stephana@google.com>
2016-11-09 19:03:20 +00:00
"Test-iOS-Clang-iPadMini4-GPU-GX6450-Arm7-Debug",
"Test-iOS-Clang-iPadMini4-GPU-GX6450-Arm7-Release",
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
}
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
// LINUX_GCE_DIMENSIONS are the Swarming dimensions for Linux GCE
// instances.
LINUX_GCE_DIMENSIONS = []string{
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
"cpu:x86-64-avx2",
"gpu:none",
Fix stragling Ubuntu dimensions BUG=skia: Change-Id: I2328190da7fc1f2db10bb87684fb3a3e95751ec5 Reviewed-on: https://skia-review.googlesource.com/6111 Reviewed-by: Eric Boren <borenet@google.com> Commit-Queue: Kevin Lubick <kjlubick@google.com>
2016-12-15 15:45:08 +00:00
fmt.Sprintf("os:%s", DEFAULT_OS_LINUX),
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
fmt.Sprintf("pool:%s", POOL_SKIA),
}
// Defines the structure of job names.
jobNameSchema *JobNameSchema
)
// deriveCompileTaskName returns the name of a compile task based on the given
// job name.
func deriveCompileTaskName(jobName string, parts map[string]string) string {
if parts["role"] == "Housekeeper" {
return "Build-Ubuntu-GCC-x86_64-Release-Shared"
} else if parts["role"] == "Test" || parts["role"] == "Perf" {
task_os := parts["os"]
ec := parts["extra_config"]
Add skpbench job This entails a few parts: 1. Isolating tools/skpbench/ to be used by the perf task. 2. Adding skpbench to BUILD_PRODUCTS_ISOLATE_WHITELIST 3. Add recipe commands to run skpbench. While it is conceptually similar to nanobench, it doesn't support images nor svgs, only skps, so we don't need to copy those to devices or bring them in via CIPD. 4. Add recipe commands to parse skpbench output and upload to Perf. 5. Update gen_tasks.go to handle skpbench jobs and tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4551 Change-Id: I09bf0b078067279e138e95eca9316e55539ec735 Reviewed-on: https://skia-review.googlesource.com/4551 Commit-Queue: Kevin Lubick <kjlubick@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2016-11-14 18:42:27 +00:00
ec = strings.TrimSuffix(ec, "_Skpbench")
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
if task_os == "Android" {
if ec == "Vulkan" {
ec = "Android_Vulkan"
}
Add a buildbotless Android bot BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2428603002 Review-Url: https://codereview.chromium.org/2428603002
2016-10-17 17:17:53 +00:00
task_os = "Ubuntu"
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
} else if task_os == "iOS" {
ec = task_os
task_os = "Mac"
} else if strings.Contains(task_os, "Win") {
task_os = "Win"
}
[nobuildbot] Migrate all Linux GCE bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4994 Change-Id: Ib63f36b3803117d5357c8e70c572653afd151abe Reviewed-on: https://skia-review.googlesource.com/4994 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-18 18:10:51 +00:00
jobNameMap := map[string]string{
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
"role": "Build",
"os": task_os,
"compiler": parts["compiler"],
"target_arch": parts["arch"],
"configuration": parts["configuration"],
[nobuildbot] Migrate all Linux GCE bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4994 Change-Id: Ib63f36b3803117d5357c8e70c572653afd151abe Reviewed-on: https://skia-review.googlesource.com/4994 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-18 18:10:51 +00:00
}
if ec != "" {
jobNameMap["extra_config"] = ec
}
name, err := jobNameSchema.MakeJobName(jobNameMap)
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
if err != nil {
glog.Fatal(err)
}
return name
} else {
return jobName
}
}
// swarmDimensions generates swarming bot dimensions for the given task.
func swarmDimensions(parts map[string]string) []string {
d := map[string]string{
"pool": POOL_SKIA,
}
if os, ok := parts["os"]; ok {
Make all tasks specify an OS version Rename Win->Win10 where appropriate BUG=skia: Change-Id: I8692340cebf646e2cb0cb825e808b5ea1b695a8f Reviewed-on: https://skia-review.googlesource.com/5356 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Mike Klein <mtklein@chromium.org> Reviewed-by: Ben Wagner <benjaminwagner@google.com>
2016-12-02 17:09:10 +00:00
d["os"] = map[string]string{
"Android": "Android",
"Mac": "Mac-10.11",
Fix stragling Ubuntu dimensions BUG=skia: Change-Id: I2328190da7fc1f2db10bb87684fb3a3e95751ec5 Reviewed-on: https://skia-review.googlesource.com/6111 Reviewed-by: Eric Boren <borenet@google.com> Commit-Queue: Kevin Lubick <kjlubick@google.com>
2016-12-15 15:45:08 +00:00
"Ubuntu": DEFAULT_OS_LINUX,
Make all tasks specify an OS version Rename Win->Win10 where appropriate BUG=skia: Change-Id: I8692340cebf646e2cb0cb825e808b5ea1b695a8f Reviewed-on: https://skia-review.googlesource.com/5356 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Mike Klein <mtklein@chromium.org> Reviewed-by: Ben Wagner <benjaminwagner@google.com>
2016-12-02 17:09:10 +00:00
"Win": "Windows-2008ServerR2-SP1",
"Win10": "Windows-10-10586",
"Win2k8": "Windows-2008ServerR2-SP1",
"Win8": "Windows-8.1-SP0",
"iOS": "iOS-9.3.1",
}[os]
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
} else {
d["os"] = DEFAULT_OS
}
if parts["role"] == "Test" || parts["role"] == "Perf" {
if strings.Contains(parts["os"], "Android") {
// For Android, the device type is a better dimension
// than CPU or GPU.
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
deviceInfo := map[string][]string{
"AndroidOne": {"sprout", "MOB30Q"},
"GalaxyS7": {"heroqlteatt", "MMB29M"},
Add Galaxy Tab3 Test Perf won't work because J is too old. But, we can at least run tests. Since we only have one device, I decided to just do Debug instead of Debug/Release. We don't care about CPU things since we have much faster arm devices to handle that for us. BUG=skia: Change-Id: I11e6f13a128b627bc2f2b2878c39c0fda8d310a9 Reviewed-on: https://skia-review.googlesource.com/6027 Commit-Queue: Kevin Lubick <kjlubick@google.com> Reviewed-by: Mike Klein <mtklein@chromium.org>
2016-12-14 13:48:00 +00:00
"GalaxyTab3": {"goyawifi", "JDQ39"},
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
"NVIDIA_Shield": {"foster", "MRA58K"},
"Nexus10": {"manta", "LMY49J"},
"Nexus5": {"hammerhead", "MOB31E"},
"Nexus6": {"shamu", "M"},
"Nexus6p": {"angler", "NMF26C"},
"Nexus7": {"grouper", "LMY47V"},
"Nexus7v2": {"flo", "M"},
"NexusPlayer": {"fugu", "NRD90R"},
"Pixel": {"sailfish", "NMF25"},
"PixelC": {"dragon", "NMF26C"},
"PixelXL": {"marlin", "NMF25"},
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
}[parts["model"]]
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
d["device_type"] = deviceInfo[0]
d["device_os"] = deviceInfo[1]
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
} else if strings.Contains(parts["os"], "iOS") {
d["device"] = map[string]string{
Change iOS bots to new-style, no-buildbot bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4582 Change-Id: Ied11c727a491382fce113b6e02831a67d944ca2f Reviewed-on: https://skia-review.googlesource.com/4582 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Stephan Altmueller <stephana@google.com>
2016-11-09 19:03:20 +00:00
"iPadMini4": "iPad5,1",
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
}[parts["model"]]
} else if parts["cpu_or_gpu"] == "CPU" {
d["gpu"] = "none"
d["cpu"] = map[string]string{
"AVX": "x86-64",
"AVX2": "x86-64-avx2",
"SSE4": "x86-64",
}[parts["cpu_or_gpu_value"]]
if strings.Contains(parts["os"], "Win") && parts["cpu_or_gpu_value"] == "AVX2" {
// AVX2 is not correctly detected on Windows. Fall back on other
// dimensions to ensure that we correctly target machines which we know
// have AVX2 support.
d["cpu"] = "x86-64"
d["os"] = "Windows-2008ServerR2-SP1"
}
} else {
d["gpu"] = map[string]string{
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
"GeForce320M": "10de:08a4",
"GT610": "10de:104a",
"GTX550Ti": "10de:1244",
"GTX660": "10de:11c0",
"GTX960": "10de:1401",
"HD4000": "8086:0a2e",
"HD4600": "8086:0412",
"HD7770": "1002:683d",
"iHD530": "8086:1912",
"IntelIris6100": "8086:162b",
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
}[parts["cpu_or_gpu_value"]]
}
} else {
d["gpu"] = "none"
}
rv := make([]string, 0, len(d))
for k, v := range d {
rv = append(rv, fmt.Sprintf("%s:%s", k, v))
}
sort.Strings(rv)
return rv
}
// compile generates a compile task. Returns the name of the last task in the
// generated chain of tasks, which the Job should add as a dependency.
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
func compile(b *specs.TasksCfgBuilder, name string, parts map[string]string) string {
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
// Collect the necessary CIPD packages.
pkgs := []*specs.CipdPackage{}
// Android bots require a toolchain.
if strings.Contains(name, "Android") {
if strings.Contains(name, "Mac") {
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
pkgs = append(pkgs, b.MustGetCipdPackageFromAsset("android_ndk_darwin"))
Add a Windows Android builder. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4320 Change-Id: Ifd693f5de978565f694bc0173a1248e705303e68 Reviewed-on: https://skia-review.googlesource.com/4320 Reviewed-by: Eric Boren <borenet@google.com> Commit-Queue: Mike Klein <mtklein@chromium.org>
2016-11-02 17:13:16 +00:00
} else if strings.Contains(name, "Win") {
Shorten android_ndk_windows to n to save some precious path budget. We're going above 260 as-is. If this doesn't work... hopefully we don't need any of the long-named files. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4316 Change-Id: I3074c28adfbd4fccb5230eaacf2d6f0c4980bbbe Reviewed-on: https://skia-review.googlesource.com/4316 Commit-Queue: Mike Klein <mtklein@chromium.org> Reviewed-by: Eric Boren <borenet@google.com>
2016-11-02 19:44:26 +00:00
pkg := b.MustGetCipdPackageFromAsset("android_ndk_windows")
pkg.Path = "n"
pkgs = append(pkgs, pkg)
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
} else {
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
pkgs = append(pkgs, b.MustGetCipdPackageFromAsset("android_ndk_linux"))
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
}
Android builders do not need host toolchains. This trims a few packages. We do the same in buildbot. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4634 Change-Id: I4c76d744917cb244ca3390d55d9ea602cda2dd58 Reviewed-on: https://skia-review.googlesource.com/4634 Reviewed-by: Eric Boren <borenet@google.com> Commit-Queue: Mike Klein <mtklein@chromium.org>
2016-11-09 21:31:42 +00:00
} else if strings.Contains(name, "Ubuntu") && strings.Contains(name, "Clang") {
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
pkgs = append(pkgs, b.MustGetCipdPackageFromAsset("clang_linux"))
Android builders do not need host toolchains. This trims a few packages. We do the same in buildbot. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4634 Change-Id: I4c76d744917cb244ca3390d55d9ea602cda2dd58 Reviewed-on: https://skia-review.googlesource.com/4634 Reviewed-by: Eric Boren <borenet@google.com> Commit-Queue: Mike Klein <mtklein@chromium.org>
2016-11-09 21:31:42 +00:00
} else if strings.Contains(name, "Win") {
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
pkgs = append(pkgs, b.MustGetCipdPackageFromAsset("win_toolchain"))
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
if strings.Contains(name, "Vulkan") {
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
pkgs = append(pkgs, b.MustGetCipdPackageFromAsset("win_vulkan_sdk"))
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
}
}
// Add the task.
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
b.MustAddTask(name, &specs.TaskSpec{
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
CipdPackages: pkgs,
Dimensions: swarmDimensions(parts),
ExtraArgs: []string{
"--workdir", "../../..", "swarm_compile",
Make buildbotless trybots only support Gerrit BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4460 Change-Id: Ia5630de72f8b473551a5357fdf50eb3dd288b9a7 Reviewed-on: https://skia-review.googlesource.com/4460 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-04 18:37:26 +00:00
fmt.Sprintf("repository=%s", specs.PLACEHOLDER_REPO),
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
fmt.Sprintf("buildername=%s", name),
"mastername=fake-master",
"buildnumber=2",
"slavename=fake-buildslave",
Recipe fixes to support try jobs in task scheduler BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2410843002 Review-Url: https://codereview.chromium.org/2410843002
2016-10-13 13:23:45 +00:00
"nobuildbot=True",
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
fmt.Sprintf("swarm_out_dir=%s", specs.PLACEHOLDER_ISOLATED_OUTDIR),
fmt.Sprintf("revision=%s", specs.PLACEHOLDER_REVISION),
Recipe fixes to support try jobs in task scheduler BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2410843002 Review-Url: https://codereview.chromium.org/2410843002
2016-10-13 13:23:45 +00:00
fmt.Sprintf("patch_storage=%s", specs.PLACEHOLDER_PATCH_STORAGE),
Make buildbotless trybots only support Gerrit BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4460 Change-Id: Ia5630de72f8b473551a5357fdf50eb3dd288b9a7 Reviewed-on: https://skia-review.googlesource.com/4460 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-04 18:37:26 +00:00
fmt.Sprintf("patch_issue=%s", specs.PLACEHOLDER_ISSUE),
fmt.Sprintf("patch_set=%s", specs.PLACEHOLDER_PATCHSET),
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
},
Isolate: "compile_skia.isolate",
Priority: 0.8,
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
})
gen_tasks.go: Assert that all compile tasks are in the JOBS list Rather than auto-adding the Job, assert that it's listed. This enforces that the JOBS list is accurate. Add all missing compile Jobs to the list. BUG=skia: Change-Id: Ic7a90165ccac36baa52a4674798977021d6812d7 Reviewed-on: https://skia-review.googlesource.com/5848 Reviewed-by: Mike Klein <mtklein@chromium.org> Commit-Queue: Eric Boren <borenet@google.com>
2016-12-12 19:30:12 +00:00
// All compile tasks are runnable as their own Job. Assert that the Job
// is listed in JOBS.
if !util.In(name, JOBS) {
glog.Fatalf("Job %q is missing from the JOBS list!", name)
}
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
return name
}
// recreateSKPs generates a RecreateSKPs task. Returns the name of the last
// task in the generated chain of tasks, which the Job should add as a
// dependency.
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
func recreateSKPs(b *specs.TasksCfgBuilder, name string) string {
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
b.MustAddTask(name, &specs.TaskSpec{
[nobuildbot] RecreateSKPs BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4836 Change-Id: Idee05a4b1ea909c5dc1de2e9ebc8c2f9631c78e2 Reviewed-on: https://skia-review.googlesource.com/4836 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2016-11-15 20:18:20 +00:00
CipdPackages: []*specs.CipdPackage{},
Dimensions: LINUX_GCE_DIMENSIONS,
ExecutionTimeout: 4 * time.Hour,
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
ExtraArgs: []string{
"--workdir", "../../..", "swarm_RecreateSKPs",
fmt.Sprintf("repository=%s", specs.PLACEHOLDER_REPO),
fmt.Sprintf("buildername=%s", name),
"mastername=fake-master",
"buildnumber=2",
"slavename=fake-buildslave",
"nobuildbot=True",
fmt.Sprintf("swarm_out_dir=%s", specs.PLACEHOLDER_ISOLATED_OUTDIR),
fmt.Sprintf("revision=%s", specs.PLACEHOLDER_REVISION),
fmt.Sprintf("patch_storage=%s", specs.PLACEHOLDER_PATCH_STORAGE),
fmt.Sprintf("patch_issue=%s", specs.PLACEHOLDER_ISSUE),
fmt.Sprintf("patch_set=%s", specs.PLACEHOLDER_PATCHSET),
},
[nobuildbot] RecreateSKPs BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4836 Change-Id: Idee05a4b1ea909c5dc1de2e9ebc8c2f9631c78e2 Reviewed-on: https://skia-review.googlesource.com/4836 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2016-11-15 20:18:20 +00:00
IoTimeout: 40 * time.Minute,
Isolate: "compile_skia.isolate",
Priority: 0.8,
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
})
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
return name
}
// ctSKPs generates a CT SKPs task. Returns the name of the last task in the
// generated chain of tasks, which the Job should add as a dependency.
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
func ctSKPs(b *specs.TasksCfgBuilder, name string) string {
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
b.MustAddTask(name, &specs.TaskSpec{
CipdPackages: []*specs.CipdPackage{},
Dimensions: []string{"pool:SkiaCT"},
ExecutionTimeout: 24 * time.Hour,
ExtraArgs: []string{
"--workdir", "../../..", "swarm_ct_skps",
fmt.Sprintf("repository=%s", specs.PLACEHOLDER_REPO),
fmt.Sprintf("buildername=%s", name),
"mastername=fake-master",
"buildnumber=2",
"slavename=fake-buildslave",
"nobuildbot=True",
fmt.Sprintf("swarm_out_dir=%s", specs.PLACEHOLDER_ISOLATED_OUTDIR),
fmt.Sprintf("revision=%s", specs.PLACEHOLDER_REVISION),
fmt.Sprintf("patch_storage=%s", specs.PLACEHOLDER_PATCH_STORAGE),
fmt.Sprintf("patch_issue=%s", specs.PLACEHOLDER_ISSUE),
fmt.Sprintf("patch_set=%s", specs.PLACEHOLDER_PATCHSET),
},
IoTimeout: time.Hour,
Isolate: "ct_skps_skia.isolate",
Priority: 0.8,
})
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
return name
}
// housekeeper generates a Housekeeper task. Returns the name of the last task
// in the generated chain of tasks, which the Job should add as a dependency.
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
func housekeeper(b *specs.TasksCfgBuilder, name, compileTaskName string) string {
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
b.MustAddTask(name, &specs.TaskSpec{
[nobuildbot] Housekeeper-PerCommit BUG=skia: Change-Id: I9a6a8970bd70dc52334fc44ed29ea942c29132fc Reviewed-on: https://skia-review.googlesource.com/5507 Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-12-02 16:01:33 +00:00
CipdPackages: []*specs.CipdPackage{b.MustGetCipdPackageFromAsset("go")},
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
Dependencies: []string{compileTaskName},
Dimensions: LINUX_GCE_DIMENSIONS,
ExtraArgs: []string{
"--workdir", "../../..", "swarm_housekeeper",
fmt.Sprintf("repository=%s", specs.PLACEHOLDER_REPO),
fmt.Sprintf("buildername=%s", name),
"mastername=fake-master",
"buildnumber=2",
"slavename=fake-buildslave",
"nobuildbot=True",
fmt.Sprintf("swarm_out_dir=%s", specs.PLACEHOLDER_ISOLATED_OUTDIR),
fmt.Sprintf("revision=%s", specs.PLACEHOLDER_REVISION),
fmt.Sprintf("patch_storage=%s", specs.PLACEHOLDER_PATCH_STORAGE),
fmt.Sprintf("patch_issue=%s", specs.PLACEHOLDER_ISSUE),
fmt.Sprintf("patch_set=%s", specs.PLACEHOLDER_PATCHSET),
},
Isolate: "housekeeper_skia.isolate",
Priority: 0.8,
})
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
return name
}
Add infra_tests.py, recipe, buildbotless bot Have the presubmit (upload) run infra_tests.py if anything in infra/ changed. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2415193002 Review-Url: https://codereview.chromium.org/2415193002
2016-10-14 13:32:09 +00:00
// infra generates an infra_tests task. Returns the name of the last task in the
// generated chain of tasks, which the Job should add as a dependency.
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
func infra(b *specs.TasksCfgBuilder, name string) string {
b.MustAddTask(name, &specs.TaskSpec{
Add infra_tests.py, recipe, buildbotless bot Have the presubmit (upload) run infra_tests.py if anything in infra/ changed. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2415193002 Review-Url: https://codereview.chromium.org/2415193002
2016-10-14 13:32:09 +00:00
CipdPackages: []*specs.CipdPackage{},
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
Dimensions: LINUX_GCE_DIMENSIONS,
Add infra_tests.py, recipe, buildbotless bot Have the presubmit (upload) run infra_tests.py if anything in infra/ changed. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2415193002 Review-Url: https://codereview.chromium.org/2415193002
2016-10-14 13:32:09 +00:00
ExtraArgs: []string{
"--workdir", "../../..", "swarm_infra",
Make buildbotless trybots only support Gerrit BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4460 Change-Id: Ia5630de72f8b473551a5357fdf50eb3dd288b9a7 Reviewed-on: https://skia-review.googlesource.com/4460 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-04 18:37:26 +00:00
fmt.Sprintf("repository=%s", specs.PLACEHOLDER_REPO),
Add infra_tests.py, recipe, buildbotless bot Have the presubmit (upload) run infra_tests.py if anything in infra/ changed. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2415193002 Review-Url: https://codereview.chromium.org/2415193002
2016-10-14 13:32:09 +00:00
fmt.Sprintf("buildername=%s", name),
"mastername=fake-master",
"buildnumber=2",
"slavename=fake-buildslave",
"nobuildbot=True",
fmt.Sprintf("swarm_out_dir=%s", specs.PLACEHOLDER_ISOLATED_OUTDIR),
fmt.Sprintf("revision=%s", specs.PLACEHOLDER_REVISION),
fmt.Sprintf("patch_storage=%s", specs.PLACEHOLDER_PATCH_STORAGE),
Make buildbotless trybots only support Gerrit BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4460 Change-Id: Ia5630de72f8b473551a5357fdf50eb3dd288b9a7 Reviewed-on: https://skia-review.googlesource.com/4460 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-04 18:37:26 +00:00
fmt.Sprintf("patch_issue=%s", specs.PLACEHOLDER_ISSUE),
fmt.Sprintf("patch_set=%s", specs.PLACEHOLDER_PATCHSET),
Add infra_tests.py, recipe, buildbotless bot Have the presubmit (upload) run infra_tests.py if anything in infra/ changed. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2415193002 Review-Url: https://codereview.chromium.org/2415193002
2016-10-14 13:32:09 +00:00
},
Isolate: "infra_skia.isolate",
Priority: 0.8,
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
})
Add infra_tests.py, recipe, buildbotless bot Have the presubmit (upload) run infra_tests.py if anything in infra/ changed. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2415193002 Review-Url: https://codereview.chromium.org/2415193002
2016-10-14 13:32:09 +00:00
return name
}
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
// doUpload indicates whether the given Job should upload its results.
func doUpload(name string) bool {
skipUploadBots := []string{
"ASAN",
"Coverage",
"MSAN",
"TSAN",
"UBSAN",
"Valgrind",
}
for _, s := range skipUploadBots {
if strings.Contains(name, s) {
return false
}
}
return true
}
// test generates a Test task. Returns the name of the last task in the
// generated chain of tasks, which the Job should add as a dependency.
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
func test(b *specs.TasksCfgBuilder, name string, parts map[string]string, compileTaskName string, pkgs []*specs.CipdPackage) string {
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
s := &specs.TaskSpec{
[nobuildbot] Copy timeouts from swarm_trigger BUG=skia: TBR=benjaminwagner GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4642 Change-Id: Ia81609af8ae11c0171c99c459e8711fa786c1e20 Reviewed-on: https://skia-review.googlesource.com/4642 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ben Wagner <benjaminwagner@google.com>
2016-11-09 23:35:15 +00:00
CipdPackages: pkgs,
Dependencies: []string{compileTaskName},
Dimensions: swarmDimensions(parts),
ExecutionTimeout: 4 * time.Hour,
Expiration: 20 * time.Hour,
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
ExtraArgs: []string{
"--workdir", "../../..", "swarm_test",
Make buildbotless trybots only support Gerrit BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4460 Change-Id: Ia5630de72f8b473551a5357fdf50eb3dd288b9a7 Reviewed-on: https://skia-review.googlesource.com/4460 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-04 18:37:26 +00:00
fmt.Sprintf("repository=%s", specs.PLACEHOLDER_REPO),
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
fmt.Sprintf("buildername=%s", name),
"mastername=fake-master",
"buildnumber=2",
"slavename=fake-buildslave",
Recipe fixes to support try jobs in task scheduler BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2410843002 Review-Url: https://codereview.chromium.org/2410843002
2016-10-13 13:23:45 +00:00
"nobuildbot=True",
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
fmt.Sprintf("swarm_out_dir=%s", specs.PLACEHOLDER_ISOLATED_OUTDIR),
fmt.Sprintf("revision=%s", specs.PLACEHOLDER_REVISION),
Recipe fixes to support try jobs in task scheduler BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2410843002 Review-Url: https://codereview.chromium.org/2410843002
2016-10-13 13:23:45 +00:00
fmt.Sprintf("patch_storage=%s", specs.PLACEHOLDER_PATCH_STORAGE),
Make buildbotless trybots only support Gerrit BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4460 Change-Id: Ia5630de72f8b473551a5357fdf50eb3dd288b9a7 Reviewed-on: https://skia-review.googlesource.com/4460 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-04 18:37:26 +00:00
fmt.Sprintf("patch_issue=%s", specs.PLACEHOLDER_ISSUE),
fmt.Sprintf("patch_set=%s", specs.PLACEHOLDER_PATCHSET),
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
},
[nobuildbot] Copy timeouts from swarm_trigger BUG=skia: TBR=benjaminwagner GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4642 Change-Id: Ia81609af8ae11c0171c99c459e8711fa786c1e20 Reviewed-on: https://skia-review.googlesource.com/4642 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ben Wagner <benjaminwagner@google.com>
2016-11-09 23:35:15 +00:00
IoTimeout: 40 * time.Minute,
Isolate: "test_skia.isolate",
Priority: 0.8,
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
}
if strings.Contains(parts["extra_config"], "Valgrind") {
s.ExecutionTimeout = 9 * time.Hour
s.Expiration = 48 * time.Hour
s.IoTimeout = time.Hour
} else if strings.Contains(parts["extra_config"], "MSAN") {
s.ExecutionTimeout = 9 * time.Hour
}
b.MustAddTask(name, s)
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
// Upload results if necessary.
if doUpload(name) {
uploadName := fmt.Sprintf("%s%s%s", PREFIX_UPLOAD, jobNameSchema.Sep, name)
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
b.MustAddTask(uploadName, &specs.TaskSpec{
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
Dependencies: []string{name},
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
Dimensions: LINUX_GCE_DIMENSIONS,
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
ExtraArgs: []string{
"--workdir", "../../..", "upload_dm_results",
Make buildbotless trybots only support Gerrit BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4460 Change-Id: Ia5630de72f8b473551a5357fdf50eb3dd288b9a7 Reviewed-on: https://skia-review.googlesource.com/4460 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-04 18:37:26 +00:00
fmt.Sprintf("repository=%s", specs.PLACEHOLDER_REPO),
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
fmt.Sprintf("buildername=%s", name),
"mastername=fake-master",
"buildnumber=2",
"slavename=fake-buildslave",
Recipe fixes to support try jobs in task scheduler BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2410843002 Review-Url: https://codereview.chromium.org/2410843002
2016-10-13 13:23:45 +00:00
"nobuildbot=True",
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
fmt.Sprintf("swarm_out_dir=%s", specs.PLACEHOLDER_ISOLATED_OUTDIR),
fmt.Sprintf("revision=%s", specs.PLACEHOLDER_REVISION),
Recipe fixes to support try jobs in task scheduler BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2410843002 Review-Url: https://codereview.chromium.org/2410843002
2016-10-13 13:23:45 +00:00
fmt.Sprintf("patch_storage=%s", specs.PLACEHOLDER_PATCH_STORAGE),
Make buildbotless trybots only support Gerrit BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4460 Change-Id: Ia5630de72f8b473551a5357fdf50eb3dd288b9a7 Reviewed-on: https://skia-review.googlesource.com/4460 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-04 18:37:26 +00:00
fmt.Sprintf("patch_issue=%s", specs.PLACEHOLDER_ISSUE),
fmt.Sprintf("patch_set=%s", specs.PLACEHOLDER_PATCHSET),
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
},
Isolate: "upload_dm_results.isolate",
Priority: 0.8,
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
})
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
return uploadName
}
return name
}
// perf generates a Perf task. Returns the name of the last task in the
// generated chain of tasks, which the Job should add as a dependency.
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
func perf(b *specs.TasksCfgBuilder, name string, parts map[string]string, compileTaskName string, pkgs []*specs.CipdPackage) string {
Add skpbench job This entails a few parts: 1. Isolating tools/skpbench/ to be used by the perf task. 2. Adding skpbench to BUILD_PRODUCTS_ISOLATE_WHITELIST 3. Add recipe commands to run skpbench. While it is conceptually similar to nanobench, it doesn't support images nor svgs, only skps, so we don't need to copy those to devices or bring them in via CIPD. 4. Add recipe commands to parse skpbench output and upload to Perf. 5. Update gen_tasks.go to handle skpbench jobs and tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4551 Change-Id: I09bf0b078067279e138e95eca9316e55539ec735 Reviewed-on: https://skia-review.googlesource.com/4551 Commit-Queue: Kevin Lubick <kjlubick@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2016-11-14 18:42:27 +00:00
recipe := "swarm_perf"
isolate := "perf_skia.isolate"
if strings.Contains(parts["extra_config"], "Skpbench") {
recipe = "swarm_skpbench"
isolate = "skpbench_skia.isolate"
}
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
s := &specs.TaskSpec{
[nobuildbot] Copy timeouts from swarm_trigger BUG=skia: TBR=benjaminwagner GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4642 Change-Id: Ia81609af8ae11c0171c99c459e8711fa786c1e20 Reviewed-on: https://skia-review.googlesource.com/4642 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ben Wagner <benjaminwagner@google.com>
2016-11-09 23:35:15 +00:00
CipdPackages: pkgs,
Dependencies: []string{compileTaskName},
Dimensions: swarmDimensions(parts),
ExecutionTimeout: 4 * time.Hour,
Expiration: 20 * time.Hour,
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
ExtraArgs: []string{
Add skpbench job This entails a few parts: 1. Isolating tools/skpbench/ to be used by the perf task. 2. Adding skpbench to BUILD_PRODUCTS_ISOLATE_WHITELIST 3. Add recipe commands to run skpbench. While it is conceptually similar to nanobench, it doesn't support images nor svgs, only skps, so we don't need to copy those to devices or bring them in via CIPD. 4. Add recipe commands to parse skpbench output and upload to Perf. 5. Update gen_tasks.go to handle skpbench jobs and tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4551 Change-Id: I09bf0b078067279e138e95eca9316e55539ec735 Reviewed-on: https://skia-review.googlesource.com/4551 Commit-Queue: Kevin Lubick <kjlubick@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2016-11-14 18:42:27 +00:00
"--workdir", "../../..", recipe,
Make buildbotless trybots only support Gerrit BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4460 Change-Id: Ia5630de72f8b473551a5357fdf50eb3dd288b9a7 Reviewed-on: https://skia-review.googlesource.com/4460 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-04 18:37:26 +00:00
fmt.Sprintf("repository=%s", specs.PLACEHOLDER_REPO),
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
fmt.Sprintf("buildername=%s", name),
"mastername=fake-master",
"buildnumber=2",
"slavename=fake-buildslave",
Recipe fixes to support try jobs in task scheduler BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2410843002 Review-Url: https://codereview.chromium.org/2410843002
2016-10-13 13:23:45 +00:00
"nobuildbot=True",
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
fmt.Sprintf("swarm_out_dir=%s", specs.PLACEHOLDER_ISOLATED_OUTDIR),
fmt.Sprintf("revision=%s", specs.PLACEHOLDER_REVISION),
Recipe fixes to support try jobs in task scheduler BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2410843002 Review-Url: https://codereview.chromium.org/2410843002
2016-10-13 13:23:45 +00:00
fmt.Sprintf("patch_storage=%s", specs.PLACEHOLDER_PATCH_STORAGE),
Make buildbotless trybots only support Gerrit BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4460 Change-Id: Ia5630de72f8b473551a5357fdf50eb3dd288b9a7 Reviewed-on: https://skia-review.googlesource.com/4460 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-04 18:37:26 +00:00
fmt.Sprintf("patch_issue=%s", specs.PLACEHOLDER_ISSUE),
fmt.Sprintf("patch_set=%s", specs.PLACEHOLDER_PATCHSET),
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
},
[nobuildbot] Copy timeouts from swarm_trigger BUG=skia: TBR=benjaminwagner GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4642 Change-Id: Ia81609af8ae11c0171c99c459e8711fa786c1e20 Reviewed-on: https://skia-review.googlesource.com/4642 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ben Wagner <benjaminwagner@google.com>
2016-11-09 23:35:15 +00:00
IoTimeout: 40 * time.Minute,
Add skpbench job This entails a few parts: 1. Isolating tools/skpbench/ to be used by the perf task. 2. Adding skpbench to BUILD_PRODUCTS_ISOLATE_WHITELIST 3. Add recipe commands to run skpbench. While it is conceptually similar to nanobench, it doesn't support images nor svgs, only skps, so we don't need to copy those to devices or bring them in via CIPD. 4. Add recipe commands to parse skpbench output and upload to Perf. 5. Update gen_tasks.go to handle skpbench jobs and tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4551 Change-Id: I09bf0b078067279e138e95eca9316e55539ec735 Reviewed-on: https://skia-review.googlesource.com/4551 Commit-Queue: Kevin Lubick <kjlubick@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2016-11-14 18:42:27 +00:00
Isolate: isolate,
[nobuildbot] Copy timeouts from swarm_trigger BUG=skia: TBR=benjaminwagner GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4642 Change-Id: Ia81609af8ae11c0171c99c459e8711fa786c1e20 Reviewed-on: https://skia-review.googlesource.com/4642 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ben Wagner <benjaminwagner@google.com>
2016-11-09 23:35:15 +00:00
Priority: 0.8,
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
}
if strings.Contains(parts["extra_config"], "Valgrind") {
s.ExecutionTimeout = 9 * time.Hour
s.Expiration = 48 * time.Hour
s.IoTimeout = time.Hour
} else if strings.Contains(parts["extra_config"], "MSAN") {
s.ExecutionTimeout = 9 * time.Hour
}
b.MustAddTask(name, s)
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
// Upload results if necessary.
if strings.Contains(name, "Release") && doUpload(name) {
uploadName := fmt.Sprintf("%s%s%s", PREFIX_UPLOAD, jobNameSchema.Sep, name)
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
b.MustAddTask(uploadName, &specs.TaskSpec{
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
Dependencies: []string{name},
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
Dimensions: LINUX_GCE_DIMENSIONS,
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
ExtraArgs: []string{
"--workdir", "../../..", "upload_nano_results",
Make buildbotless trybots only support Gerrit BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4460 Change-Id: Ia5630de72f8b473551a5357fdf50eb3dd288b9a7 Reviewed-on: https://skia-review.googlesource.com/4460 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-04 18:37:26 +00:00
fmt.Sprintf("repository=%s", specs.PLACEHOLDER_REPO),
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
fmt.Sprintf("buildername=%s", name),
"mastername=fake-master",
"buildnumber=2",
"slavename=fake-buildslave",
Recipe fixes to support try jobs in task scheduler BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2410843002 Review-Url: https://codereview.chromium.org/2410843002
2016-10-13 13:23:45 +00:00
"nobuildbot=True",
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
fmt.Sprintf("swarm_out_dir=%s", specs.PLACEHOLDER_ISOLATED_OUTDIR),
fmt.Sprintf("revision=%s", specs.PLACEHOLDER_REVISION),
Recipe fixes to support try jobs in task scheduler BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2410843002 Review-Url: https://codereview.chromium.org/2410843002
2016-10-13 13:23:45 +00:00
fmt.Sprintf("patch_storage=%s", specs.PLACEHOLDER_PATCH_STORAGE),
Make buildbotless trybots only support Gerrit BUG=skia:5723 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4460 Change-Id: Ia5630de72f8b473551a5357fdf50eb3dd288b9a7 Reviewed-on: https://skia-review.googlesource.com/4460 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-04 18:37:26 +00:00
fmt.Sprintf("patch_issue=%s", specs.PLACEHOLDER_ISSUE),
fmt.Sprintf("patch_set=%s", specs.PLACEHOLDER_PATCHSET),
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
},
Isolate: "upload_nano_results.isolate",
Priority: 0.8,
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
})
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
return uploadName
}
return name
}
// process generates tasks and jobs for the given job name.
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
func process(b *specs.TasksCfgBuilder, name string) {
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
deps := []string{}
parts, err := jobNameSchema.ParseJobName(name)
if err != nil {
glog.Fatal(err)
}
// RecreateSKPs.
if strings.Contains(name, "RecreateSKPs") {
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
deps = append(deps, recreateSKPs(b, name))
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
}
// CT bots.
if strings.Contains(name, "-CT_") {
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
deps = append(deps, ctSKPs(b, name))
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
}
Add infra_tests.py, recipe, buildbotless bot Have the presubmit (upload) run infra_tests.py if anything in infra/ changed. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2415193002 Review-Url: https://codereview.chromium.org/2415193002
2016-10-14 13:32:09 +00:00
// Infra tests.
if name == "Housekeeper-PerCommit-InfraTests" {
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
deps = append(deps, infra(b, name))
Add infra_tests.py, recipe, buildbotless bot Have the presubmit (upload) run infra_tests.py if anything in infra/ changed. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2415193002 Review-Url: https://codereview.chromium.org/2415193002
2016-10-14 13:32:09 +00:00
}
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
// Compile bots.
if parts["role"] == "Build" {
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
deps = append(deps, compile(b, name, parts))
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
}
[nobuildbot] RecreateSKPs BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4836 Change-Id: Idee05a4b1ea909c5dc1de2e9ebc8c2f9631c78e2 Reviewed-on: https://skia-review.googlesource.com/4836 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2016-11-15 20:18:20 +00:00
// Most remaining bots need a compile task.
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
compileTaskName := deriveCompileTaskName(name, parts)
Add a buildbotless Android bot BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2428603002 Review-Url: https://codereview.chromium.org/2428603002
2016-10-17 17:17:53 +00:00
compileTaskParts, err := jobNameSchema.ParseJobName(compileTaskName)
if err != nil {
glog.Fatal(err)
}
[nobuildbot] Remaining Android devices BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4933 Change-Id: I4e38d25c37e6a336f90e46d2260fcbb4f9899901 Reviewed-on: https://skia-review.googlesource.com/4933 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-17 16:33:27 +00:00
// These bots do not need a compile task.
[nobuildbot] RecreateSKPs BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4836 Change-Id: Idee05a4b1ea909c5dc1de2e9ebc8c2f9631c78e2 Reviewed-on: https://skia-review.googlesource.com/4836 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2016-11-15 20:18:20 +00:00
if parts["role"] != "Build" &&
name != "Housekeeper-PerCommit-InfraTests" &&
[nobuildbot] CT bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=5183 Change-Id: I2d131415c912790cf1aeceaccc23be85ade7f5f0 Reviewed-on: https://skia-review.googlesource.com/5183 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-30 19:05:16 +00:00
!strings.Contains(name, "RecreateSKPs") &&
!strings.Contains(name, "-CT_") {
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
compile(b, compileTaskName, compileTaskParts)
Add a buildbotless Android bot BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2428603002 Review-Url: https://codereview.chromium.org/2428603002
2016-10-17 17:17:53 +00:00
}
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
// Housekeeper.
[nobuildbot] Housekeeper-PerCommit BUG=skia: Change-Id: I9a6a8970bd70dc52334fc44ed29ea942c29132fc Reviewed-on: https://skia-review.googlesource.com/5507 Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-12-02 16:01:33 +00:00
if name == "Housekeeper-PerCommit" {
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
deps = append(deps, housekeeper(b, name, compileTaskName))
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
}
// Common assets needed by the remaining bots.
pkgs := []*specs.CipdPackage{
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
b.MustGetCipdPackageFromAsset("skimage"),
b.MustGetCipdPackageFromAsset("skp"),
b.MustGetCipdPackageFromAsset("svg"),
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
}
gen_tasks.go: Implement TODOs, bring up to speed with swarm_trigger BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4547 Change-Id: Ia22a4836732dd33f30f4f6e4e49f5b39294ec53f Reviewed-on: https://skia-review.googlesource.com/4547 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-08 17:55:32 +00:00
if strings.Contains(name, "Ubuntu") && strings.Contains(name, "SAN") {
pkgs = append(pkgs, b.MustGetCipdPackageFromAsset("clang_linux"))
}
Add skpbench job This entails a few parts: 1. Isolating tools/skpbench/ to be used by the perf task. 2. Adding skpbench to BUILD_PRODUCTS_ISOLATE_WHITELIST 3. Add recipe commands to run skpbench. While it is conceptually similar to nanobench, it doesn't support images nor svgs, only skps, so we don't need to copy those to devices or bring them in via CIPD. 4. Add recipe commands to parse skpbench output and upload to Perf. 5. Update gen_tasks.go to handle skpbench jobs and tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4551 Change-Id: I09bf0b078067279e138e95eca9316e55539ec735 Reviewed-on: https://skia-review.googlesource.com/4551 Commit-Queue: Kevin Lubick <kjlubick@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2016-11-14 18:42:27 +00:00
// Skpbench only needs skps
if strings.Contains(name, "Skpbench") {
pkgs = []*specs.CipdPackage{
b.MustGetCipdPackageFromAsset("skp"),
}
}
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
// Test bots.
[nobuildbot] CT bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=5183 Change-Id: I2d131415c912790cf1aeceaccc23be85ade7f5f0 Reviewed-on: https://skia-review.googlesource.com/5183 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-30 19:05:16 +00:00
if parts["role"] == "Test" && !strings.Contains(name, "-CT_") {
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
deps = append(deps, test(b, name, parts, compileTaskName, pkgs))
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
}
// Perf bots.
[nobuildbot] CT bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=5183 Change-Id: I2d131415c912790cf1aeceaccc23be85ade7f5f0 Reviewed-on: https://skia-review.googlesource.com/5183 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-30 19:05:16 +00:00
if parts["role"] == "Perf" && !strings.Contains(name, "-CT_") {
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
deps = append(deps, perf(b, name, parts, compileTaskName, pkgs))
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
}
// Add the Job spec.
[nobuildbot] RecreateSKPs BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4836 Change-Id: Idee05a4b1ea909c5dc1de2e9ebc8c2f9631c78e2 Reviewed-on: https://skia-review.googlesource.com/4836 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2016-11-15 20:18:20 +00:00
j := &specs.JobSpec{
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
Priority: 0.8,
TaskSpecs: deps,
[nobuildbot] RecreateSKPs BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4836 Change-Id: Idee05a4b1ea909c5dc1de2e9ebc8c2f9631c78e2 Reviewed-on: https://skia-review.googlesource.com/4836 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2016-11-15 20:18:20 +00:00
}
if name == "Housekeeper-Nightly-RecreateSKPs_Canary" {
j.Trigger = "nightly"
}
if name == "Housekeeper-Weekly-RecreateSKPs" {
j.Trigger = "weekly"
}
[nobuildbot] CT bots BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=5183 Change-Id: I2d131415c912790cf1aeceaccc23be85ade7f5f0 Reviewed-on: https://skia-review.googlesource.com/5183 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2016-11-30 19:05:16 +00:00
if name == "Test-Ubuntu-GCC-GCE-CPU-AVX2-x86_64-Debug-CT_DM_1m_SKPs" {
j.Trigger = "weekly"
}
gen_tasks.go: Assert that all compile tasks are in the JOBS list Rather than auto-adding the Job, assert that it's listed. This enforces that the JOBS list is accurate. Add all missing compile Jobs to the list. BUG=skia: Change-Id: Ic7a90165ccac36baa52a4674798977021d6812d7 Reviewed-on: https://skia-review.googlesource.com/5848 Reviewed-by: Mike Klein <mtklein@chromium.org> Commit-Queue: Eric Boren <borenet@google.com>
2016-12-12 19:30:12 +00:00
b.MustAddJob(name, j)
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
}
// Regenerate the tasks.json file.
func main() {
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
b := specs.MustNewTasksCfgBuilder()
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
// Create the JobNameSchema.
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
schema, err := NewJobNameSchema(path.Join(b.CheckoutRoot(), "infra", "bots", "recipe_modules", "builder_name_schema", "builder_name_schema.json"))
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
if err != nil {
glog.Fatal(err)
}
jobNameSchema = schema
// Create Tasks and Jobs.
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
for _, name := range JOBS {
process(b, name)
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
}
gen_tasks.go: Use new helpers from specs package BUG=skia:5626 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2438043002 Review-Url: https://chromiumcodereview.appspot.com/2438043002
2016-10-20 18:04:31 +00:00
b.MustFinish()
[task scheduler] Add gen_tasks.go This mimics the flow of infra/bots/recipes/swarm_trigger.py but it builds the tasks.json file instead of triggering the actual tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2386663002 Review-Url: https://codereview.chromium.org/2386663002
2016-09-30 19:53:12 +00:00
}
// TODO(borenet): The below really belongs in its own file, probably next to the
// builder_name_schema.json file.
// JobNameSchema is a struct used for (de)constructing Job names in a
// predictable format.
type JobNameSchema struct {
Schema map[string][]string `json:"builder_name_schema"`
Sep string `json:"builder_name_sep"`
}
// NewJobNameSchema returns a JobNameSchema instance based on the given JSON
// file.
func NewJobNameSchema(jsonFile string) (*JobNameSchema, error) {
var rv JobNameSchema
f, err := os.Open(jsonFile)
if err != nil {
return nil, err
}
defer util.Close(f)
if err := json.NewDecoder(f).Decode(&rv); err != nil {
return nil, err
}
return &rv, nil
}
// ParseJobName splits the given Job name into its component parts, according
// to the schema.
func (s *JobNameSchema) ParseJobName(n string) (map[string]string, error) {
split := strings.Split(n, s.Sep)
if len(split) < 2 {
return nil, fmt.Errorf("Invalid job name: %q", n)
}
role := split[0]
split = split[1:]
keys, ok := s.Schema[role]
if !ok {
return nil, fmt.Errorf("Invalid job name; %q is not a valid role.", role)
}
extraConfig := ""
if len(split) == len(keys)+1 {
extraConfig = split[len(split)-1]
split = split[:len(split)-1]
}
if len(split) != len(keys) {
return nil, fmt.Errorf("Invalid job name; %q has incorrect number of parts.", n)
}
rv := make(map[string]string, len(keys)+2)
rv["role"] = role
if extraConfig != "" {
rv["extra_config"] = extraConfig
}
for i, k := range keys {
rv[k] = split[i]
}
return rv, nil
}
// MakeJobName assembles the given parts of a Job name, according to the schema.
func (s *JobNameSchema) MakeJobName(parts map[string]string) (string, error) {
role, ok := parts["role"]
if !ok {
return "", fmt.Errorf("Invalid job parts; jobs must have a role.")
}
keys, ok := s.Schema[role]
if !ok {
return "", fmt.Errorf("Invalid job parts; unknown role %q", role)
}
rvParts := make([]string, 0, len(parts))
rvParts = append(rvParts, role)
for _, k := range keys {
v, ok := parts[k]
if !ok {
return "", fmt.Errorf("Invalid job parts; missing %q", k)
}
rvParts = append(rvParts, v)
}
if _, ok := parts["extra_config"]; ok {
rvParts = append(rvParts, parts["extra_config"])
}
return strings.Join(rvParts, s.Sep), nil
}
Reference in New Issue Copy Permalink