epoger@google.com
b248dd5294
rebaseline.py: re-record already succeeding test results, just in case
...
TBR=borenet
Review URL: https://codereview.chromium.org/19459002
git-svn-id: http://skia.googlecode.com/svn/trunk@10121 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-07-17 00:09:10 +00:00
epoger@google.com
4b38301a57
rebaseline.py: fix --add-new for JSON files
...
TBR=borenet
Review URL: https://codereview.chromium.org/19415002
git-svn-id: http://skia.googlecode.com/svn/trunk@10117 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-07-16 21:10:54 +00:00
epoger@google.com
61822a25d3
svndiff.py: add ability to compare before-and-after JSON files, not just raw images
...
This should complete step 3 of https://goto.google.com/ChecksumTransitionDetail !
R=borenet@google.com
Review URL: https://codereview.chromium.org/19112002
git-svn-id: http://skia.googlecode.com/svn/trunk@10113 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-07-16 18:56:32 +00:00
epoger@google.com
ffcbdbfe6a
rebaseline.py: add --keep-going-on-failure option, off by default
...
R=borenet@google.com
Review URL: https://codereview.chromium.org/18092004
git-svn-id: http://skia.googlecode.com/svn/trunk@10109 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-07-16 17:35:39 +00:00
epoger@google.com
66ba9f978f
rebaseline.py: skip any platforms we don't have actual results for, with warning message
...
R=borenet@google.com
Review URL: https://codereview.chromium.org/19052007
git-svn-id: http://skia.googlecode.com/svn/trunk@10022 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-07-11 19:20:30 +00:00
epoger@google.com
3e7399fe28
Fix Housekeeper bot after r9961
...
git-svn-id: http://skia.googlecode.com/svn/trunk@9965 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-07-10 17:23:47 +00:00
epoger@google.com
89fa4b9ee6
rebaseline.py: error out early if --expectations-root not pointing at gm-expected dir
...
BUG=https://code.google.com/p/skia/issues/detail?id=1403
R=senorblanco@chromium.org
Review URL: https://codereview.chromium.org/18416005
git-svn-id: http://skia.googlecode.com/svn/trunk@9961 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-07-10 16:54:10 +00:00
epoger@google.com
9de25e3fd4
rebaseline.py: use specified configs/tests as a FILTER over actually-run tests
...
Now that we have the actual-results.json file for every bot type, we know
the full set of tests that actual results are available for. If configs and/or
tests are specified, just use those as FILTERS over the actually available
results.
R=senorblanco@chromium.org
Review URL: https://codereview.chromium.org/18324018
git-svn-id: http://skia.googlecode.com/svn/trunk@9956 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-07-10 15:27:18 +00:00
epoger@google.com
a783f2bee8
rebaseline.py: if expectations dir contains JSON format results, update those instead of image files
...
Part of Step 3 in https://goto.google.com/ChecksumTransitionDetail
R=senorblanco@chromium.org
Review URL: https://codereview.chromium.org/18348018
git-svn-id: http://skia.googlecode.com/svn/trunk@9910 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-07-08 17:51:58 +00:00
robertphillips@google.com
63e9627fca
Add N4 to rebaseline.py
...
https://codereview.chromium.org/18023014/
(SkipBuildbotRuns)
git-svn-id: http://skia.googlecode.com/svn/trunk@9859 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-07-02 12:54:37 +00:00
epoger@google.com
99a8ec9705
rebaseline.py: split image-based rebaselining, which will go away soon, into its own script
...
(part of step 3 in https://goto.google.com/ChecksumTransitionDetail )
also adds new --expectations-root option
R=scroggo@google.com , senorblanco@chromium.org
Review URL: https://codereview.chromium.org/17379004
git-svn-id: http://skia.googlecode.com/svn/trunk@9689 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-06-19 18:56:59 +00:00
epoger@google.com
bd4af3a9a6
rebaseline.py: keep going if we encounter an "INVALID" entry in the JSON file
...
Review URL: https://codereview.chromium.org/16826003
git-svn-id: http://skia.googlecode.com/svn/trunk@9543 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-06-12 19:07:00 +00:00
epoger@google.com
e78d20798d
rebaseline.py: try to download images from Google Storage before skia-autogen
...
This will allow us to complete Step 1 of https://goto.google.com/ChecksumTransitionDetail
R=scroggo@google.com
Review URL: https://codereview.chromium.org/16311011
git-svn-id: http://skia.googlecode.com/svn/trunk@9534 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-06-12 17:44:14 +00:00
epoger@google.com
dad5310ab6
rebaseline.py: add --add-new option, and only add new expectations if it is set
...
R=senorblanco@chromium.org
Review URL: https://codereview.chromium.org/16363006
git-svn-id: http://skia.googlecode.com/svn/trunk@9527 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-06-12 14:25:30 +00:00
epoger@google.com
cc2e1cf13c
rebaseline.py: improve readability of dry-run output
...
Split off of already-reviewed https://codereview.chromium.org/15789010/ ('rebaseline.py: --tests and --configs are now FILTERS within json results')
Review URL: https://codereview.chromium.org/16509006
git-svn-id: http://skia.googlecode.com/svn/trunk@9507 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-06-11 16:24:37 +00:00
epoger@google.com
bda4e91596
rebaseline.py: if rebaselining all platforms (not listing them explicitly), allow missing platforms
...
TBR=any-reviewer
Review URL: https://codereview.chromium.org/16782003
git-svn-id: http://skia.googlecode.com/svn/trunk@9506 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-06-11 16:16:02 +00:00
epoger@google.com
82f317815e
rebaseline.py: in option names, replace underscores with hyphens
...
Split off of already-reviewed https://codereview.chromium.org/15789010/ ('rebaseline.py: --tests and --configs are now FILTERS within json results')
Review URL: https://codereview.chromium.org/15904018
git-svn-id: http://skia.googlecode.com/svn/trunk@9504 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-06-11 15:45:46 +00:00
epoger@google.com
99ba65a181
rebaseline.py: if --tests is not specified, get test list from actual-results.json
...
R=scroggo@google.com
Review URL: https://codereview.chromium.org/16093025
git-svn-id: http://skia.googlecode.com/svn/trunk@9443 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-06-05 15:43:37 +00:00
epoger@google.com
db29a310f7
rebaseline.py : add self-tests
...
R=senorblanco@chromium.org
Review URL: https://codereview.chromium.org/15660014
git-svn-id: http://skia.googlecode.com/svn/trunk@9426 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-06-04 14:58:47 +00:00
epoger@google.com
9166bf57d8
rebaseline.py: use argparse command-line flags for more flexibility
...
--tests is the only mandatory argument.
If you used to run this:
rebaseline.py aaclip bigmatrix
Run this instead:
rebaseline.py --tests aaclip bigmatrix
That's the only change you NEED to make.
And then, if you WANT to specify --configs, --subdirs, etc. you CAN.
R=senorblanco@chromium.org
Review URL: https://codereview.chromium.org/15675010
git-svn-id: http://skia.googlecode.com/svn/trunk@9348 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-05-30 15:46:19 +00:00
epoger@google.com
ec3397bb6c
Refactor rebaseline.py into functions ; no behavioral changes.
...
R=senorblanco@chromium.org
Review URL: https://codereview.chromium.org/16160008
git-svn-id: http://skia.googlecode.com/svn/trunk@9318 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-05-29 17:09:43 +00:00
bsalomon@google.com
7d01ec478f
Make rebaseline.py pull msaa images
...
R=robertphillips@google.com
Review URL: https://codereview.chromium.org/15299005
git-svn-id: http://skia.googlecode.com/svn/trunk@9179 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-05-17 14:10:59 +00:00
bsalomon@google.com
3c58723202
Update rebaseline.py for N10.
...
R=jvanverth@google.com
Review URL: https://codereview.chromium.org/14581014
git-svn-id: http://skia.googlecode.com/svn/trunk@9126 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-05-14 18:20:00 +00:00
bsalomon@google.com
cb3c8d7e6a
Make rebaseline.py pull GN Debug images.
...
R=senorblanco@chromium.org
Review URL: https://codereview.chromium.org/14743004
git-svn-id: http://skia.googlecode.com/svn/trunk@8999 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-05-03 20:24:54 +00:00
borenet@google.com
e6598a04a7
Fix builder name references
...
... as a result of https://codereview.chromium.org/14517004/
(SkipBuildbotRuns)
R=bensong@google.com , rmistry@google.com , senorblanco@chromium.org
Review URL: https://codereview.chromium.org/14544003
git-svn-id: http://skia.googlecode.com/svn/trunk@8921 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-30 12:02:32 +00:00
senorblanco@chromium.org
0b6dc190bb
Rebaseline script: check for .git and .svn in the current directory as well. Add mesa to list of configs to update.
...
R=bsalomon@google.com
Review URL: https://codereview.appspot.com/6908050
git-svn-id: http://skia.googlecode.com/svn/trunk@6707 2bbb7eff-a529-9590-31e7-b0007b416f81
2012-12-07 17:19:07 +00:00
bungeman@google.com
df6fe603a5
No longer generating 4444, remove from rebaseline tool.
...
https://codereview.appspot.com/6886048/
git-svn-id: http://skia.googlecode.com/svn/trunk@6692 2bbb7eff-a529-9590-31e7-b0007b416f81
2012-12-06 19:16:36 +00:00
senorblanco@chromium.org
123a0b5fbf
rebaseline.py: Allow multiple testnames on the command line.
...
Review URL: https://codereview.appspot.com/6856118
git-svn-id: http://skia.googlecode.com/svn/trunk@6623 2bbb7eff-a529-9590-31e7-b0007b416f81
2012-11-29 21:50:34 +00:00
senorblanco@chromium.org
79fc6fcc59
Add Git support to the simple rebaseline tool. Do SVN commands only in an svn checkout.
...
Review URL: https://codereview.appspot.com/6814099
git-svn-id: http://skia.googlecode.com/svn/trunk@6341 2bbb7eff-a529-9590-31e7-b0007b416f81
2012-11-07 22:32:12 +00:00
senorblanco@chromium.org
5682f21f99
Simple rebaseline tool: Add support for ANGLE, DirectWrite builders.
...
Set svn mime type to image/png.
Review URL: https://codereview.appspot.com/6820054
git-svn-id: http://skia.googlecode.com/svn/trunk@6199 2bbb7eff-a529-9590-31e7-b0007b416f81
2012-10-30 14:34:55 +00:00
senorblanco@chromium.org
782f3b4230
First stab at a simple rebaseline script.
...
Review URL: https://codereview.appspot.com/6775045
git-svn-id: http://skia.googlecode.com/svn/trunk@6170 2bbb7eff-a529-9590-31e7-b0007b416f81
2012-10-29 18:06:26 +00:00