epoger@google.com
f711f320a3
GM: add --ignoreFailuresFile as an alternative to --ignoreTests
...
(moved from old review at https://codereview.chromium.org/27752002/ )
This will allow the user to specify the tests to ignore failure on as a file,
rather than listing them out in the command line (and thus busting the
line length limit on Android).
BUG=skia:1730
R=scroggo@google.com
Review URL: https://codereview.chromium.org/29203002
git-svn-id: http://skia.googlecode.com/svn/trunk@11855 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-10-18 14:55:47 +00:00
epoger@google.com
1ddfbc201a
gm: if test has no expectations, record its result as no-expectations regardless of ignoreFailure
...
After https://code.google.com/p/skia/source/detail?r=11640 ('Ignore any
pdf-poppler GM failures'), there are a bunch of pdf-poppler tests showing up
as failure-ignored at http://c128.i.corp.google.com/production-gm-diffs/latest/view.html
Make them go away.
R=scroggo@google.com
Review URL: https://codereview.chromium.org/26650005
git-svn-id: http://skia.googlecode.com/svn/trunk@11703 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-10-10 17:24:20 +00:00
epoger@google.com
3a882dda07
GM: Allow ignored-tests.txt to list configs as well as tests (and combinations too)
...
BUG=skia:1657
This will allow us to ignore poppler failures until bug 1657 is resolved
(but this CL doesn't actually make that change to ignored-tests.txt yet)
R=scroggo@google.com
Review URL: https://codereview.chromium.org/26294004
git-svn-id: http://skia.googlecode.com/svn/trunk@11639 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-10-07 18:55:09 +00:00
epoger@google.com
5e49738c99
revert temporary r11517
...
Review URL: https://codereview.chromium.org/25215002
git-svn-id: http://skia.googlecode.com/svn/trunk@11518 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-09-30 07:01:55 +00:00
epoger@google.com
19fcd8e2ef
gm: temporarily re-enable multiple rendermodes, to make sure they haven't regressed
...
Review URL: https://codereview.chromium.org/25213002
git-svn-id: http://skia.googlecode.com/svn/trunk@11517 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-09-30 06:29:19 +00:00
epoger@google.com
defc487aa9
gm: add --ignoreTests flag
...
BUG=skia:1600
R=scroggo@google.com
Review URL: https://codereview.chromium.org/23526065
git-svn-id: http://skia.googlecode.com/svn/trunk@11374 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-09-19 06:18:27 +00:00
epoger@google.com
33aa55a077
revert temporary r11371
...
BUG=skia:1641
Review URL: https://codereview.chromium.org/24256003
git-svn-id: http://skia.googlecode.com/svn/trunk@11373 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-09-19 06:09:32 +00:00
epoger@google.com
1a7e09e2dd
gm: temporarily re-enable multiple rendermodes, to make sure they haven't regressed
...
BUG=skia:1641
Review URL: https://codereview.chromium.org/24153020
git-svn-id: http://skia.googlecode.com/svn/trunk@11371 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-09-19 05:25:17 +00:00
epoger@google.com
3ad5dd009f
Speed up GM ~50% by NOT running most renderModes by default
...
BUG=skia:1566
R=borenet@google.com , bsalomon@google.com
Review URL: https://codereview.chromium.org/23889030
git-svn-id: http://skia.googlecode.com/svn/trunk@11265 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-09-13 19:56:14 +00:00
epoger@google.com
5852c8b06d
gm: add self-test to confirm that ignore-failure field is respected
...
BUG=skia:1578
R=scroggo@google.com
Review URL: https://codereview.chromium.org/23799004
git-svn-id: http://skia.googlecode.com/svn/trunk@11047 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-08-30 20:19:25 +00:00
epoger@google.com
e33e137623
GM: stop recording all *_pdf.png results as "INVALID" on non-Mac platforms
...
BUG=https://code.google.com/p/skia/issues/detail?id=1352
R=edisonn@google.com
Review URL: https://codereview.chromium.org/17366003
git-svn-id: http://skia.googlecode.com/svn/trunk@9912 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-07-08 19:13:33 +00:00
epoger@google.com
5f99545de6
GM: add --missingExpectationsPath option, similar to --mismatchPath
...
This will allow us to make the buildbots record all images EXCEPT those which
match expectations to Google Storage.
R=borenet@google.com
Review URL: https://codereview.chromium.org/17552012
git-svn-id: http://skia.googlecode.com/svn/trunk@9725 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-06-21 18:16:47 +00:00
epoger@google.com
6f7f14d061
Reland r9682, using new SkString::appendU64()
...
Review URL: https://codereview.chromium.org/17157005
git-svn-id: http://skia.googlecode.com/svn/trunk@9687 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-06-19 18:28:31 +00:00
epoger@google.com
628de5f1f4
Reverting r9682, which broke on some compilers
...
git-svn-id: http://skia.googlecode.com/svn/trunk@9684 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-06-19 15:58:00 +00:00
epoger@google.com
6324ac5d81
GM: add --writeChecksumBasedFilenames option
...
as needed for Step 2 of https://goto.google.com/ChecksumTransitionDetail :
make GenerateGMs upload actual images to Google Storage instead of skia-autogen
R=scroggo@google.com
Review URL: https://codereview.chromium.org/17365002
git-svn-id: http://skia.googlecode.com/svn/trunk@9682 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-06-19 15:50:09 +00:00
epoger@google.com
a55e48d6ef
Improve tool that analyzes gm JSON summary
...
BUG=https://code.google.com/p/skia/issues/detail?id=1300
R=borenet@google.com
Review URL: https://codereview.chromium.org/15298010
git-svn-id: http://skia.googlecode.com/svn/trunk@9217 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-05-21 16:06:40 +00:00
epoger@google.com
37d747d383
GM self-tests: add testing for non --hierarchy case
...
R=scroggo@google.com
Review URL: https://codereview.chromium.org/15397007
git-svn-id: http://skia.googlecode.com/svn/trunk@9214 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-05-21 15:41:35 +00:00
epoger@google.com
26515baa90
Add gm/confirm_no_failures_in_json.py
...
The CompareGMs step will use this (instead of running skdiff over the image
files) to decide whether to go red or green.
R=rmistry@google.com
Review URL: https://codereview.chromium.org/15100003
git-svn-id: http://skia.googlecode.com/svn/trunk@9127 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-05-14 18:58:12 +00:00
epoger@google.com
ee2c3b9fb3
GM self-test: add --writePath and --mismatchPath , but in a way that works cross-platform
...
R=scroggo@google.com
Review URL: https://codereview.chromium.org/15085007
git-svn-id: http://skia.googlecode.com/svn/trunk@9077 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-05-09 18:09:06 +00:00
epoger@google.com
fed9db6930
GM self-test: add option to exercise --writePath and --mismatchPath, but not on bots
...
(individual developers can set WRITE_IMAGE_FILES=1 for local testing)
R=rmistry@google.com
Review URL: https://codereview.chromium.org/14863009
git-svn-id: http://skia.googlecode.com/svn/trunk@9056 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-05-08 14:10:28 +00:00
epoger@google.com
0cc99cf793
GM self-tests: always run all tests (don't stop at first failure)
...
and make rebaseline.sh rebaseline all tests in one go.
(RunBuilders:Skia_PerCommit_House_Keeping)
Review URL: https://codereview.chromium.org/13979017
git-svn-id: http://skia.googlecode.com/svn/trunk@8881 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-26 17:45:06 +00:00
epoger@google.com
318a059a0c
GM: add self-test that sets --readPath to a nonexistent directory path
...
Review URL: https://codereview.chromium.org/13844011
git-svn-id: http://skia.googlecode.com/svn/trunk@8664 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-12 19:05:57 +00:00
epoger@google.com
5079d2c2a0
GM: allow caller to specify which result types trigger an error
...
Review URL: https://codereview.chromium.org/14187007
git-svn-id: http://skia.googlecode.com/svn/trunk@8652 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-12 14:11:21 +00:00
epoger@google.com
51dbabee67
gm: hide list of tests with ignored errors, by default
...
Review URL: https://codereview.chromium.org/13811031
git-svn-id: http://skia.googlecode.com/svn/trunk@8591 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-10 15:24:53 +00:00
epoger@google.com
c8263e7041
gm: record IntentionallySkipped tests
...
Review URL: https://codereview.chromium.org/13663003
git-svn-id: http://skia.googlecode.com/svn/trunk@8586 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-10 12:17:34 +00:00
epoger@google.com
caac3db48f
re-land r8535, now that src.chromium.org is back up
...
Review URL: https://codereview.chromium.org/13662002
git-svn-id: http://skia.googlecode.com/svn/trunk@8538 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-04 19:23:11 +00:00
epoger@google.com
67caaf8792
Revert r8535
...
git-svn-id: http://skia.googlecode.com/svn/trunk@8536 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-04 18:21:48 +00:00
epoger@google.com
da8db9837e
gm: report ExpectationsMismatch and RenderModeMismatch results separately
...
Review URL: https://codereview.chromium.org/13650002
git-svn-id: http://skia.googlecode.com/svn/trunk@8535 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-04 18:11:31 +00:00
epoger@google.com
0b62b3dd1c
gm refactor: extract run_multiple_configs() and run_multiple_modes()
...
Review URL: https://codereview.chromium.org/12536007
git-svn-id: http://skia.googlecode.com/svn/trunk@8269 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-20 17:59:28 +00:00
scroggo@google.com
09fd4d2169
Reland r8235 "Switch gm to use SkFlags."
...
This time, using #if guards for gpuCacheSize consistently.
Also fix some warnings.
BUG=https://code.google.com/p/skia/issues/detail?id=1094
Review URL: https://codereview.chromium.org/12440052
git-svn-id: http://skia.googlecode.com/svn/trunk@8254 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-20 14:20:18 +00:00
scroggo@google.com
0b735631b7
Revert "Make gm use SkFlags."
...
Fix the build.
This reverts commit 6f1fe2aee39308fc56854b062be244a904c209e7.
Review URL: https://codereview.chromium.org/12709005
git-svn-id: http://skia.googlecode.com/svn/trunk@8236 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-19 17:38:50 +00:00
scroggo@google.com
7d519305bb
Make gm use SkFlags.
...
Make flag parser its own project. It is still in the tools folder,
but can now be used by other projects.
Some changes to behavior in order to work with SkFlags:
enable-missing-warning and disable-missing-warning have become
enableMissingWarning and noenableMissingWarning.
exclude-config is now excludeConfig
--config now can only be listed once, but all configs listed
after it will be included (same with excludeConfig and match).
In addition, writeJsonSummary has been changed to
writeJsonSummaryPath for consistency with other path flags.
Provide an option to SkFlags to provide a short name, and use
it for the flags which have short names.
--tileGridReplayScales now takes space separated arguments,
like other inputs.
BUG=https://code.google.com/p/skia/issues/detail?id=1094
Review URL: https://codereview.chromium.org/12632015
git-svn-id: http://skia.googlecode.com/svn/trunk@8235 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-19 17:28:10 +00:00
epoger@google.com
5efdd0cb9c
gm: write all messages to stdout/stderr with "GM:" preamble to distinguish from various debug messages coming from elsewhere
...
Review URL: https://codereview.chromium.org/12691009
git-svn-id: http://skia.googlecode.com/svn/trunk@8126 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-13 14:18:40 +00:00
epoger@google.com
b9ba1eadc8
gm self-test: make all test cases exercise transparency
...
BUG=https://code.google.com/p/skia/issues/detail?id=1142
Review URL: https://codereview.chromium.org/12379047
git-svn-id: http://skia.googlecode.com/svn/trunk@7943 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-02 19:56:18 +00:00
epoger@google.com
c5d71e2a97
gm self-test: disable spuriously-failing aaclip tests
...
Review URL: https://codereview.chromium.org/12377049
git-svn-id: http://skia.googlecode.com/svn/trunk@7927 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-01 16:46:49 +00:00
commit-bot@chromium.org
c61c3c3101
gm self-test: use a pathologically simple test case instead of dashing2
...
BUG=https://code.google.com/p/skia/issues/detail?id=677
Review URL: https://chromiumcodereview.appspot.com/12381038
git-svn-id: http://skia.googlecode.com/svn/trunk@7922 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-01 15:32:34 +00:00
epoger@google.com
d271d245e9
gm: Add ability to compare against checksums (as opposed to image files)
...
Review URL: https://codereview.appspot.com/7306071
git-svn-id: http://skia.googlecode.com/svn/trunk@7724 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-02-13 18:14:48 +00:00
epoger@google.com
e460a4718c
gm self-tests: generate JSON expectations, in addition to image expectations
...
Review URL: https://codereview.appspot.com/7310050
git-svn-id: http://skia.googlecode.com/svn/trunk@7624 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-02-06 18:41:04 +00:00
epoger@google.com
4688de1ee5
gm self-tests: add 565 mode testing, in addition to 8888 mode
...
Review URL: https://codereview.appspot.com/7229061
git-svn-id: http://skia.googlecode.com/svn/trunk@7489 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-31 15:06:36 +00:00
epoger@google.com
666c5cf3af
Fix bugs in r7291
...
TBR=reed
Review URL: https://codereview.appspot.com/7129057
git-svn-id: http://skia.googlecode.com/svn/trunk@7292 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-19 04:56:36 +00:00
epoger@google.com
3726960733
re-land r7258 with fixes and tests
...
BUG=http://code.google.com/p/skia/issues/detail?id=1079
TBR=reed
Review URL: https://codereview.appspot.com/7132060
git-svn-id: http://skia.googlecode.com/svn/trunk@7291 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-19 04:21:27 +00:00
epoger@google.com
80d447893e
gm self-test: followup to r7284
...
TBR=rmistry
Review URL: https://codereview.appspot.com/7128056
git-svn-id: http://skia.googlecode.com/svn/trunk@7286 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-18 20:03:58 +00:00
epoger@google.com
407f8da4f4
make gm self-test more robust
...
BUG=http://code.google.com/p/skia/issues/detail?id=1068
Review URL: https://codereview.appspot.com/7164043
git-svn-id: http://skia.googlecode.com/svn/trunk@7284 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-18 19:19:47 +00:00
epoger@google.com
98204f9301
better quick fix for GM self-test: ignore instance-counting lines in Debug output
...
BUG=http://code.google.com/p/skia/issues/detail?id=1068
Review URL: https://codereview.appspot.com/7127044
git-svn-id: http://skia.googlecode.com/svn/trunk@7214 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-16 04:19:01 +00:00
epoger@google.com
3aa3358c03
Add more warnings about https://code.google.com/p/skia/issues/detail?id=677 ('make tools/tests/run.sh work cross-platform')
...
git-svn-id: http://skia.googlecode.com/svn/trunk@6965 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-02 15:53:25 +00:00
epoger@google.com
9c56a8dea6
Make gm's json results include checksums even if run without --readPath
...
Review URL: https://codereview.appspot.com/6979043
git-svn-id: http://skia.googlecode.com/svn/trunk@6917 2bbb7eff-a529-9590-31e7-b0007b416f81
2012-12-20 18:34:29 +00:00
epoger@google.com
ee8a8e3931
Re-land r6843 with copied gyp file to (hopefully) fix Windows build
...
BUG=https://code.google.com/p/skia/issues/detail?id=1023
Review URL: https://codereview.appspot.com/6943073
git-svn-id: http://skia.googlecode.com/svn/trunk@6880 2bbb7eff-a529-9590-31e7-b0007b416f81
2012-12-18 19:13:49 +00:00
epoger@google.com
33352d9623
Roll out r6843 to hopefully fix Windows builds
...
BUG=https://code.google.com/p/skia/issues/detail?id=1023
TBR=borenet
Review URL: https://codereview.appspot.com/6942061
git-svn-id: http://skia.googlecode.com/svn/trunk@6849 2bbb7eff-a529-9590-31e7-b0007b416f81
2012-12-17 18:23:58 +00:00
epoger@google.com
6c0e5225a0
Add --writeJsonSummary option to gm
...
This writes out a JSON file containing expected and actual checksum values for every test.
Next step: allow the same checksum file to be compared against, instead of PNG files.
Review URL: https://codereview.appspot.com/6940053
git-svn-id: http://skia.googlecode.com/svn/trunk@6843 2bbb7eff-a529-9590-31e7-b0007b416f81
2012-12-17 15:27:30 +00:00
epoger@google.com
8a6f13a20d
Add script to help rebaseline gm self-tests, and run it right now
...
BUG=https://code.google.com/p/skia/issues/detail?id=995
TBR=rmistry
Review URL: https://codereview.appspot.com/6887046
git-svn-id: http://skia.googlecode.com/svn/trunk@6683 2bbb7eff-a529-9590-31e7-b0007b416f81
2012-12-05 20:21:35 +00:00