epoger@google.com
0cc99cf793
GM self-tests: always run all tests (don't stop at first failure)
...
and make rebaseline.sh rebaseline all tests in one go.
(RunBuilders:Skia_PerCommit_House_Keeping)
Review URL: https://codereview.chromium.org/13979017
git-svn-id: http://skia.googlecode.com/svn/trunk@8881 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-26 17:45:06 +00:00
epoger@google.com
76c913db20
GM: specify that currently used checksums are CityHashes of SkBitmaps
...
(distinct from other hash algorithms we may switch to, or hashes of
files such as PDFs that cannot be read into an SkBitmap)
Review URL: https://codereview.chromium.org/14284018
git-svn-id: http://skia.googlecode.com/svn/trunk@8877 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-26 15:06:44 +00:00
bsalomon@google.com
dd8e353bef
Add option to specify defaults configs to --config flag in gm. This makes it easier to run gm defaults configs with a delta. Also make ~ exclude a config.
...
Review URL: https://codereview.chromium.org/13842014
git-svn-id: http://skia.googlecode.com/svn/trunk@8842 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-24 18:07:11 +00:00
epoger@google.com
318a059a0c
GM: add self-test that sets --readPath to a nonexistent directory path
...
Review URL: https://codereview.chromium.org/13844011
git-svn-id: http://skia.googlecode.com/svn/trunk@8664 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-12 19:05:57 +00:00
epoger@google.com
5079d2c2a0
GM: allow caller to specify which result types trigger an error
...
Review URL: https://codereview.chromium.org/14187007
git-svn-id: http://skia.googlecode.com/svn/trunk@8652 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-12 14:11:21 +00:00
epoger@google.com
bcbf5aa77d
GM: print list of GMs run, even in non-verbose mode (rolls back part of r8600)
...
Review URL: https://codereview.chromium.org/14052003
git-svn-id: http://skia.googlecode.com/svn/trunk@8638 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-12 02:11:54 +00:00
epoger@google.com
b0f8b430de
GM: remove enableMissingWarning in favor of verbose flag, and trim output in nonverbose mode
...
Review URL: https://codereview.chromium.org/14080003
git-svn-id: http://skia.googlecode.com/svn/trunk@8600 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-10 18:46:25 +00:00
epoger@google.com
51dbabee67
gm: hide list of tests with ignored errors, by default
...
Review URL: https://codereview.chromium.org/13811031
git-svn-id: http://skia.googlecode.com/svn/trunk@8591 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-10 15:24:53 +00:00
epoger@google.com
c8263e7041
gm: record IntentionallySkipped tests
...
Review URL: https://codereview.chromium.org/13663003
git-svn-id: http://skia.googlecode.com/svn/trunk@8586 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-10 12:17:34 +00:00
epoger@google.com
caac3db48f
re-land r8535, now that src.chromium.org is back up
...
Review URL: https://codereview.chromium.org/13662002
git-svn-id: http://skia.googlecode.com/svn/trunk@8538 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-04 19:23:11 +00:00
epoger@google.com
67caaf8792
Revert r8535
...
git-svn-id: http://skia.googlecode.com/svn/trunk@8536 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-04 18:21:48 +00:00
epoger@google.com
da8db9837e
gm: report ExpectationsMismatch and RenderModeMismatch results separately
...
Review URL: https://codereview.chromium.org/13650002
git-svn-id: http://skia.googlecode.com/svn/trunk@8535 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-04 18:11:31 +00:00
epoger@google.com
310478e72c
re-land r8514 without breaking 32-bit Mac compilers
...
Review URL: https://codereview.chromium.org/13427004
git-svn-id: http://skia.googlecode.com/svn/trunk@8518 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-03 18:00:39 +00:00
epoger@google.com
2212c2e35c
roll out r8514
...
Review URL: https://codereview.chromium.org/13503003
git-svn-id: http://skia.googlecode.com/svn/trunk@8515 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-03 17:12:42 +00:00
epoger@google.com
f60494ba0b
gm: display summary of all results by ErrorType
...
as discussed in https://codereview.chromium.org/12825005/#msg14
Review URL: https://codereview.chromium.org/12851022
git-svn-id: http://skia.googlecode.com/svn/trunk@8514 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-04-03 17:02:53 +00:00
epoger@google.com
0b62b3dd1c
gm refactor: extract run_multiple_configs() and run_multiple_modes()
...
Review URL: https://codereview.chromium.org/12536007
git-svn-id: http://skia.googlecode.com/svn/trunk@8269 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-20 17:59:28 +00:00
scroggo@google.com
09fd4d2169
Reland r8235 "Switch gm to use SkFlags."
...
This time, using #if guards for gpuCacheSize consistently.
Also fix some warnings.
BUG=https://code.google.com/p/skia/issues/detail?id=1094
Review URL: https://codereview.chromium.org/12440052
git-svn-id: http://skia.googlecode.com/svn/trunk@8254 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-20 14:20:18 +00:00
scroggo@google.com
0b735631b7
Revert "Make gm use SkFlags."
...
Fix the build.
This reverts commit 6f1fe2aee39308fc56854b062be244a904c209e7.
Review URL: https://codereview.chromium.org/12709005
git-svn-id: http://skia.googlecode.com/svn/trunk@8236 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-19 17:38:50 +00:00
scroggo@google.com
7d519305bb
Make gm use SkFlags.
...
Make flag parser its own project. It is still in the tools folder,
but can now be used by other projects.
Some changes to behavior in order to work with SkFlags:
enable-missing-warning and disable-missing-warning have become
enableMissingWarning and noenableMissingWarning.
exclude-config is now excludeConfig
--config now can only be listed once, but all configs listed
after it will be included (same with excludeConfig and match).
In addition, writeJsonSummary has been changed to
writeJsonSummaryPath for consistency with other path flags.
Provide an option to SkFlags to provide a short name, and use
it for the flags which have short names.
--tileGridReplayScales now takes space separated arguments,
like other inputs.
BUG=https://code.google.com/p/skia/issues/detail?id=1094
Review URL: https://codereview.chromium.org/12632015
git-svn-id: http://skia.googlecode.com/svn/trunk@8235 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-19 17:28:10 +00:00
epoger@google.com
5efdd0cb9c
gm: write all messages to stdout/stderr with "GM:" preamble to distinguish from various debug messages coming from elsewhere
...
Review URL: https://codereview.chromium.org/12691009
git-svn-id: http://skia.googlecode.com/svn/trunk@8126 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-13 14:18:40 +00:00
epoger@google.com
b9ba1eadc8
gm self-test: make all test cases exercise transparency
...
BUG=https://code.google.com/p/skia/issues/detail?id=1142
Review URL: https://codereview.chromium.org/12379047
git-svn-id: http://skia.googlecode.com/svn/trunk@7943 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-02 19:56:18 +00:00
epoger@google.com
c5d71e2a97
gm self-test: disable spuriously-failing aaclip tests
...
Review URL: https://codereview.chromium.org/12377049
git-svn-id: http://skia.googlecode.com/svn/trunk@7927 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-01 16:46:49 +00:00
epoger@google.com
44a18d5819
gm self-test: fix results that break housekeeping bot
...
Review URL: https://codereview.chromium.org/12393011
git-svn-id: http://skia.googlecode.com/svn/trunk@7926 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-01 16:18:06 +00:00
commit-bot@chromium.org
c61c3c3101
gm self-test: use a pathologically simple test case instead of dashing2
...
BUG=https://code.google.com/p/skia/issues/detail?id=677
Review URL: https://chromiumcodereview.appspot.com/12381038
git-svn-id: http://skia.googlecode.com/svn/trunk@7922 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-03-01 15:32:34 +00:00
borenet@google.com
4f62bf4b47
Fix GM self-test expectations, mkII
...
Review URL: https://codereview.appspot.com/7393046
git-svn-id: http://skia.googlecode.com/svn/trunk@7815 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-02-21 19:48:02 +00:00
borenet@google.com
1df2a5e528
Fix GM self-test expectations
...
Review URL: https://codereview.appspot.com/7386048
git-svn-id: http://skia.googlecode.com/svn/trunk@7814 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-02-21 19:20:11 +00:00
epoger@google.com
d271d245e9
gm: Add ability to compare against checksums (as opposed to image files)
...
Review URL: https://codereview.appspot.com/7306071
git-svn-id: http://skia.googlecode.com/svn/trunk@7724 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-02-13 18:14:48 +00:00
epoger@google.com
e460a4718c
gm self-tests: generate JSON expectations, in addition to image expectations
...
Review URL: https://codereview.appspot.com/7310050
git-svn-id: http://skia.googlecode.com/svn/trunk@7624 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-02-06 18:41:04 +00:00
epoger@google.com
4688de1ee5
gm self-tests: add 565 mode testing, in addition to 8888 mode
...
Review URL: https://codereview.appspot.com/7229061
git-svn-id: http://skia.googlecode.com/svn/trunk@7489 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-31 15:06:36 +00:00
epoger@google.com
666c5cf3af
Fix bugs in r7291
...
TBR=reed
Review URL: https://codereview.appspot.com/7129057
git-svn-id: http://skia.googlecode.com/svn/trunk@7292 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-19 04:56:36 +00:00
epoger@google.com
3726960733
re-land r7258 with fixes and tests
...
BUG=http://code.google.com/p/skia/issues/detail?id=1079
TBR=reed
Review URL: https://codereview.appspot.com/7132060
git-svn-id: http://skia.googlecode.com/svn/trunk@7291 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-19 04:21:27 +00:00
epoger@google.com
9ef89ce8b7
Roll out r7258
...
BUG=http://code.google.com/p/skia/issues/detail?id=1079
TBR=robertphillips
Review URL: https://codereview.appspot.com/7138065
git-svn-id: http://skia.googlecode.com/svn/trunk@7289 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-18 21:45:42 +00:00
epoger@google.com
80d447893e
gm self-test: followup to r7284
...
TBR=rmistry
Review URL: https://codereview.appspot.com/7128056
git-svn-id: http://skia.googlecode.com/svn/trunk@7286 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-18 20:03:58 +00:00
epoger@google.com
407f8da4f4
make gm self-test more robust
...
BUG=http://code.google.com/p/skia/issues/detail?id=1068
Review URL: https://codereview.appspot.com/7164043
git-svn-id: http://skia.googlecode.com/svn/trunk@7284 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-18 19:19:47 +00:00
epoger@google.com
a243b22422
Reapply r7198 with Mac/Windows fixes
...
BUG=https://code.google.com/p/skia/issues/detail?id=1067
Review URL: https://codereview.appspot.com/7138056
git-svn-id: http://skia.googlecode.com/svn/trunk@7258 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-17 17:54:28 +00:00
epoger@google.com
98204f9301
better quick fix for GM self-test: ignore instance-counting lines in Debug output
...
BUG=http://code.google.com/p/skia/issues/detail?id=1068
Review URL: https://codereview.appspot.com/7127044
git-svn-id: http://skia.googlecode.com/svn/trunk@7214 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-16 04:19:01 +00:00
epoger@google.com
6008e60a54
quick fix for GM self-test failures after r7206
...
BUG=http://code.google.com/p/skia/issues/detail?id=1068
Review URL: https://codereview.appspot.com/7131043
git-svn-id: http://skia.googlecode.com/svn/trunk@7213 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-16 03:34:15 +00:00
epoger@google.com
bc159bdcd0
Revert r7198 until I can fix https://code.google.com/p/skia/issues/detail?id=1067
...
Review URL: https://codereview.appspot.com/7124043
git-svn-id: http://skia.googlecode.com/svn/trunk@7203 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-15 20:24:03 +00:00
epoger@google.com
06b8a19b56
gm: use new Expectations struct instead of comparison bitmaps
...
Review URL: https://codereview.appspot.com/7088044
git-svn-id: http://skia.googlecode.com/svn/trunk@7198 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-15 19:10:16 +00:00
epoger@google.com
b4a870bfab
Update gm self-test results to expect new runtime config debug message
...
git-svn-id: http://skia.googlecode.com/svn/trunk@7197 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-15 18:29:41 +00:00
epoger@google.com
3499f3c0d9
gm: if no readPath is given, report all tests as "missing reference image" instead of "passed"
...
Review URL: https://codereview.appspot.com/7070066
git-svn-id: http://skia.googlecode.com/svn/trunk@7119 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-10 17:11:27 +00:00
epoger@google.com
8e910abcb7
gm self-test: update expected dashing2.png images (in inputs/ dir) to reflect new behavior
...
TBR=reed1
Review URL: https://codereview.appspot.com/7068060
git-svn-id: http://skia.googlecode.com/svn/trunk@7116 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-10 15:56:44 +00:00
epoger@google.com
15655b241b
gm: remove --diffPath option and all other pixel diff functionality.
...
If you want pixel diffs, you need to run skdiff instead; from now on,
gm will only tell you WHETHER the images differed (not HOW they differed).
Review URL: https://codereview.appspot.com/7064047
git-svn-id: http://skia.googlecode.com/svn/trunk@7093 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-08 18:47:31 +00:00
reed@google.com
57cf9a6f25
ran gm/tests/rebaseline.sh 5-6 times to update the self-test after 6984
...
git-svn-id: http://skia.googlecode.com/svn/trunk@6995 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-03 15:29:03 +00:00
epoger@google.com
3aa3358c03
Add more warnings about https://code.google.com/p/skia/issues/detail?id=677 ('make tools/tests/run.sh work cross-platform')
...
git-svn-id: http://skia.googlecode.com/svn/trunk@6965 2bbb7eff-a529-9590-31e7-b0007b416f81
2013-01-02 15:53:25 +00:00
mike@reedtribe.org
4427aa639f
revert 6938, as running rebaseline.sh did not seem to work.
...
Binary files gm/tests/outputs/compared-against-identical-bytes/output-expected/images/8888/dashing2.png and gm/tests/outputs/compared-against-identical-bytes/output-actual/images/8888/dashing2.png differ
diff -r '--exclude=.*' gm/tests/outputs/compared-against-identical-bytes/output-expected/json-summary.txt gm/tests/outputs/compared-against-identical-bytes/output-actual/json-summary.txt
5c5
< "checksum" : 2249048307642991938
---
> "checksum" : 16595425910463109922
diff -r '--exclude=.*' gm/tests/outputs/compared-against-identical-bytes/output-expected/stdout gm/tests/outputs/compared-against-identical-bytes/output-actual/stdout
4c4
< ----- max pixel mismatch for 8888/dashing2 is 16
---
> ----- max pixel mismatch for 8888/dashing2 is 64
6c6
< 8888/dashing2 pixel_error 16
---
> 8888/dashing2 pixel_error 64
failed in: compare_directories gm/tests/outputs/compared-against-identical-bytes/output-expected gm/tests/outputs/compared-against-identical-bytes/output-actual
git-svn-id: http://skia.googlecode.com/svn/trunk@6939 2bbb7eff-a529-9590-31e7-b0007b416f81
2012-12-24 11:23:09 +00:00
mike@reedtribe.org
0f3aabebae
rebaseline self-test images after stroke change
...
git-svn-id: http://skia.googlecode.com/svn/trunk@6938 2bbb7eff-a529-9590-31e7-b0007b416f81
2012-12-24 11:13:51 +00:00
epoger@google.com
9c56a8dea6
Make gm's json results include checksums even if run without --readPath
...
Review URL: https://codereview.appspot.com/6979043
git-svn-id: http://skia.googlecode.com/svn/trunk@6917 2bbb7eff-a529-9590-31e7-b0007b416f81
2012-12-20 18:34:29 +00:00
epoger@google.com
ee8a8e3931
Re-land r6843 with copied gyp file to (hopefully) fix Windows build
...
BUG=https://code.google.com/p/skia/issues/detail?id=1023
Review URL: https://codereview.appspot.com/6943073
git-svn-id: http://skia.googlecode.com/svn/trunk@6880 2bbb7eff-a529-9590-31e7-b0007b416f81
2012-12-18 19:13:49 +00:00
epoger@google.com
33352d9623
Roll out r6843 to hopefully fix Windows builds
...
BUG=https://code.google.com/p/skia/issues/detail?id=1023
TBR=borenet
Review URL: https://codereview.appspot.com/6942061
git-svn-id: http://skia.googlecode.com/svn/trunk@6849 2bbb7eff-a529-9590-31e7-b0007b416f81
2012-12-17 18:23:58 +00:00