v8/tools/clusterfuzz
Michael Achenbach 8590942c84 [foozzie] Prioritize reporting differences with x64 if present
tldr: This adds an on-demand comparison with x64 when a difference to
a non-x64 build is detected.

Normally foozzie compares the baseline build (just ignition), with
two secondary builds. One, the default, always uses the shipping
configuration, the second passes additional flags. Both can use a
different architecture than the baseline build as well.

Differences between ignition and turbofan are then often detected
independent of the architectures used, but reported several times
(for each compared architecture).

This makes the reporting more specific, by running another build on
demand that uses the baseline architecture, but otherwise the same
configuration that showed a difference. If it shows the difference as
well, the baseline architecture is used for the report.

As a result only pure architecture differences will be reported with
an architecture other than x64.

This also adds some minor refactorings to reduce the code complexity
when looping over comparisons.

For testing this, the fake-d8s are extended with different behavior
for different flags passed. We add two test cases for testing:
x64 vs. ia32 with difference in x64 and ia32
x64 vs. ia32 with difference only in ia32

Bug: chromium:1196633
No-Try: true
Test: tools/clusterfuzz/v8_foozzie_test.py
Change-Id: Ic470ae8f0b37fb1628b32e4fafc0c39377e16f8c
Reviewed-on: https://chromium-review.googlesource.com/c/v8/v8/+/2897099
Reviewed-by: Liviu Rau <liviurau@chromium.org>
Commit-Queue: Michael Achenbach <machenbach@chromium.org>
Cr-Commit-Position: refs/heads/master@{#74612}
2021-05-17 17:57:03 +00:00
..
js_fuzzer [sparkplug] Add always_sparkplug variant 2021-03-19 09:52:50 +00:00
testdata [foozzie] Prioritize reporting differences with x64 if present 2021-05-17 17:57:03 +00:00
toolchain [foozzie] Correctness-compare pointer compression build 2019-10-07 07:58:42 +00:00
BUILD.gn [foozzie] Insensitive terms clean-up 2020-11-27 16:57:24 +00:00
OWNERS Use relative paths to OWNERS files 2019-08-12 13:52:52 +00:00
PRESUBMIT.py [presubmit] Clean up insensitive terms 2020-07-27 18:05:48 +00:00
v8_commands.py [foozzie] Refactoring - several code clean-ups 2020-06-29 12:29:39 +00:00
v8_foozzie_harness_adjust.js [sparkplug] Add always_sparkplug variant 2021-03-19 09:52:50 +00:00
v8_foozzie_test.py [foozzie] Prioritize reporting differences with x64 if present 2021-05-17 17:57:03 +00:00
v8_foozzie.py [foozzie] Prioritize reporting differences with x64 if present 2021-05-17 17:57:03 +00:00
v8_fuzz_config.py [foozzie] Overhaul --no-lazy-feedback-allocation comparisons 2020-02-17 14:10:37 +00:00
v8_fuzz_experiments.json [foozzie] Compare baseline/default in every run 2020-06-30 11:07:47 +00:00
v8_fuzz_flags.json [wasm] Test --no-wasm-generic-wrapper in the stress variant 2021-03-22 09:45:59 +00:00
v8_mock_archs.js [foozzie] Add tests and fix mocks 2020-02-18 09:37:28 +00:00
v8_mock_webassembly.js [foozzie] Add tests and fix mocks 2020-02-18 09:37:28 +00:00
v8_mock.js [foozzie] Make stubbing-out typed arrays more robust 2021-04-12 07:53:51 +00:00
v8_smoke_tests.js [foozzie] Insensitive terms clean-up 2020-11-27 16:57:24 +00:00
v8_suppressions.js [foozzie] Remove obsolete suppression 2020-02-05 13:00:58 +00:00
v8_suppressions.py Reland "Enable simulating errors to test fuzzer reliability" 2020-12-01 16:26:43 +00:00