v8/test/fuzzer
ahaas 68bcaf9be3 Revert of [fuzzer] Format README.md (patchset #2 id:20001 of https://codereview.chromium.org/2692443002/ )
Reason for revert:
Found another mistake

Original issue's description:
> [fuzzer] Format README.md
>
> NOTRY=true
> R=hablich@chromium.org
>
> Review-Url: https://codereview.chromium.org/2692443002
> Cr-Commit-Position: refs/heads/master@{#43138}
> Committed: a3de4726c3

TBR=hablich@chromium.org
# Skipping CQ checks because original CL landed less than 1 days ago.
NOPRESUBMIT=true
NOTREECHECKS=true
NOTRY=true

Review-Url: https://codereview.chromium.org/2693863002
Cr-Commit-Position: refs/heads/master@{#43139}
2017-02-13 08:39:55 +00:00
..
json Add json fuzzer 2016-02-02 11:29:01 +00:00
parser Add a library suitable for libfuzzer with a small unit test runner shell 2016-01-26 10:39:03 +00:00
regexp [regexp] add fuzzer support for regexp parser and compiler. 2016-02-01 14:00:38 +00:00
wasm_call [wasm] Add a new fuzzer which can also test wasm function calls. 2016-10-24 11:15:00 +00:00
wasm_code [wasm] Create a new fuzzer for wasm code. 2016-08-29 13:56:00 +00:00
wasm_data_section [wasm] Write fuzzers for single wasm sections. 2016-09-14 11:17:53 +00:00
wasm_function_sigs_section [wasm] Write fuzzers for single wasm sections. 2016-09-14 11:17:53 +00:00
wasm_globals_section [wasm] Write fuzzers for single wasm sections. 2016-09-14 11:17:53 +00:00
wasm_imports_section [wasm] Write fuzzers for single wasm sections. 2016-09-14 11:17:53 +00:00
wasm_memory_section [wasm] Write fuzzers for single wasm sections. 2016-09-14 11:17:53 +00:00
wasm_names_section [wasm] Write fuzzers for single wasm sections. 2016-09-14 11:17:53 +00:00
wasm_types_section [wasm] Write fuzzers for single wasm sections. 2016-09-14 11:17:53 +00:00
DEPS Add a library suitable for libfuzzer with a small unit test runner shell 2016-01-26 10:39:03 +00:00
fuzzer-support.cc Provide a convenience array buffer allocator 2016-06-29 07:42:40 +00:00
fuzzer-support.h Provide a convenience array buffer allocator 2016-06-29 07:42:40 +00:00
fuzzer.cc [wasm] Fix -Wsign-compare warnings. 2016-11-10 12:51:05 +00:00
fuzzer.gyp Add icu libraries to fuzzer dependencies 2016-11-18 11:14:30 +00:00
fuzzer.isolate [wasm] Add a new fuzzer which can also test wasm function calls. 2016-10-24 11:15:00 +00:00
fuzzer.status Add a library suitable for libfuzzer with a small unit test runner shell 2016-01-26 10:39:03 +00:00
json.cc Add GC request to libFuzzers in attempt to avoid parasitic coverage. 2016-04-28 13:32:28 +00:00
parser.cc Reland of land: [Parse] ParseInfo owns the parsing Zone. (patchset #1 id:1 of https://codereview.chromium.org/2683733002/ ) 2017-02-07 20:46:47 +00:00
README.md Revert of [fuzzer] Format README.md (patchset #2 id:20001 of https://codereview.chromium.org/2692443002/ ) 2017-02-13 08:39:55 +00:00
regexp.cc [regexp fuzzer] Let the fuzzer input select the regexp flag. 2016-11-22 12:59:38 +00:00
testcfg.py [wasm] Add a new fuzzer which can also test wasm function calls. 2016-10-24 11:15:00 +00:00
wasm_asmjs.tar.gz.sha1 [wasm] Write fuzzers for single wasm sections. 2016-09-14 11:17:53 +00:00
wasm-asmjs.cc [wasm] Change the constant kV8MaxWasmTableSize to a command line flag. 2017-01-24 10:12:22 +00:00
wasm-call.cc [wasm] Add the 'end' opcode at the end of the fuzzer input 2017-01-16 11:27:20 +00:00
wasm-code.cc [wasm] With possible nondeterminism the fuzzer should not check traps 2017-02-06 17:19:53 +00:00
wasm-data-section.cc [wasm] Master CL for Binary 0xC changes. 2016-09-27 20:46:30 +00:00
wasm-function-sigs-section.cc [wasm] Master CL for Binary 0xC changes. 2016-09-27 20:46:30 +00:00
wasm-globals-section.cc [wasm] Master CL for Binary 0xC changes. 2016-09-27 20:46:30 +00:00
wasm-imports-section.cc [wasm] Master CL for Binary 0xC changes. 2016-09-27 20:46:30 +00:00
wasm-memory-section.cc [wasm] Master CL for Binary 0xC changes. 2016-09-27 20:46:30 +00:00
wasm-names-section.cc [wasm] Master CL for Binary 0xC changes. 2016-09-27 20:46:30 +00:00
wasm-section-fuzzers.cc [wasm] Use a Managed<WasmModule> to hold metadata about modules. 2016-10-19 13:07:22 +00:00
wasm-section-fuzzers.h [wasm] Master CL for Binary 0xC changes. 2016-09-27 20:46:30 +00:00
wasm-types-section.cc [wasm] Master CL for Binary 0xC changes. 2016-09-27 20:46:30 +00:00
wasm.cc [wasm] Change the constant kV8MaxWasmTableSize to a command line flag. 2017-01-24 10:12:22 +00:00
wasm.tar.gz.sha1 [wasm] Write fuzzers for single wasm sections. 2016-09-14 11:17:53 +00:00

How to make a libFuzzer fuzzer in V8

This document describes how to make a new libfuzzer fuzzer for V8. A general introduction to libfuzzer can be found at here. In short, libFuzzer is an in-process coverage-driven evolutionary fuzzer. libFuzzer serves you with a sequence of byte arrays that you can use to test your code. libFuzzer tries to generate this sequence of byte arrays in a way that maximizes test coverage.

Warning: By itself libFuzzer typically does not generate valid JavaScript code.

Changes to V8

tldr: Do the same as https://codereview.chromium.org/2280623002 to introduce a new fuzzer to V8. This is a step by step guide on how to make a new fuzzer in V8. In the example the fuzzer is called foo.

  1. Copy one of the existing fuzzer implementations in test/fuzzer/, e.g. cp wasm.cc foo.cc
    • Copying an existing fuzzer is a good idea to get all the required setup, e.g. setting up the isolate
  2. Create a directory called foo in test/fuzzer/ which contains at least one file
    • The file is used by the trybots to check whether the fuzzer actually compiles and runs
  3. Copy the build rules of an existing fuzzer in BUILD.gn, e.g. the build rules for the wasm.cc fuzzer are v8_source_set("wasm_fuzzer") and v8_fuzzer("wasm_fuzzer"). Note that the name has to be the name of the directory created in Step 2 + “_fuzzer” so that the scripts on the trybots work
  4. Now you can already compile the fuzzer with ninja -j 1000 -C out/tmp/v8_simple_foo_fuzzer
    • Use this binary to reproduce issues found by cluster fuzz, e.g. out/tmp/v8_simple_foo_fuzzer testcase.foo
  5. Copy the build rules of an existing fuzzer in test/fuzzer/fuzzer.gyp, e.g. the build rules for the wasm.cc fuzzer are v8_simple_wasm_fuzzer and wasm_fuzzer_lib
    • This build rule is needed to compile with gyp
  6. Copy the binary name and the test directory name in test/fuzzer/fuzzer.isolate
  7. Add the fuzzer to the FuzzerTestSuite in test/fuzzer/testcfg.py
    • This step is needed to run the fuzzer with the files created in Step 2 on the trybots
  8. Commit the changes described above to the V8 repository

Changes to Chromium

tldr: Do the same as https://codereview.chromium.org/2344823002 to add the new fuzzer to cluster fuzz.

  1. Copy the build rules of an existing fuzzer in testing/libfuzzer/fuzzers/BUILD.gn, e.g. the build rule for the wasm.cc fuzzer is {v8_wasm_fuzzer}. There is no need to set a dictionary , or a seed_corpus. See chromium-fuzzing-getting-started for more information.
  2. Compile the fuzzer in chromium (for different configurations see: https://chromium.googlesource.com/chromium/src/+/master/testing/libfuzzer/reproducing.md):
    • gn gen out/libfuzzer '--args=use_libfuzzer=true is_asan=true is_debug=false enable_nacl=false'
    • ninja -j 1000 -C out/libfuzzer/ v8_foo_fuzzer
  3. Run the fuzzer locally
    • mkdir /tmp/empty_corpus && out/libfuzzer/v8_foo_fuzzer /tmp/empty_corpus