skia2/modules/canvaskit
Elliot Evans fe7e74b3a7 Add an experimental_simd build target to CanvasKit.
The `experimental_simd` build target builds
CanvasKit using the Emscripten `-msimd128` flag, to build CanvasKit
with SIMD instructions in the compiled WASM. This build of
CanvasKit works in Chrome Canary 86.0.4186.0
with chrome://flags#enable-webassembly-simd enabled.

Also add WebAssembly-specific intrinsics to SkVx.h to enable
support for almost all native SIMD operations in CanvasKit WebAssmebly.

Also add a Skia/modules/canvaskit/wasm_tools/SIMD folder which contains
build_simd_test.sh for testing whether WASM SIMD intrinsics operations
are actually being used by skvx, and for testing correctness of
WASM SIMD operations. Also contains simd_float_test.cpp and
simd_int_test.cpp which serve as documentation for which operations are
correctly turned into WASM SIMD operations by emscripten.

Bug: skia:10453
Change-Id: Icd312b4d189e8d8667d3ffe12a72bfa6febaab2f
Reviewed-on: https://skia-review.googlesource.com/c/skia/+/299705
Reviewed-by: Mike Klein <mtklein@google.com>
2020-06-30 22:52:31 +00:00
..
canvaskit Query GL_SAMPLES when creating an SkSurface from the WebGL canvas 2020-06-19 19:59:15 +00:00
fonts [canvaskit] Clean up embedded fonts 2019-10-09 14:51:39 +00:00
future_apis Add a future_apis folder to canvaskit. future_apis contains notes on 2020-06-17 18:17:25 +00:00
htmlcanvas Wide color gamut support and working example. 2020-05-26 20:13:33 +00:00
perf Added CanvasKit.MakeImageFromCanvasImageSource which is useful as an alternative to 2020-06-15 19:35:09 +00:00
tests [canvaskit] High performance Path APIs 2020-06-24 12:40:49 +00:00
wasm_tools/SIMD Add an experimental_simd build target to CanvasKit. 2020-06-30 22:52:31 +00:00
.gitignore Record code coverage in canvaskit tests, increase coverage 2020-05-29 15:53:35 +00:00
BUILD.gn Add svg parsing to CanvasKit viewer.html 2020-05-28 20:39:43 +00:00
canvaskit_bindings.cpp [canvaskit] High performance Path APIs 2020-06-24 12:40:49 +00:00
catchExceptionNop.js JS files to support running jasmine tests in google3 2020-03-09 14:20:27 +00:00
CHANGELOG.md [canvaskit] High performance Path APIs 2020-06-24 12:40:49 +00:00
compile.sh Add an experimental_simd build target to CanvasKit. 2020-06-30 22:52:31 +00:00
cpu.js CanvasKit: implement client-supplied dirty rect support for software surface. 2020-06-01 12:05:08 +00:00
debug.js Expose 4x4 matrices on canvas in a way similar to SimpleMatrix, add example. 2020-02-22 00:12:13 +00:00
externs.js [canvaskit] High performance Path APIs 2020-06-24 12:40:49 +00:00
font.js [canvaskit] Fix infrequent crash in SkFontMgr.FromData 2020-06-05 13:32:46 +00:00
gpu.js CanvasKit: implement client-supplied dirty rect support for software surface. 2020-06-01 12:05:08 +00:00
helper.js [canvaskit] High performance Path APIs 2020-06-24 12:40:49 +00:00
interface.js [canvaskit] High performance Path APIs 2020-06-24 12:40:49 +00:00
karma.bench.conf.js Pass 4f colors to private functions with float pointers 2020-05-05 13:17:28 +00:00
karma.conf.js Record code coverage in canvaskit tests, increase coverage 2020-05-29 15:53:35 +00:00
karma.google3.conf.js JS files to support running jasmine tests in google3 2020-03-09 14:20:27 +00:00
Makefile Add an experimental_simd build target to CanvasKit. 2020-06-30 22:52:31 +00:00
package-lock.json Record code coverage in canvaskit tests, increase coverage 2020-05-29 15:53:35 +00:00
package.json Record code coverage in canvaskit tests, increase coverage 2020-05-29 15:53:35 +00:00
paragraph_bindings.cpp [canvaskit] Fix memory leak in paragraph bindings 2020-05-14 14:48:21 +00:00
paragraph.js [canvaskit] Fix bug with TextStyle color 2020-06-12 15:40:13 +00:00
particles_bindings.cpp Pure SkSL RNG for particles 2020-04-10 17:20:07 +00:00
particles.js [canvaskit] Fix infrequent crash in SkFontMgr.FromData 2020-06-05 13:32:46 +00:00
pathops.js [canvaskit] Add build flag for pathops 2020-01-06 13:10:43 +00:00
postamble.js [canvaskit] Move from experimental to modules 2019-03-11 21:09:52 +00:00
preamble.js [canvaskit] Move from experimental to modules 2019-03-11 21:09:52 +00:00
README.md [canvaskit] Add MacOS specific notes for setup 2020-06-05 16:58:20 +00:00
release.js Expose 4x4 matrices on canvas in a way similar to SimpleMatrix, add example. 2020-02-22 00:12:13 +00:00
rt_shader.js [canvaskit] Fix infrequent crash in SkFontMgr.FromData 2020-06-05 13:32:46 +00:00
serve.py [canvaskit] Move from experimental to modules 2019-03-11 21:09:52 +00:00
skottie_bindings.cpp [skottie-wasm] Add support for nested animation playback 2020-05-07 12:31:57 +00:00
skottie.js [canvaskit] Fix infrequent crash in SkFontMgr.FromData 2020-06-05 13:32:46 +00:00
skp.js Add support for reading .skp files in CanvasKit. 2020-01-15 14:46:37 +00:00
viewer_bindings.cpp Query GL_SAMPLES when creating an SkSurface from the WebGL canvas 2020-06-19 19:59:15 +00:00
WasmCommon.h Pass 4f colors to private functions with float pointers 2020-05-05 13:17:28 +00:00

Prerequisites

To compile CanvasKit, you will first need to install emscripten. This will set the environment EMSDK (among others) which is required for compilation.

MacOS specific notes

Make sure you have Python3 installed, otherwise the downloading emscripten toolchain can fail with errors about SSL certificates. https://github.com/emscripten-core/emsdk/pull/273

See also https://github.com/emscripten-core/emscripten/issues/9036#issuecomment-532092743 for a solution to Python3 using the wrong certificates.

Compile and Run Local Example

make release  # make debug is much faster and has better error messages
make local-example

This will print a local endpoint for viewing the example. You can experiment with the CanvasKit API by modifying ./canvaskit/example.html and refreshing the page. For some more experimental APIs, there's also ./canvaskit/extra.html.

For other available build targets, see Makefile and compile.sh. For example, building a stripped-down version of CanvasKit with no text support or any of the "extras", one might run:

./compile.sh no_skottie no_particles no_font

Such a stripped-down version is about half the size of the default release build.

Unit tests, performance tests, and coverage.

To run unit tests and compute test coverage on a debug gpu build

make debug
make test-continuous

This reads karma.conf.js, and opens a chrome browser and begins running all the test in test/ it will detect changes to the tests in that directory and automatically run again, however it will automatically rebuild and reload canvaskit. Closing the chrome window will just cause it to re-opened. Kill the karma process to stop continuous monitoring for changes.

The tests are run with whichever build of canvaskit you last made. be sure to also test with release, debug_cpu, and release_cpu. testing with release builds will expose problems in closure compilation and usually forgotten externs.

Coverage

Coverage will be automatically computed when running test-continuous locally. Note that the results will only be useful when testing a debug build. Open coverage/<browser version>/index.html For a summary and detailed line-by-line result.

Measuring Performance

To measure the runtime of all benchmarks in perf/

make release
make perf

Performacnce benchmarks also use karma, with a different config karma.bench.conf.js. It will run once and print results.

Typically, you'd want to run these at head, and with your CL to observe the effect of some optimization.

Adding tests

The tests in tests/ and perf/ are grouped into files by topic. Within each file there are describe blocks further organizing the tests, and within those it() functions which test particular behaviors. describe and it are jasmine methods which can both be temporarily renamed fdescribe and fit. Which causes jasmine to only those.

We have also defined gm which is a method for defining a test which draws something to a canvas that is shapshotted and reported to gold.skia.org, where you can compare it with the snapshot at head.

Testing from Gerrit

When submitting a CL in gerrit, click "choose tryjobs" and type canvaskit to filter them. select all of them, which at the time of this writing is four jobs, for each combination of perf/test gpu/cpu.

The performance results are reported to perf.skia.org gold results are reported to gold.skia.org

Coverage is not measured while running tests this way.

Infrastructure Playbook

When dealing with CanvasKit (or PathKit) on our bots, we use Docker. Check out $SKIA_ROOT/infra/wasm-common/docker/README.md for more on building/editing the images used for building and testing.

Updating the version of Emscripten we build/test with

This presumes you have updated emscripten locally to a newer version of the sdk and verified/fixed any build issues that have arisen.

  1. Edit $SKIA_ROOT/infra/wasm-common/docker/emsdk-base/Dockerfile to install and activate the desired version of Emscripten.
  2. Edit $SKIA_ROOT/infra/wasm-common/docker/Makefile to have EMSDK_VERSION be set to that desired version. If there is a suffix that is not _v1, reset it to be _v1. If testing the image later does not work and edits are made to the emsdk-base Dockerfile to correct that, increment to _v2,_v3, etc to force the bots to pick up the new image.
  3. In $SKIA_ROOT/infra/wasm-common/docker/, run make publish_emsdk_base
  4. Edit $SKIA_ROOT/infra/canvaskit/docker/canvaskit-emsdk/Dockerfile to be based off the new version from step 2. CanvasKit has its own docker image because it needs a few extra dependencies to build with font support.
  5. Edit $SKIA_ROOT/infra/canvaskit/docker/Makefile to have the same version from step 2. It's easiest to keep the emsdk-base and canvaskit-emsdk versions be in lock-step.
  6. In $SKIA_ROOT/infra/canvaskit/docker/, run make publish_canvaskit_emsdk.
  7. In $SKIA_ROOT/infra/bots/recipe_modules/build/, update canvaskit.py and pathkit.py to have DOCKER_IMAGE point to the desired tagged Docker containers from steps 2 and 5 (which should be the same).
  8. In $SKIA_ROOT/infra/bots/, run make train to re-train the recipes.
  9. Optional: Run something like git grep 1\\.38\\. in $SKIA_ROOT to see if there are any other references that need updating.
  10. Upload a CL with all the changes. Run all Test.+CanvasKit, Perf.+CanvasKit, Test.+PathKit, Perf.+PathKit jobs to make sure the new builds pass all tests and don't crash the perf harnesses.
  11. Send out CL for review. Feel free to point the reviewer at these steps.