AuroraMiddleware/skia2
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
5b181bfb2d
skia2/tools/skqp
History
Chris Dalton b3c9745911 Remove "nvpr" configs 
The majority of our gm testing has been disabling nvpr, which doesn't
match our real-world behavior where we use nvpr whenever available.
This CL fixes the issue by completely removing the explicit nvpr
configs. Now if we have nvpr, you get it.

This CL also lowers the nvpr priority in the path renderer chain and
adds a "NonNVPR" job on Quadro where we can continue to test our
non-nvpr codepaths on NVIDIA.

Bug: skia:
Change-Id: I6a36f1101c8218adcaaf10cab25d2c28e70371f0
Reviewed-on: https://skia-review.googlesource.com/c/skia/+/223828
Reviewed-by: Brian Salomon <bsalomon@google.com>
Commit-Queue: Chris Dalton <csmartdalton@google.com>
2019-06-26 16:53:50 +00:00
..
src Remove "nvpr" configs 2019-06-26 16:53:50 +00:00
bad_gms.txt SkQP: remove bad tests from future branches. 2019-04-11 13:50:25 +00:00
branch_skqp_dev.sh
clean_app.sh
cut_release.py SkQP: consolidate cut_release scripts 2019-04-18 19:40:50 +00:00
docker_build_universal_apk.sh
docker_run_apk.sh SkQP: new docker test code 2019-04-19 18:50:03 +00:00
download_model
find_commit_with_best_gold_results.py find_commit_with_best_gold_results takes arguments 2019-02-11 15:00:27 +00:00
generate_gn_args SkQP: from skqp_gn_args import SkqpGnArgs 2019-03-05 20:51:55 +00:00
gn_to_bp.py SkQP: from skqp_gn_args import SkqpGnArgs 2019-03-05 20:51:55 +00:00
jitter_gms.cpp IWYU for gms. 2019-05-02 17:48:53 +00:00
make_apk_list.py
make_apk.sh
make_skqp_model.cpp rewrite includes to not need so much -Ifoo 2019-04-24 16:27:11 +00:00
make_universal_apk
make_universal_apk.py
README_ALGORITHM.md
README_GENERATING_MODELS.md SkQP: consolidate cut_release scripts 2019-04-18 19:40:50 +00:00
README.md
release.sh Update CtsSkQPTestCases to non-shardable in release script 2019-06-14 17:05:51 +00:00
run_apk.sh SkQP: new docker test code 2019-04-19 18:50:03 +00:00
run_skqp_exe
setup_resources
skqp_gn_args.py SkQP: from skqp_gn_args import SkqpGnArgs 2019-03-05 20:51:55 +00:00
test_apk.sh SkQP: new docker test code 2019-04-19 18:50:03 +00:00
upload_apk

README.md

SkQP

SkQP (Skia Quality Program) is a component of the Android CTS (Compatablity Test Suite) that tests an Android device's GPU and OpenGLES & Vulkan drivers using Skia's existing unit & rendering tests.

See https://skia.org/dev/testing/skqp for pre-build APKs.

How to build and run the SkQP tests

  1. Get the dependencies:

    • You will need Java JDK 8, git, and python.

    • Install Chromium's depot_tools. Add it to your PATH.

      git clone 'https://chromium.googlesource.com/chromium/tools/depot_tools.git'
export PATH="${PWD}/depot_tools:${PATH}"

    • Install the Android NDK.

      ( cd ~; unzip ~/Downloads/android-ndk-*.zip )
ANDROID_NDK=$(ls -d ~/android-ndk-*)   # Or wherever you installed the Android NDK.

    • Install the Android SDK. Set the ANDROID_HOME environment variable.

      mkdir ~/android-sdk
( cd ~/android-sdk; unzip ~/Downloads/sdk-tools-*.zip )
yes | ~/android-sdk/tools/bin/sdkmanager --licenses
export ANDROID_HOME=~/android-sdk  # Or wherever you installed the Android SDK.

      Put adb in your PATH.

      export PATH="${PATH}:${ANDROID_HOME}/platform-tools"

  2. Get the right version of Skia:

    git clone https://skia.googlesource.com/skia.git
cd skia
git checkout origin/skqp/dev  # or whatever release tag you need

  3. Build the APK:

    tools/git-sync-deps
tools/skqp/make_universal_apk

  4. Build, install, and run.

    adb install -r out/skqp/skqp-universal-debug.apk
adb logcat -c
adb shell am instrument -w org.skia.skqp

  5. Monitor the output with:

    adb logcat TestRunner org.skia.skqp skia "*:S"

    Note the test's output path on the device. It will look something like this:

    01-23 15:22:12.688 27158 27173 I org.skia.skqp:
output written to "/storage/emulated/0/Android/data/org.skia.skqp/files/output"

  6. Retrieve and view the report with:

    OUTPUT_LOCATION="/storage/emulated/0/Android/data/org.skia.skqp/files/output"
adb pull $OUTPUT_LOCATION /tmp/
bin/sysopen /tmp/output/skqp_report/report.html

Running a single test

To run a single test, for example gles_aarectmodes:

adb shell am instrument -e class 'org.skia.skqp.SkQPRunner#gles_aarectmodes' -w org.skia.skqp

Unit tests can be run with the unitTest_ prefix:

adb shell am instrument -e class 'org.skia.skqp.SkQPRunner#unitTest_GrSurface -w org.skia.skqp

Run as a non-APK executable

  1. Follow steps 1-3 as above.

  2. Build the SkQP program, load files on the device, and run skqp:

    gn gen out/skqp-arm
ninja -C out/skqp-arm skqp
python tools/skqp/run_skqp_exe out/skqp-arm