skia2/site/docs/dev/testing/skiaperf.md

46 lines
1.4 KiB
Markdown
Raw Normal View History

---
title: "Skia Perf"
linkTitle: "Skia Perf"
---
[Skia Perf](https://perf.skia.org) is a web application for analyzing and
viewing performance metrics produced by Skia's testing infrastructure.
[docs] Add back in all images and fix broken image links. Change-Id: I0ffd838880746dbfe534ea615277fc24cd26b7ec No-Try: true Docs-Preview: https://skia.org/docs/dev/design/conical/corollary2.3.3?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Digests?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Status?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Cluster?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Perf?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/corollary2.3.2?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/lemma4?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/IssueHighlight?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/lemma3.1?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/tracing?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/BlameView?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/corollary2.2.2?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/download?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Isolate?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Search?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/end?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/image?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Grid?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/corollary2.2.1?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/debugger?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/pdftheory?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/resources?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/playcommands?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/DotDiagram?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Ignores?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/onlinedebugger?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/crosshair?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/frameplayback?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/corollary2.3.1?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/buttons?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/ClusterConfig?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/lemma3.2?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/skiaperf?cl=392736 Docs-Preview: https://skia.org/docs/dev/contrib/SuggestedReviewers?cl=392736 Docs-Preview: https://skia.org/docs/user/modules/PathKit_effects?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Regression?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/ByTest?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/settings?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/lemma1?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/PdfLogicalDocumentStructure?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/skiagold?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/expand?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/tracing_load?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/layers?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/gpuop?cl=392736 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/392736 Reviewed-by: Joe Gregorio <jcgregorio@google.com>
2021-04-05 13:17:20 +00:00
<img src=../Perf.png style="margin-left:30px" align="left" width="800"/> <br clear="left">
Skia tests across a large number of platforms and configurations, and each
commit to Skia generates more than 400,000 individual values that are sent to
Perf, consisting mostly of performance benchmark results, but also including
memory and coverage data.
Perf offers clustering, which is a tool to pick out trends and patterns in large sets of traces.
[docs] Add back in all images and fix broken image links. Change-Id: I0ffd838880746dbfe534ea615277fc24cd26b7ec No-Try: true Docs-Preview: https://skia.org/docs/dev/design/conical/corollary2.3.3?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Digests?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Status?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Cluster?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Perf?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/corollary2.3.2?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/lemma4?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/IssueHighlight?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/lemma3.1?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/tracing?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/BlameView?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/corollary2.2.2?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/download?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Isolate?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Search?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/end?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/image?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Grid?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/corollary2.2.1?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/debugger?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/pdftheory?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/resources?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/playcommands?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/DotDiagram?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Ignores?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/onlinedebugger?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/crosshair?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/frameplayback?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/corollary2.3.1?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/buttons?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/ClusterConfig?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/lemma3.2?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/skiaperf?cl=392736 Docs-Preview: https://skia.org/docs/dev/contrib/SuggestedReviewers?cl=392736 Docs-Preview: https://skia.org/docs/user/modules/PathKit_effects?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Regression?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/ByTest?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/settings?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/lemma1?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/PdfLogicalDocumentStructure?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/skiagold?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/expand?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/tracing_load?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/layers?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/gpuop?cl=392736 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/392736 Reviewed-by: Joe Gregorio <jcgregorio@google.com>
2021-04-05 13:17:20 +00:00
<img src=../Cluster.png style="margin-left:30px" align="left" width="400"/> <br clear="left">
And can generate alerts when those trends spot a regression:
[docs] Add back in all images and fix broken image links. Change-Id: I0ffd838880746dbfe534ea615277fc24cd26b7ec No-Try: true Docs-Preview: https://skia.org/docs/dev/design/conical/corollary2.3.3?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Digests?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Status?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Cluster?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Perf?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/corollary2.3.2?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/lemma4?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/IssueHighlight?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/lemma3.1?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/tracing?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/BlameView?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/corollary2.2.2?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/download?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Isolate?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Search?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/end?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/image?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Grid?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/corollary2.2.1?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/debugger?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/pdftheory?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/resources?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/playcommands?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/DotDiagram?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Ignores?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/onlinedebugger?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/crosshair?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/frameplayback?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/corollary2.3.1?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/buttons?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/ClusterConfig?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/lemma3.2?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/skiaperf?cl=392736 Docs-Preview: https://skia.org/docs/dev/contrib/SuggestedReviewers?cl=392736 Docs-Preview: https://skia.org/docs/user/modules/PathKit_effects?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/Regression?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/ByTest?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/settings?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/conical/lemma1?cl=392736 Docs-Preview: https://skia.org/docs/dev/design/PdfLogicalDocumentStructure?cl=392736 Docs-Preview: https://skia.org/docs/dev/testing/skiagold?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/expand?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/tracing_load?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/layers?cl=392736 Docs-Preview: https://skia.org/docs/dev/tools/gpuop?cl=392736 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/392736 Reviewed-by: Joe Gregorio <jcgregorio@google.com>
2021-04-05 13:17:20 +00:00
<img src=../Regression.png style="margin-left:30px" align="left" width="800"/> <br clear="left">
## Calculations
Skia Perf has the ability to perform calculations over the test data
allowing you to build up interesting queries.
This query displays the ratio of playback time in ms to the number of ops for desk\_wowwiki.skp:
ratio(
ave(fill(filter("name=desk_wowwiki.skp&sub_result=min_ms"))),
ave(fill(filter("name=desk_wowwiki.skp&sub_result=ops")))
)
You can also use the data to answer questions like how many tests were run per commit.
count(filter(""))
See Skia Perf for the [full list of functions available](https://perf.skia.org/help/).