Skip to content

TestRunner: Added --chart to display a chart of performance tests

David Eichmann requested to merge DavidEichmann/ghc:ChartPerfMetrics into master

This uses the Chart.js javascript library. Everything is put into a standalone .html file and opened with the default browser. I also simplified the text output to use the same data as the chart. You can now use a commit range with git's ".." syntax. The --ci option will use results from CI (you'll need to fetch them first):

  $ git fetch https://gitlab.haskell.org/ghc/ghc-performance-notes.git refs/notes/perf:refs/notes/ci/perf
  $ python3 testsuite/driver/perf_notes.py --ci --chart --test-env x86_64-darwin --test-name T9630 master~500..master

Summary of changes:

  • Refactoring - extract into a top level function:
    • get_commit_message (memoized)
    • commit_log
    • get_commit_metric (memoized)
  • Add new cli parameters (--chart, --ci, ...)
  • Output of the script is now either
  • Add code to generate chart html file
  • Remove old code to aggregate and print (to stdout) the metrics.
    • This is slightly simpler
    • The data matches that visualized by the chart.
Edited by David Eichmann

Merge request reports