Skip to content
Snippets Groups Projects

nofib/shake 6484f0d72a9110c5960b9185f239e6ce049b0c74 vs e9c0f671f7befd7c34165884ed26fc2abc90304e

  • Clone with SSH
  • Clone with HTTPS
  • Embed
  • Share
    The snippet can be accessed without any authentication.
    Authored by Douglas Wilson

    6484f0d72a9110c5960b9185f239e6ce049b0c74 (from master) is labelled f220010ea975d654bb1dedbbf3c58973d61f842469ca5b032f91f73c25e8a46e (the sha256 of the bindist I'm using)

    e9c0f671f7befd7c34165884ed26fc2abc90304e (from https://gitlab.haskell.org/ghc/ghc/-/merge_requests/4619) is labelled a4dd114f3ec0743b4f6d1cf51642f0c0e65f62e5ba7214694e39e3ddb1ad42fa

    Tests were run on my 2 year old dell xps 9570 laptop 6 core (12 hyperthreads) run in an 8 core cpuset with a cmd:

    ../out/nofib-run/bin/nofib-run -w $(pwd)/../out/ghc/e9c0f671f7befd7c34165884ed26fc2abc90304e/bin/ghc -o a4dd114f3ec0743b4f6d1cf51642f0c0e65f62e5ba7214694e39e3ddb1ad42fa --perf --compiler-arg -threaded --rts-arg -N --rts-arg -qb0 --rts-arg -qg0 --times 5 --speed norm -c
    • bytes allocated geom mean: -0.6%
    • mutator time geom mean: -14.66
    • GC (cpu) time geom mean: +Infinity%
    • GC (wall) time geom mean: 51%
    • Elapsed (wall) time: -2.66%
    • perf instructions: -5.30%
    • perf cycles: -7.52
    Edited
    results.txt 219.41 KiB
    
    # compiler allocations
    
    ## no samples
    
    # compiler mutator time
    
    ## no samples
    
    # compiler GC (cpu) time
    
    ## no samples
    
    # compiler GC (wall) time
    
    ## no samples
    
    # executable size
    
    ## no samples
    
    # bytes allocated
    
    +-------------------------------++--+-------------------------------------------------------------------+-----------+-------------------------------------------------------------------------+-----------+
    |                               ||  | f220010ea975d654bb1dedbbf3c58973d61f842469ca5b032f91f73c25e8a46e/ | std. err. | a4dd114f3ec0743b4f6d1cf51642f0c0e65f62e5ba7214694e39e3ddb1ad42fa/ (rel) | std. err. |
    +===============================++==+===================================================================+===========+=========================================================================+===========+
    |                    gc/circsim ||  |                                                          +3.752e9 |   4.8e-7% |                                                                  -0.00% |   8.6e-7% |
    |                gc/constraints ||  |                                                          +2.088e9 |   8.6e-7% |                                                                  -0.00% |   1.8e-6% |
    |                   gc/fibheaps ||  |                                                          +2.799e9 |   8.6e-7% |                                                                  -0.00% |   1.2e-6% |
    |                     gc/fulsom ||  |                                                          +4.058e9 |   5.6e-7% |                                                                  -0.00% |   1.2e-6% |
    |                   gc/gc_bench ||  |                                                          +1.873e9 |   2.1e-6% |                                                                  -0.00% |   3.1e-6% |
    |                      gc/happy ||  |                                                          +1.029e9 |   1.0e-4% |                                                                  -0.00% |   3.6e-6% |
    |                       gc/hash ||  |                                                          +6.693e8 |   3.6e-6% |                                                                  -0.00% |   4.1e-6% |
    |                       gc/lcss ||  |                                                          +2.341e9 |   1.1e-6% |                                                                  -0.00% |   9.7e-7% |
    |                  gc/mutstore1 ||  |                                                          +6.765e8 |   2.1e-5% |                                                                  -0.00% |   2.0e-5% |
    |                  gc/mutstore2 ||  |                                                          +2.380e8 |   2.3e-5% |                                                                  +0.00% |   2.8e-5% |
    |                      gc/power ||  |                                                          +9.311e8 |   2.9e-6% |                                                                  -0.00% |   5.1e-6% |
    |                 gc/spellcheck ||  |                                                          +1.605e9 |   5.6e-6% |                                                                  +0.00% |   2.1e-6% |
    |          imaginary/bernouilli ||  |                                                          +2.823e9 |      0.0% |                                                                  -0.00% |   1.9e-6% |
    |        imaginary/digits-of-e1 ||  |                                                          +1.069e9 |   2.7e-7% |                                                                  -0.00% |   5.4e-6% |
    |        imaginary/digits-of-e2 ||  |                                                          +2.152e9 |   2.5e-6% |                                                                  +0.00% |   1.7e-6% |
    |              imaginary/exp3_8 ||  |                                                          +5.888e9 |   1.4e-6% |                                                                  +0.00% |   1.3e-6% |
    |         imaginary/gen_regexps ||  |                                                          +9.104e8 |   8.2e-6% |                                                                  +0.00% |   7.5e-6% |
    |           imaginary/integrate ||  |                                                          +3.640e9 |   2.8e-6% |                                                                  -0.00% |   1.8e-6% |
    |               imaginary/kahan ||  |                                                       +184012.800 |   1.4e-2% |                                                                  -0.06% |   4.7e-2% |
    |           imaginary/paraffins ||  |                                                          +3.856e9 |   1.2e-6% |                                                                  -0.00% |   2.6e-6% |
    |              imaginary/primes ||  |                                                          +2.928e9 |   9.3e-7% |                                                                  -0.00% |   2.9e-5% |
    |              imaginary/queens ||  |                                                          +6.710e8 |   6.7e-6% |                                                                  -0.00% |   5.4e-6% |
    |                imaginary/rfib ||  |                                                       +274584.000 |      0.0% |                                                                  -0.04% |   1.4e-2% |
    |                 imaginary/tak ||  |                                                       +232000.000 |      0.0% |                                                                  -0.04% |   8.4e-3% |
    |        imaginary/wheel-sieve1 ||  |                                                          +1.345e8 |   2.0e-5% |                                                                  +0.00% |   4.5e-4% |
    |        imaginary/wheel-sieve2 ||  |                                                          +2.428e9 |   1.6e-6% |                                                                  +0.00% |   8.8e-7% |
    |                imaginary/x2n1 ||  |                                                          +2.562e8 |   2.4e-5% |                                                                   0.00% |   2.9e-5% |
    |         parallel/blackscholes ||  |                                                          +1.983e9 |   4.9e-2% |                                                                  -0.02% |   1.3e-2% |
    |                parallel/coins ||  |                                                          +5.258e9 |   1.4e-2% |                                                                  -0.02% |   9.8e-3% |
    |                 parallel/gray ||  |                                                          +2.012e9 |   8.0e-4% |                                                                  -0.04% |   5.2e-3% |
    |               parallel/mandel ||  |                                                          +8.527e9 |   2.9e-3% |                                                                  -0.00% |   2.4e-3% |
    |              parallel/matmult ||  |                                                          +4.792e8 |      3.7% |                                                                  -9.02% |      4.0% |
    |              parallel/minimax ||  |                                                         +2.212e10 |   3.6e-3% |                                                                  +0.01% |   3.6e-3% |
    |                parallel/nbody ||  |                                                      +1784684.800 |      0.5% |                                                                  +0.87% |      0.3% |
    |               parallel/parfib ||  |                                                          +4.561e8 |      2.0% |                                                                  +0.60% |      2.0% |
    |              parallel/partree ||  |                                                          +3.292e9 |   1.3e-2% |                                                                  +0.00% |   1.5e-2% |
    |                 parallel/prsa ||  |                                                          +2.153e9 |      0.2% |                                                                  +0.99% |      0.3% |
    |               parallel/queens ||  |                                                          +6.980e8 |      0.7% |                                                                  -1.15% |      0.1% |
    |                  parallel/ray ||  |                                                         +1.453e10 |      0.2% |                                                                  +0.15% |      0.2% |
    |             parallel/sumeuler ||  |                                                      +1926656.000 |   2.3e-3% |                                                                  +0.00% |   1.9e-3% |
    |            parallel/transclos ||  |                                                          +9.058e9 |   9.0e-2% |                                                                  -0.06% |   9.8e-2% |
    |                     real/anna ||  |                                                          +2.021e9 |   1.3e-6% |                                                                  -0.00% |   4.8e-6% |
    |             real/ben-raytrace ||  |                                                         +3.419e10 |   1.8e-5% |                                                                  -0.00% |   1.8e-5% |
    |                     real/bspt ||  |                                                          +3.741e9 |   8.4e-7% |                                                                  -0.00% |   2.1e-6% |
    |                real/cacheprof ||  |                                                          +2.473e9 |   1.2e-6% |                                                                  -0.00% |   4.4e-6% |
    |                 real/compress ||  |                                                          +2.807e9 |   1.3e-6% |                                                                  -0.00% |   2.3e-6% |
    |                real/compress2 ||  |                                                          +3.436e9 |   4.2e-6% |                                                                  -0.00% |   1.2e-6% |
    |                   real/eff/CS ||  |                                                          +1.602e8 |   4.5e-5% |                                                                  +0.00% |   2.9e-5% |
    |                  real/eff/CSD ||  |                                                          +1.600e9 |   3.4e-6% |                                                                  -0.00% |   5.7e-6% |
    |                   real/eff/FS ||  |                                                          +1.760e9 |   5.8e-6% |                                                                  -0.00% |   6.3e-6% |
    |                    real/eff/S ||  |                                                          +2.402e8 |   9.3e-5% |                                                                  -0.00% |   1.1e-5% |
    |                   real/eff/VS ||  |                                                          +4.833e8 |   8.6e-6% |                                                                  -0.00% |   1.0e-5% |
    |                  real/eff/VSD ||  |                                                       +184604.800 |   1.6e-3% |                                                                  -0.07% |   3.9e-2% |
    |                  real/eff/VSM ||  |                                                          +1.040e9 |   3.2e-6% |                                                                  -0.00% |   7.7e-6% |
    |                      real/fem ||  |                                                          +4.947e9 |   2.3e-6% |                                                                  -0.00% |   1.8e-6% |
    |                    real/fluid ||  |                                                          +2.161e9 |   3.8e-5% |                                                                  +0.00% |   3.4e-6% |
    |                   real/fulsom ||  |                                                          +1.966e9 |   4.4e-6% |                                                                  -0.00% |   1.5e-6% |
    |                   real/gamteb ||  |                                                          +4.446e9 |   5.9e-7% |                                                                  -0.00% |   2.0e-6% |
    |                       real/gg ||  |                                                          +2.653e9 |   1.8e-6% |                                                                  -0.00% |   1.7e-6% |
    |                     real/grep ||  |                                                          +4.623e9 |   3.5e-6% |                                                                  +0.00% |   1.6e-5% |
    |                   real/hidden ||  |                                                          +5.111e9 |   1.7e-6% |                                                                  -0.00% |   2.1e-6% |
    |                      real/hpg ||  |                                                          +3.168e9 |   8.5e-7% |                                                                  -0.00% |   1.4e-6% |
    |                    real/infer ||  |                                                          +1.731e9 |   1.9e-6% |                                                                  -0.00% |   5.1e-6% |
    |                     real/lift ||  |                                                          +2.732e9 |   1.3e-6% |                                                                  -0.00% |   1.6e-6% |
    |                   real/linear ||  |                                                          +5.412e9 |   5.4e-7% |                                                                  -0.00% |   1.0e-6% |
    |                 real/maillist ||  |                                                          +3.446e9 |   6.3e-7% |                                                                  -0.00% |   8.3e-7% |
    |                  real/mkhprog ||  |                                                      +9386713.600 |   7.1e-3% |                                                                  +0.02% |   8.1e-3% |
    |                   real/parser ||  |                                                          +2.653e9 |   2.4e-6% |                                                                  -0.00% |   1.3e-6% |
    |                      real/pic ||  |                                                          +1.469e9 |      0.0% |                                                                  -0.00% |   2.7e-6% |
    |                   real/prolog ||  |                                                          +2.927e9 |      0.0% |                                                                  -0.00% |   2.0e-6% |
    |                  real/reptile ||  |                                                          +5.122e9 |   5.4e-7% |                                                                  -0.00% |   6.9e-7% |
    |                      real/rsa ||  |                                                          +8.415e8 |   7.0e-6% |                                                                  +0.00% |   2.3e-6% |
    |                      real/scs ||  |                                                          +4.041e9 |   1.1e-6% |                                                                  -0.00% |   1.8e-6% |
    |                  real/smallpt ||  |                                                         +6.487e10 |   4.7e-8% |                                                                  -0.00% |   1.1e-7% |
    |                   real/symalg ||  |                                                          +3.195e8 |   2.8e-5% |                                                                  +0.00% |   9.0e-7% |
    |                  real/veritas ||  |                                                          +4.173e9 |   1.0e-6% |                                                                  -0.00% |   1.4e-6% |
    |         shootout/binary-trees ||  |                                                          +4.364e9 |      0.2% |                                                                  -0.44% |      0.1% |
    |       shootout/fannkuch-redux ||  |                                                       +202404.800 |   2.0e-2% |                                                                  +0.01% |   2.2e-2% |
    |                shootout/fasta ||  |                                                          +7.105e8 |   1.6e-4% |                                                                  -0.00% |   1.8e-4% |
    |         shootout/k-nucleotide ||  |                                                          +2.215e7 |   1.0e-2% |                                                                  +0.01% |   1.6e-2% |
    |               shootout/n-body ||  |                                                       +264984.000 |   1.2e-2% |                                                                  -0.02% |   1.5e-2% |
    |             shootout/pidigits ||  |                                                         +1.027e10 |   6.6e-7% |                                                                  -0.00% |   7.0e-7% |
    |   shootout/reverse-complement ||  |                                                       +193643.200 |   3.3e-2% |                                                                  -0.03% |   1.7e-2% |
    |        shootout/spectral-norm ||  |                                                       +365062.400 |   2.2e-2% |                                                                  +0.00% |   2.5e-2% |
    |               smp/callback001 ||  |                                                          +1.114e9 |   1.6e-5% |                                                                  +0.00% |   2.4e-5% |
    |               smp/callback002 ||  |                                                          +3.264e9 |   7.0e-7% |                                                                  -0.00% |   2.6e-6% |
    |                      smp/chan ||  |                                                          +1.241e9 |   1.5e-2% |                                                                  +0.00% |   1.6e-2% |
    |                     smp/sieve ||  |                                                          +1.408e9 |   6.4e-6% |                                                                  +0.00% |   3.6e-6% |
    |                smp/threads001 ||  |                                                         +1.072e10 |   4.9e-7% |                                                                  -0.00% |   2.9e-7% |
    |                smp/threads003 ||  |                                                          +4.408e8 |   9.5e-3% |                                                                  -0.03% |   9.2e-3% |
    |                smp/threads006 ||  |                                                          +2.243e8 |   5.2e-5% |                                                                  -0.00% |   3.8e-5% |
    |                smp/threads007 ||  |                                                          +1.832e9 |   3.1e-2% |                                                                  +0.05% |   3.6e-2% |
    |                 spectral/ansi ||  |                                                          +7.406e9 |   1.2e-6% |                                                                  +0.00% |   9.2e-7% |
    |                 spectral/atom ||  |                                                          +3.579e9 |   5.6e-7% |                                                                  -0.00% |   1.1e-6% |
    |               spectral/awards ||  |                                                          +4.754e9 |   1.2e-6% |                                                                  +0.00% |   9.3e-7% |
    |               spectral/banner ||  |                                                          +6.139e9 |   1.2e-4% |                                                                  -0.00% |   1.3e-4% |
    |                spectral/boyer ||  |                                                          +4.666e9 |   1.7e-6% |                                                                  -0.00% |   8.2e-7% |
    |               spectral/boyer2 ||  |                                                          +1.151e9 |   3.5e-6% |                                                                  +0.00% |   7.3e-7% |
    |             spectral/calendar ||  |                                                          +7.100e9 |   9.6e-7% |                                                                  -0.00% |   9.6e-7% |
    |             spectral/cichelli ||  |                                                          +1.969e9 |   2.5e-6% |                                                                  -0.00% |   2.7e-6% |
    |              spectral/circsim ||  |                                                          +4.850e9 |   4.7e-7% |                                                                  -0.00% |   1.1e-6% |
    |             spectral/clausify ||  |                                                          +2.095e9 |   1.4e-6% |                                                                  -0.00% |   3.2e-6% |
    |          spectral/constraints ||  |                                                          +4.882e9 |   1.7e-6% |                                                                  -0.00% |   9.1e-7% |
    |         spectral/cryptarithm1 ||  |                                                          +5.981e9 |   1.2e-6% |                                                                  -0.00% |   1.0e-6% |
    |         spectral/cryptarithm2 ||  |                                                          +3.663e9 |   1.8e-6% |                                                                  -0.00% |   1.6e-6% |
    |                  spectral/cse ||  |                                                          +3.802e9 |   1.3e-6% |                                                                  -0.00% |   8.1e-7% |
    |               spectral/dom-lt ||  |                                                          +3.889e9 |   1.5e-6% |                                                                  -0.00% |   2.2e-6% |
    |                spectral/eliza ||  |                                                          +4.099e9 |   2.5e-6% |                                                                  -0.00% |   1.9e-6% |
    |          spectral/exact-reals ||  |                                                          +1.230e9 |   2.3e-7% |                                                                  -0.00% |   4.3e-6% |
    |               spectral/expert ||  |                                                          +2.128e9 |      0.0% |                                                                  -0.00% |   3.4e-6% |
    |                 spectral/fft2 ||  |                                                          +1.458e9 |   5.0e-5% |                                                                  +0.00% |   4.9e-5% |
    |             spectral/fibheaps ||  |                                                          +4.737e9 |   1.5e-6% |                                                                  -0.00% |   1.5e-6% |
    |                 spectral/fish ||  |                                                          +6.183e9 |   4.2e-7% |                                                                  -0.00% |   1.3e-6% |
    |                  spectral/gcd ||  |                                                          +2.069e9 |   5.4e-6% |                                                                  +0.00% |   2.3e-6% |
    | spectral/hartel/comp_lab_zift ||  |                                                          +4.751e9 |   8.8e-7% |                                                                  -0.00% |   1.2e-6% |
    |         spectral/hartel/event ||  |                                                          +3.635e9 |   6.7e-7% |                                                                  -0.00% |   1.3e-6% |
    |           spectral/hartel/fft ||  |                                                          +1.611e9 |   1.3e-6% |                                                                  -0.00% |   2.4e-6% |
    |        spectral/hartel/genfft ||  |                                                          +8.019e9 |   6.5e-7% |                                                                  -0.00% |   9.7e-7% |
    |           spectral/hartel/ida ||  |                                                          +3.515e9 |   2.1e-6% |                                                                  -0.00% |   1.5e-6% |
    |     spectral/hartel/listcompr ||  |                                                          +6.157e9 |   1.0e-6% |                                                                  -0.00% |   5.7e-7% |
    |      spectral/hartel/listcopy ||  |                                                          +6.758e9 |   7.1e-7% |                                                                  -0.00% |   1.1e-6% |
    |      spectral/hartel/nucleic2 ||  |                                                          +3.003e9 |      0.0% |                                                                  -0.00% |   1.5e-6% |
    |       spectral/hartel/parstof ||  |                                                          +1.369e9 |   6.7e-5% |                                                                  +0.00% |   4.9e-5% |
    |         spectral/hartel/sched ||  |                                                          +3.675e9 |   1.4e-6% |                                                                  -0.00% |   5.9e-7% |
    |         spectral/hartel/solid ||  |                                                          +3.509e9 |   3.0e-6% |                                                                  -0.00% |   1.8e-6% |
    |     spectral/hartel/transform ||  |                                                          +3.960e9 |   2.7e-6% |                                                                  -0.00% |   1.4e-6% |
    |     spectral/hartel/typecheck ||  |                                                          +2.570e9 |      0.0% |                                                                  -0.00% |   3.0e-6% |
    |          spectral/hartel/wang ||  |                                                          +4.735e9 |   1.1e-6% |                                                                  -0.00% |   1.5e-6% |
    |     spectral/hartel/wave4main ||  |                                                          +1.147e9 |   4.6e-6% |                                                                  -0.00% |   2.0e-6% |
    |              spectral/integer ||  |                                                          +3.260e9 |   1.5e-6% |                                                                  -0.00% |   2.2e-6% |
    |              spectral/knights ||  |                                                          +1.094e9 |   2.9e-6% |                                                                  -0.00% |   3.6e-6% |
    |               spectral/lambda ||  |                                                          +2.950e9 |   8.0e-7% |                                                                  -0.00% |   9.6e-7% |
    |           spectral/last-piece ||  |                                                          +6.853e8 |   6.3e-7% |                                                                  -0.00% |   7.6e-6% |
    |                 spectral/lcss ||  |                                                          +6.565e9 |   2.6e-7% |                                                                  -0.00% |   1.0e-6% |
    |                 spectral/life ||  |                                                          +6.799e9 |   6.8e-7% |                                                                  +0.00% |   1.1e-5% |
    |               spectral/mandel ||  |                                                          +1.972e9 |   3.7e-5% |                                                                  -0.00% |   3.6e-5% |
    |              spectral/mandel2 ||  |                                                          +5.233e8 |   8.9e-6% |                                                                  +0.00% |   1.1e-5% |
    |                 spectral/mate ||  |                                                          +5.506e9 |   1.6e-6% |                                                                  +0.00% |   1.1e-6% |
    |              spectral/minimax ||  |                                                          +2.641e9 |   2.7e-5% |                                                                  +0.00% |   3.5e-6% |
    |           spectral/multiplier ||  |                                                          +2.850e9 |   9.7e-7% |                                                                  +0.00% |   2.2e-6% |
    |                 spectral/para ||  |                                                          +4.056e9 |   1.7e-6% |                                                                  +0.00% |   2.0e-6% |
    |                spectral/power ||  |                                                          +1.428e9 |   6.1e-6% |                                                                  +0.00% |   1.9e-6% |
    |               spectral/pretty ||  |                                                       +270547.200 |   3.1e-2% |                                                                  +0.03% |   1.7e-2% |
    |            spectral/primetest ||  |                                                          +8.457e8 |   3.6e-6% |                                                                  -0.00% |   9.9e-6% |
    |               spectral/puzzle ||  |                                                          +1.678e9 |   1.6e-6% |                                                                  -0.00% |   5.2e-6% |
    |              spectral/rewrite ||  |                                                          +1.702e9 |   3.9e-6% |                                                                  +0.00% |   4.1e-6% |
    |                  spectral/scc ||  |                                                       +192043.200 |   2.6e-2% |                                                                  -0.04% |   5.2e-2% |
    |               spectral/simple ||  |                                                          +2.317e9 |   7.8e-7% |                                                                  -0.00% |   1.0e-6% |
    |              spectral/sorting ||  |                                                          +3.077e9 |   2.3e-5% |                                                                  -0.00% |   2.8e-6% |
    |               spectral/sphere ||  |                                                          +2.299e9 |   3.7e-6% |                                                                  -0.00% |   3.2e-5% |
    |             spectral/treejoin ||  |                                                          +2.796e9 |   1.4e-6% |                                                                  -0.00% |   3.6e-6% |
    +===============================++==+===================================================================+===========+=========================================================================+===========+
    |                     geom mean ||  |                                                            -0.06% |           |                                                                         |           |
    +-------------------------------++--+-------------------------------------------------------------------+-----------+-------------------------------------------------------------------------+-----------+
    
    
    # mutator time
    
    +-------------------------------++--+-------------------------------------------------------------------+-----------+-------------------------------------------------------------------------+-----------+
    |                               ||  | f220010ea975d654bb1dedbbf3c58973d61f842469ca5b032f91f73c25e8a46e/ | std. err. | a4dd114f3ec0743b4f6d1cf51642f0c0e65f62e5ba7214694e39e3ddb1ad42fa/ (rel) | std. err. |
    +===============================++==+===================================================================+===========+=========================================================================+===========+
    |                    gc/circsim ||  |                                                            +0.972 |      0.6% |                                                                  +7.40% |      1.0% |
    |                gc/constraints ||  |                                                            +0.668 |      0.7% |                                                                  -1.09% |      1.3% |
    |                   gc/fibheaps ||  |                                                            +1.079 |      2.4% |                                                                  +4.43% |      1.0% |
    |                     gc/fulsom ||  |                                                            +2.025 |      5.6% |                                                                  +2.77% |      1.1% |
    |                   gc/gc_bench ||  |                                                            +0.489 |      1.3% |                                                                  -4.78% |      1.2% |
    |                      gc/happy ||  |                                                            +1.157 |      3.3% |                                                                  -6.23% |      0.8% |
    |                       gc/hash ||  |                                                            +0.230 |      4.0% |                                                                  +6.94% |      9.8% |
    |                       gc/lcss ||  |                                                            +1.025 |      0.5% |                                                                  +9.88% |      1.6% |
    |                  gc/mutstore1 ||  |                                                            +0.711 |      2.1% |                                                                 +43.27% |     25.5% |
    |                  gc/mutstore2 ||  |                                                            +0.451 |      9.7% |                                                                 -27.87% |      4.0% |
    |                      gc/power ||  |                                                            +1.181 |      0.6% |                                                                 -14.89% |      1.9% |
    |                 gc/spellcheck ||  |                                                            +1.534 |      4.4% |                                                                  -0.92% |      0.9% |
    |          imaginary/bernouilli ||  |                                                            +2.088 |      1.9% |                                                                 +17.32% |      3.1% |
    |        imaginary/digits-of-e1 ||  |                                                            +1.228 |      0.8% |                                                                  +3.23% |      0.7% |
    |        imaginary/digits-of-e2 ||  |                                                            +1.821 |      4.1% |                                                                 -14.64% |      2.0% |
    |              imaginary/exp3_8 ||  |                                                            +3.396 |      2.1% |                                                                 -17.06% |      1.6% |
    |         imaginary/gen_regexps ||  |                                                            +1.369 |      1.1% |                                                                 +17.78% |      4.4% |
    |           imaginary/integrate ||  |                                                            +1.897 |      5.5% |                                                                 +11.70% |      6.8% |
    |               imaginary/kahan ||  |                                                            +7.224 |      4.0% |                                                                 +10.08% |      3.9% |
    |           imaginary/paraffins ||  |                                                            +2.080 |      1.9% |                                                                 +31.73% |      1.9% |
    |              imaginary/primes ||  |                                                            +2.628 |      2.0% |                                                                  -3.13% |      3.0% |
    |              imaginary/queens ||  |                                                            +1.727 |      0.9% |                                                                  +1.16% |      1.0% |
    |                imaginary/rfib ||  |                                                            +0.973 |      2.2% |                                                                 +46.46% |      4.3% |
    |                 imaginary/tak ||  |                                                            +1.358 |      2.4% |                                                                 +15.69% |      2.8% |
    |        imaginary/wheel-sieve1 ||  |                                                            +1.183 |      6.2% |                                                                  +2.19% |      1.3% |
    |        imaginary/wheel-sieve2 ||  |                                                            +2.255 |      3.3% |                                                                  +1.38% |      1.5% |
    |                imaginary/x2n1 ||  |                                                            +1.336 |      0.5% |                                                                  +8.24% |      0.6% |
    |         parallel/blackscholes ||  |                                                            +2.049 |      1.2% |                                                                  +3.93% |      1.0% |
    |                parallel/coins ||  |                                                            +1.256 |      3.3% |                                                                 +25.01% |      1.4% |
    |                 parallel/gray ||  |                                                            +2.889 |      2.1% |                                                                 -58.41% |      1.8% |
    |               parallel/mandel ||  |                                                            +6.464 |     19.4% |                                                                  -5.11% |      5.0% |
    |              parallel/matmult ||  |                                                            +6.492 |      4.0% |                                                                 -53.94% |      1.2% |
    |              parallel/minimax ||  |                                                            +6.901 |      0.8% |                                                                  -4.57% |      1.3% |
    |                parallel/nbody ||  |                                                            +0.130 |      0.4% |                                                                 +10.31% |      2.8% |
    |               parallel/parfib ||  |                                                            +4.700 |      1.6% |                                                                  -2.35% |      2.6% |
    |              parallel/partree ||  |                                                            +5.547 |      1.0% |                                                                 -70.62% |      1.3% |
    |                 parallel/prsa ||  |                                                            +4.676 |      0.6% |                                                                 -23.99% |      1.2% |
    |               parallel/queens ||  |                                                            +1.966 |      1.7% |                                                                  +8.26% |      2.9% |
    |                  parallel/ray ||  |                                                            +4.379 |      2.6% |                                                                 +16.52% |      3.4% |
    |             parallel/sumeuler ||  |                                                            +5.241 |      0.3% |                                                                 -12.14% |      7.2% |
    |            parallel/transclos ||  |                                                            +5.367 |      2.6% |                                                                 -16.61% |      1.7% |
    |                     real/anna ||  |                                                            +2.441 |      1.5% |                                                                  -7.55% |      0.2% |
    |             real/ben-raytrace ||  |                                                           +63.440 |      0.7% |                                                                 -55.15% |      3.4% |
    |                     real/bspt ||  |                                                            +2.656 |      1.5% |                                                                 +14.76% |      1.5% |
    |                real/cacheprof ||  |                                                            +1.860 |      0.7% |                                                                 -25.01% |      3.2% |
    |                 real/compress ||  |                                                            +1.939 |      1.2% |                                                                 -27.65% |      4.2% |
    |                real/compress2 ||  |                                                            +2.308 |      4.7% |                                                                 -31.55% |      1.9% |
    |                   real/eff/CS ||  |                                                            +0.248 |      2.4% |                                                                 -31.50% |      4.0% |
    |                  real/eff/CSD ||  |                                                            +1.845 |      2.0% |                                                                 -42.60% |      4.9% |
    |                   real/eff/FS ||  |                                                            +2.016 |      4.6% |                                                                 -56.86% |      4.3% |
    |                    real/eff/S ||  |                                                            +0.205 |     57.7% |                                                                 +39.51% |     11.2% |
    |                   real/eff/VS ||  |                                                            +0.723 |      1.8% |                                                                 -39.32% |      0.9% |
    |                  real/eff/VSD ||  |                                                         +1.027e-2 |      2.4% |                                                                 -15.84% |      1.3% |
    |                  real/eff/VSM ||  |                                                            +1.199 |      2.4% |                                                                 -45.96% |      2.5% |
    |                      real/fem ||  |                                                            +2.515 |      1.9% |                                                                 -26.54% |      4.5% |
    |                    real/fluid ||  |                                                            +1.819 |      2.5% |                                                                 -14.83% |      4.6% |
    |                   real/fulsom ||  |                                                            +1.337 |      1.0% |                                                                 -30.46% |      2.6% |
    |                   real/gamteb ||  |                                                            +3.060 |      1.7% |                                                                 -27.06% |      4.1% |
    |                       real/gg ||  |                                                            +2.332 |      2.2% |                                                                 -22.29% |      2.9% |
    |                     real/grep ||  |                                                            +3.050 |      4.7% |                                                                 -40.52% |      2.2% |
    |                   real/hidden ||  |                                                            +3.149 |      0.7% |                                                                 -31.30% |      2.1% |
    |                      real/hpg ||  |                                                            +2.036 |      0.9% |                                                                 -25.14% |      3.7% |
    |                    real/infer ||  |                                                            +1.910 |      2.9% |                                                                 -10.96% |      0.5% |
    |                     real/lift ||  |                                                            +2.062 |      1.7% |                                                                 -29.64% |      2.9% |
    |                   real/linear ||  |                                                            +3.785 |      2.3% |                                                                 -18.50% |      2.8% |
    |                 real/maillist ||  |                                                            +3.083 |      0.8% |                                                                  +2.29% |      0.8% |
    |                  real/mkhprog ||  |                                                         +5.396e-3 |      6.1% |                                                                 +68.53% |      9.9% |
    |                   real/parser ||  |                                                            +2.153 |      2.1% |                                                                 -38.29% |      3.4% |
    |                      real/pic ||  |                                                            +1.411 |      2.3% |                                                                 -22.30% |      1.6% |
    |                   real/prolog ||  |                                                            +2.568 |      4.2% |                                                                 -40.10% |      1.7% |
    |                  real/reptile ||  |                                                            +2.687 |      0.6% |                                                                 -32.68% |      1.7% |
    |                      real/rsa ||  |                                                            +1.797 |      1.0% |                                                                 -18.67% |      4.0% |
    |                      real/scs ||  |                                                            +4.751 |      1.5% |                                                                 -66.61% |      1.6% |
    |                  real/smallpt ||  |                                                           +96.087 |      0.7% |                                                                 +12.10% |      0.5% |
    |                   real/symalg ||  |                                                            +1.850 |      2.9% |                                                                 -36.16% |      1.0% |
    |                  real/veritas ||  |                                                            +5.249 |      2.4% |                                                                 -66.43% |      4.2% |
    |         shootout/binary-trees ||  |                                                            +2.319 |      3.9% |                                                                  +0.58% |      3.3% |
    |       shootout/fannkuch-redux ||  |                                                            +3.335 |      0.8% |                                                                  +9.56% |      1.1% |
    |                shootout/fasta ||  |                                                            +1.306 |      1.2% |                                                                  +8.05% |      1.5% |
    |         shootout/k-nucleotide ||  |                                                            +1.118 |      2.5% |                                                                  -0.86% |      2.4% |
    |               shootout/n-body ||  |                                                            +1.979 |      1.3% |                                                                  +9.39% |      2.8% |
    |             shootout/pidigits ||  |                                                            +4.168 |      6.2% |                                                                 -23.17% |      2.2% |
    |   shootout/reverse-complement ||  |                                                         +2.048e-4 |     20.5% |                                                                  +7.13% |     22.9% |
    |        shootout/spectral-norm ||  |                                                            +0.666 |      8.3% |                                                                 -17.59% |      0.8% |
    |               smp/callback001 ||  |                                                            +1.052 |      1.8% |                                                                 +58.18% |      7.1% |
    |               smp/callback002 ||  |                                                            +2.513 |      5.5% |                                                                 +10.85% |      2.6% |
    |                      smp/chan ||  |                                                            +1.101 |      1.6% |                                                                 +14.10% |      2.8% |
    |                     smp/sieve ||  |                                                            +0.594 |      0.7% |                                                                  -2.39% |      3.0% |
    |                smp/threads001 ||  |                                                            +5.603 |      1.1% |                                                                 -13.04% |      1.9% |
    |                smp/threads003 ||  |                                                            +8.807 |      2.7% |                                                                 -10.67% |      0.7% |
    |                smp/threads006 ||  |                                                            +0.586 |      5.6% |                                                                  +3.56% |      5.3% |
    |                smp/threads007 ||  |                                                           +21.437 |      0.9% |                                                                  +5.61% |      0.9% |
    |                 spectral/ansi ||  |                                                            +3.141 |      1.4% |                                                                 -20.24% |      5.6% |
    |                 spectral/atom ||  |                                                            +2.640 |      2.7% |                                                                 -23.47% |      3.1% |
    |               spectral/awards ||  |                                                            +2.992 |      1.2% |                                                                 -25.69% |      3.6% |
    |               spectral/banner ||  |                                                            +2.812 |      4.0% |                                                                 -11.22% |      6.2% |
    |                spectral/boyer ||  |                                                            +3.143 |      7.3% |                                                                 -29.47% |      3.5% |
    |               spectral/boyer2 ||  |                                                            +1.665 |      2.8% |                                                                  +0.28% |      1.7% |
    |             spectral/calendar ||  |                                                            +2.982 |      3.9% |                                                                 -14.47% |      4.2% |
    |             spectral/cichelli ||  |                                                            +2.054 |      2.1% |                                                                 -13.38% |      1.5% |
    |              spectral/circsim ||  |                                                            +1.856 |      0.9% |                                                                  -3.30% |      1.7% |
    |             spectral/clausify ||  |                                                            +2.229 |      2.7% |                                                                 -12.12% |      1.4% |
    |          spectral/constraints ||  |                                                            +3.424 |      7.3% |                                                                 -31.04% |      4.5% |
    |         spectral/cryptarithm1 ||  |                                                            +2.801 |      3.7% |                                                                 -16.17% |      2.9% |
    |         spectral/cryptarithm2 ||  |                                                            +2.422 |      1.4% |                                                                  -7.69% |      6.7% |
    |                  spectral/cse ||  |                                                            +2.428 |      2.1% |                                                                  -5.35% |      2.5% |
    |               spectral/dom-lt ||  |                                                            +3.151 |      2.7% |                                                                  -4.87% |      1.3% |
    |                spectral/eliza ||  |                                                            +2.737 |      1.3% |                                                                 -12.89% |      3.1% |
    |          spectral/exact-reals ||  |                                                            +1.521 |      0.8% |                                                                  -1.26% |      1.0% |
    |               spectral/expert ||  |                                                            +2.111 |      0.6% |                                                                  -3.78% |      1.9% |
    |                 spectral/fft2 ||  |                                                            +1.983 |      2.0% |                                                                 -13.23% |      1.6% |
    |             spectral/fibheaps ||  |                                                            +3.099 |      1.2% |                                                                 -27.66% |      3.0% |
    |                 spectral/fish ||  |                                                            +3.853 |      1.8% |                                                                 -10.17% |      2.0% |
    |                  spectral/gcd ||  |                                                            +1.924 |      0.6% |                                                                  -8.08% |      4.0% |
    | spectral/hartel/comp_lab_zift ||  |                                                            +2.998 |      2.6% |                                                                 -17.43% |      5.2% |
    |         spectral/hartel/event ||  |                                                            +2.957 |      2.1% |                                                                 -27.59% |      2.3% |
    |           spectral/hartel/fft ||  |                                                            +1.402 |      4.9% |                                                                 -37.99% |      2.1% |
    |        spectral/hartel/genfft ||  |                                                            +4.534 |      2.2% |                                                                 -40.07% |      1.9% |
    |           spectral/hartel/ida ||  |                                                            +2.635 |      1.9% |                                                                 -17.20% |      2.6% |
    |     spectral/hartel/listcompr ||  |                                                            +2.724 |      3.1% |                                                                 -14.66% |      6.4% |
    |      spectral/hartel/listcopy ||  |                                                            +3.064 |      4.7% |                                                                 -15.93% |      1.7% |
    |      spectral/hartel/nucleic2 ||  |                                                            +2.091 |      1.0% |                                                                 -33.35% |      2.0% |
    |       spectral/hartel/parstof ||  |                                                            +1.590 |      3.7% |                                                                  +3.53% |      3.4% |
    |         spectral/hartel/sched ||  |                                                            +2.381 |      1.3% |                                                                 -29.00% |      1.5% |
    |         spectral/hartel/solid ||  |                                                            +2.561 |      1.8% |                                                                 -18.05% |      2.4% |
    |     spectral/hartel/transform ||  |                                                            +2.640 |      1.3% |                                                                 -34.98% |      1.3% |
    |     spectral/hartel/typecheck ||  |                                                            +2.589 |      3.4% |                                                                  -7.34% |      2.5% |
    |          spectral/hartel/wang ||  |                                                            +2.958 |      4.6% |                                                                 -18.63% |      2.2% |
    |     spectral/hartel/wave4main ||  |                                                            +1.403 |      0.6% |                                                                  -1.29% |      1.9% |
    |              spectral/integer ||  |                                                            +2.085 |      0.8% |                                                                  +4.24% |      2.5% |
    |              spectral/knights ||  |                                                            +2.529 |      2.7% |                                                                  -5.23% |      0.3% |
    |               spectral/lambda ||  |                                                            +2.556 |      1.9% |                                                                 -33.80% |      5.4% |
    |           spectral/last-piece ||  |                                                            +0.651 |      2.3% |                                                                 -11.99% |      2.5% |
    |                 spectral/lcss ||  |                                                            +3.970 |      5.6% |                                                                 -38.52% |      1.9% |
    |                 spectral/life ||  |                                                            +3.948 |      4.8% |                                                                 -37.92% |      2.8% |
    |               spectral/mandel ||  |                                                            +1.810 |      2.4% |                                                                  +2.63% |      5.8% |
    |              spectral/mandel2 ||  |                                                            +1.465 |      1.2% |                                                                  -7.80% |      0.8% |
    |                 spectral/mate ||  |                                                            +3.662 |      5.2% |                                                                 -33.67% |      5.9% |
    |              spectral/minimax ||  |                                                            +2.164 |      4.3% |                                                                 +15.42% |      2.5% |
    |           spectral/multiplier ||  |                                                            +2.057 |      0.8% |                                                                 -13.92% |      2.5% |
    |                 spectral/para ||  |                                                            +4.043 |      9.9% |                                                                 -52.29% |      1.5% |
    |                spectral/power ||  |                                                            +2.257 |      3.2% |                                                                 -32.94% |      1.6% |
    |               spectral/pretty ||  |                                                         +3.450e-4 |     25.9% |                                                                 +10.09% |     18.1% |
    |            spectral/primetest ||  |                                                            +1.409 |      4.8% |                                                                  +0.25% |      1.3% |
    |               spectral/puzzle ||  |                                                            +1.672 |      0.8% |                                                                  +4.54% |      0.9% |
    |              spectral/rewrite ||  |                                                            +1.579 |      7.6% |                                                                 +15.56% |      3.3% |
    |                  spectral/scc ||  |                                                         +1.626e-4 |      5.1% |                                                                 +35.42% |     17.7% |
    |               spectral/simple ||  |                                                            +2.860 |      1.6% |                                                                 -31.68% |      1.2% |
    |              spectral/sorting ||  |                                                            +2.873 |      3.3% |                                                                 -30.88% |      6.0% |
    |               spectral/sphere ||  |                                                            +2.425 |      9.2% |                                                                 -46.98% |      8.3% |
    |             spectral/treejoin ||  |                                                            +2.166 |      2.0% |                                                                  -3.81% |      0.7% |
    +===============================++==+===================================================================+===========+=========================================================================+===========+
    |                     geom mean ||  |                                                           -14.66% |           |                                                                         |           |
    +-------------------------------++--+-------------------------------------------------------------------+-----------+-------------------------------------------------------------------------+-----------+
    
    
    # GC (cpu) time
    
    +-------------------------------++--+-------------------------------------------------------------------+-----------+-------------------------------------------------------------------------+-----------+
    |                               ||  | f220010ea975d654bb1dedbbf3c58973d61f842469ca5b032f91f73c25e8a46e/ | std. err. | a4dd114f3ec0743b4f6d1cf51642f0c0e65f62e5ba7214694e39e3ddb1ad42fa/ (rel) | std. err. |
    +===============================++==+===================================================================+===========+=========================================================================+===========+
    |                    gc/circsim ||  |                                                            +1.437 |      2.0% |                                                                 -17.44% |      0.6% |
    |                gc/constraints ||  |                                                            +1.360 |      0.5% |                                                                  +0.67% |      0.8% |
    |                   gc/fibheaps ||  |                                                            +4.501 |     18.2% |                                                                 -69.49% |      1.1% |
    |                     gc/fulsom ||  |                                                            +3.023 |      2.8% |                                                                 +40.92% |      0.9% |
    |                   gc/gc_bench ||  |                                                            +0.710 |      8.5% |                                                                 -12.02% |      7.1% |
    |                      gc/happy ||  |                                                            +0.851 |      2.7% |                                                                 -51.16% |      1.8% |
    |                       gc/hash ||  |                                                            +3.865 |      4.2% |                                                                  +3.16% |      2.6% |
    |                       gc/lcss ||  |                                                            +3.444 |      4.6% |                                                                 -17.84% |      1.0% |
    |                  gc/mutstore1 ||  |                                                            +9.116 |      8.2% |                                                                 -41.08% |      1.4% |
    |                  gc/mutstore2 ||  |                                                           +15.770 |     11.1% |                                                                 -71.21% |      2.9% |
    |                      gc/power ||  |                                                            +3.232 |      8.7% |                                                                  -2.38% |      1.5% |
    |                 gc/spellcheck ||  |                                                            +0.951 |      3.4% |                                                                  +0.04% |      2.6% |
    |          imaginary/bernouilli ||  |                                                            +0.491 |      8.7% |                                                                +130.47% |      0.7% |
    |        imaginary/digits-of-e1 ||  |                                                            +0.286 |      3.2% |                                                                +107.93% |      1.7% |
    |        imaginary/digits-of-e2 ||  |                                                            +0.973 |     10.1% |                                                                 +23.99% |      1.3% |
    |              imaginary/exp3_8 ||  |                                                            +3.904 |      4.9% |                                                                 -22.29% |      1.1% |
    |         imaginary/gen_regexps ||  |                                                            +1.040 |      6.6% |                                                                 -37.53% |      3.2% |
    |           imaginary/integrate ||  |                                                            +0.738 |      5.4% |                                                                 +70.20% |      5.3% |
    |               imaginary/kahan ||  |                                                            +5.542 |      5.6% |                                                                  +7.74% |      7.1% |
    |           imaginary/paraffins ||  |                                                           +21.732 |      2.1% |                                                                 -83.18% |      0.6% |
    |              imaginary/primes ||  |                                                            +1.742 |      5.1% |                                                                 +39.98% |      3.6% |
    |              imaginary/queens ||  |                                                            +0.117 |      9.1% |                                                                +131.50% |      3.6% |
    |                imaginary/rfib ||  |                                                            +2.024 |      5.8% |                                                                 +62.36% |      5.7% |
    |                 imaginary/tak ||  |                                                            +3.190 |      3.1% |                                                                 +20.83% |      5.4% |
    |        imaginary/wheel-sieve1 ||  |                                                            +0.452 |      4.3% |                                                                 -68.93% |      5.7% |
    |        imaginary/wheel-sieve2 ||  |                                                            +7.209 |      2.9% |                                                                 -60.40% |      2.6% |
    |                imaginary/x2n1 ||  |                                                         +9.297e-2 |     10.9% |                                                                 +55.98% |      4.5% |
    |         parallel/blackscholes ||  |                                                            +0.140 |     10.4% |                                                                  +3.10% |     10.6% |
    |                parallel/coins ||  |                                                            +2.378 |      0.8% |                                                                 -14.35% |      0.9% |
    |                 parallel/gray ||  |                                                            +2.831 |      4.5% |                                                                 -78.77% |      1.5% |
    |               parallel/mandel ||  |                                                            +1.486 |     26.3% |                                                                 -42.80% |      6.8% |
    |              parallel/matmult ||  |                                                            +0.733 |      7.7% |                                                                 -81.52% |      4.6% |
    |              parallel/minimax ||  |                                                            +2.831 |      1.3% |                                                                  -3.67% |      1.3% |
    |                parallel/nbody ||  |                                                         +1.822e-4 |      7.8% |                                                                  -0.33% |      2.1% |
    |               parallel/parfib ||  |                                                            +0.121 |     12.4% |                                                                 -22.89% |     12.8% |
    |              parallel/partree ||  |                                                            +7.280 |      1.2% |                                                                 -67.67% |      2.0% |
    |                 parallel/prsa ||  |                                                            +1.051 |      0.7% |                                                                 -73.60% |      8.0% |
    |               parallel/queens ||  |                                                            +0.305 |     10.7% |                                                                 -45.84% |      9.8% |
    |                  parallel/ray ||  |                                                            +3.495 |      2.0% |                                                                  -9.53% |      2.4% |
    |             parallel/sumeuler ||  |                                                            +0.543 |      6.3% |                                                                  -7.01% |      2.2% |
    |            parallel/transclos ||  |                                                            +1.111 |      3.0% |                                                                 -36.43% |      1.6% |
    |                     real/anna ||  |                                                            +1.719 |      8.3% |                                                                  -5.30% |      0.8% |
    |             real/ben-raytrace ||  |                                                            +5.463 |      6.8% |                                                                 -57.61% |      4.2% |
    |                     real/bspt ||  |                                                            +0.555 |      6.1% |                                                                +156.81% |      3.7% |
    |                real/cacheprof ||  |                                                            +4.533 |      6.2% |                                                                 -71.24% |      2.7% |
    |                 real/compress ||  |                                                            +2.583 |      4.5% |                                                                 -32.01% |      3.0% |
    |                real/compress2 ||  |                                                            +2.139 |      5.3% |                                                                  +9.17% |      1.6% |
    |                   real/eff/CS ||  |                                                            +0.112 |      8.0% |                                                                 -26.82% |      7.0% |
    |                  real/eff/CSD ||  |                                                            +0.649 |      1.9% |                                                                 -11.40% |      3.0% |
    |                   real/eff/FS ||  |                                                            +1.070 |     13.5% |                                                                 -47.34% |      5.1% |
    |                    real/eff/S ||  |                                                           +10.559 |      7.0% |                                                                 -90.74% |      1.1% |
    |                   real/eff/VS ||  |                                                            +1.506 |     12.8% |                                                                 -79.48% |      3.7% |
    |                  real/eff/VSD ||  |                                                         +1.504e-4 |     44.2% |                                                                  -9.04% |     43.4% |
    |                  real/eff/VSM ||  |                                                            +0.425 |      2.8% |                                                                 -10.79% |      4.8% |
    |                      real/fem ||  |                                                            +1.964 |      3.8% |                                                                 -19.64% |      5.4% |
    |                    real/fluid ||  |                                                            +1.259 |      2.0% |                                                                 +11.32% |      4.8% |
    |                   real/fulsom ||  |                                                            +1.075 |      7.0% |                                                                  +4.26% |      2.4% |
    |                   real/gamteb ||  |                                                            +2.201 |      3.6% |                                                                 -12.07% |      4.4% |
    |                       real/gg ||  |                                                            +5.490 |      5.4% |                                                                 -43.30% |      1.6% |
    |                     real/grep ||  |                                                            +4.105 |     13.6% |                                                                 -66.34% |      3.8% |
    |                   real/hidden ||  |                                                            +1.284 |      4.4% |                                                                  +6.12% |      1.9% |
    |                      real/hpg ||  |                                                            +2.694 |      3.0% |                                                                 -39.93% |      1.6% |
    |                    real/infer ||  |                                                            +5.352 |      3.9% |                                                                 -61.07% |      1.4% |
    |                     real/lift ||  |                                                            +1.282 |      2.2% |                                                                 -38.44% |      4.7% |
    |                   real/linear ||  |                                                            +2.979 |      5.1% |                                                                 +11.50% |      2.5% |
    |                 real/maillist ||  |                                                            +1.050 |      6.0% |                                                                 +72.59% |      2.3% |
    |                  real/mkhprog ||  |                                                         +3.560e-3 |      4.7% |                                                                +148.99% |     31.5% |
    |                   real/parser ||  |                                                            +2.635 |      6.0% |                                                                 -45.83% |      2.1% |
    |                      real/pic ||  |                                                            +1.685 |      5.9% |                                                                 +39.93% |      2.0% |
    |                   real/prolog ||  |                                                            +1.896 |      5.0% |                                                                 -48.21% |      2.5% |
    |                  real/reptile ||  |                                                            +2.084 |      5.0% |                                                                 -40.18% |      1.3% |
    |                      real/rsa ||  |                                                            +0.443 |      4.2% |                                                                  -0.80% |      4.1% |
    |                      real/scs ||  |                                                            +4.639 |      9.6% |                                                                 -72.43% |      1.5% |
    |                  real/smallpt ||  |                                                           +16.846 |      4.0% |                                                                 +81.14% |      2.3% |
    |                   real/symalg ||  |                                                            +1.010 |      2.2% |                                                                 -81.17% |      3.1% |
    |                  real/veritas ||  |                                                            +7.776 |      9.5% |                                                                 -83.82% |      5.0% |
    |         shootout/binary-trees ||  |                                                            +1.908 |     12.9% |                                                                 -29.98% |      1.6% |
    |       shootout/fannkuch-redux ||  |                                                         +1.788e-4 |      2.1% |                                                                 -40.49% |     55.7% |
    |                shootout/fasta ||  |                                                            +0.253 |     11.1% |                                                                 +40.50% |      8.0% |
    |         shootout/k-nucleotide ||  |                                                         +2.298e-2 |     45.6% |                                                                 -74.15% |      6.0% |
    |               shootout/n-body ||  |                                                            +4.982 |      1.5% |                                                                 +14.40% |      3.8% |
    |             shootout/pidigits ||  |                                                            +2.480 |      7.3% |                                                                  -7.29% |      2.5% |
    |   shootout/reverse-complement ||  |                                                         +1.346e-4 |     25.2% |                                                                 -19.17% |     38.2% |
    |        shootout/spectral-norm ||  |                                                             0.000 |      NaN% |                                                              +Infinity% |     89.4% |
    |               smp/callback001 ||  |                                                            +1.659 |      9.9% |                                                                 -22.12% |     10.2% |
    |               smp/callback002 ||  |                                                            +0.835 |      7.2% |                                                                 +94.92% |      2.1% |
    |                      smp/chan ||  |                                                            +6.443 |     41.5% |                                                                 -86.09% |     22.7% |
    |                     smp/sieve ||  |                                                            +0.249 |      4.8% |                                                                 -16.60% |      2.0% |
    |                smp/threads001 ||  |                                                            +2.315 |      3.2% |                                                                  +7.56% |      2.7% |
    |                smp/threads003 ||  |                                                            +0.109 |      6.4% |                                                                 -20.37% |      1.0% |
    |                smp/threads006 ||  |                                                            +0.588 |      2.6% |                                                                  -8.25% |      1.6% |
    |                smp/threads007 ||  |                                                            +1.611 |      2.3% |                                                                 +29.90% |      2.4% |
    |                 spectral/ansi ||  |                                                            +3.485 |      4.8% |                                                                  -0.79% |      5.4% |
    |                 spectral/atom ||  |                                                            +8.846 |      5.1% |                                                                 -44.87% |      1.1% |
    |               spectral/awards ||  |                                                            +1.123 |      5.1% |                                                                 +16.07% |      3.7% |
    |               spectral/banner ||  |                                                            +1.848 |      3.4% |                                                                  -6.64% |      5.7% |
    |                spectral/boyer ||  |                                                            +4.197 |      8.2% |                                                                 -21.14% |      2.5% |
    |               spectral/boyer2 ||  |                                                            +1.625 |      3.1% |                                                                 -19.78% |      1.1% |
    |             spectral/calendar ||  |                                                            +1.608 |      4.5% |                                                                 +11.39% |      4.7% |
    |             spectral/cichelli ||  |                                                            +2.660 |     10.3% |                                                                 -41.97% |      1.2% |
    |              spectral/circsim ||  |                                                            +2.058 |      2.0% |                                                                 +16.07% |      1.1% |
    |             spectral/clausify ||  |                                                            +1.227 |      3.5% |                                                                 +53.26% |      2.7% |
    |          spectral/constraints ||  |                                                            +1.807 |      9.6% |                                                                  +6.55% |      4.6% |
    |         spectral/cryptarithm1 ||  |                                                            +1.313 |      2.3% |                                                                 +16.31% |      1.7% |
    |         spectral/cryptarithm2 ||  |                                                            +0.842 |      4.6% |                                                                 +48.04% |      5.7% |
    |                  spectral/cse ||  |                                                            +0.738 |      6.6% |                                                                 +77.18% |      2.2% |
    |               spectral/dom-lt ||  |                                                            +1.176 |      5.2% |                                                                +164.03% |      2.6% |
    |                spectral/eliza ||  |                                                            +0.816 |      9.3% |                                                                 +66.47% |      3.4% |
    |          spectral/exact-reals ||  |                                                            +0.319 |      4.5% |                                                                +135.36% |      2.3% |
    |               spectral/expert ||  |                                                            +0.704 |      1.5% |                                                                 +70.80% |      3.7% |
    |                 spectral/fft2 ||  |                                                            +1.449 |      7.3% |                                                                 -16.36% |      0.9% |
    |             spectral/fibheaps ||  |                                                            +3.999 |      2.9% |                                                                 -34.23% |      2.3% |
    |                 spectral/fish ||  |                                                            +1.121 |      4.9% |                                                                 +85.13% |      2.1% |
    |                  spectral/gcd ||  |                                                            +1.232 |      9.3% |                                                                 -13.38% |      5.9% |
    | spectral/hartel/comp_lab_zift ||  |                                                            +2.598 |      4.0% |                                                                 +14.30% |      5.8% |
    |         spectral/hartel/event ||  |                                                            +7.727 |      7.1% |                                                                 -41.35% |      2.3% |
    |           spectral/hartel/fft ||  |                                                            +2.474 |      5.8% |                                                                  +9.98% |      1.6% |
    |        spectral/hartel/genfft ||  |                                                            +9.952 |      9.6% |                                                                 -74.01% |      1.3% |
    |           spectral/hartel/ida ||  |                                                            +2.121 |      3.4% |                                                                 +16.29% |      3.7% |
    |     spectral/hartel/listcompr ||  |                                                            +1.348 |      5.3% |                                                                 +13.98% |      6.0% |
    |      spectral/hartel/listcopy ||  |                                                            +1.539 |      2.7% |                                                                  +7.67% |      1.4% |
    |      spectral/hartel/nucleic2 ||  |                                                            +0.713 |      6.3% |                                                                 +29.18% |      2.6% |
    |       spectral/hartel/parstof ||  |                                                            +2.359 |      6.3% |                                                                 -15.89% |      4.2% |
    |         spectral/hartel/sched ||  |                                                            +1.081 |      8.0% |                                                                 +10.76% |      4.0% |
    |         spectral/hartel/solid ||  |                                                            +1.545 |      5.0% |                                                                 +33.35% |      2.6% |
    |     spectral/hartel/transform ||  |                                                            +1.973 |     11.5% |                                                                 -44.87% |      1.8% |
    |     spectral/hartel/typecheck ||  |                                                            +0.802 |      6.7% |                                                                 +58.12% |      3.0% |
    |          spectral/hartel/wang ||  |                                                            +4.636 |      1.9% |                                                                 -23.79% |      3.1% |
    |     spectral/hartel/wave4main ||  |                                                            +0.766 |      4.4% |                                                                 +52.42% |      0.7% |
    |              spectral/integer ||  |                                                            +0.645 |      2.2% |                                                                 +67.42% |      2.3% |
    |              spectral/knights ||  |                                                            +0.627 |      5.2% |                                                                 +13.80% |      1.5% |
    |               spectral/lambda ||  |                                                            +3.429 |      9.1% |                                                                 -56.37% |      5.5% |
    |           spectral/last-piece ||  |                                                            +0.384 |      3.3% |                                                                 +81.49% |      3.7% |
    |                 spectral/lcss ||  |                                                            +5.099 |      4.0% |                                                                 -33.31% |      1.6% |
    |                 spectral/life ||  |                                                            +4.544 |      5.5% |                                                                 -34.69% |      3.3% |
    |               spectral/mandel ||  |                                                            +0.374 |      5.1% |                                                                 +99.18% |      2.9% |
    |              spectral/mandel2 ||  |                                                            +0.366 |      4.9% |                                                                 -27.08% |      4.1% |
    |                 spectral/mate ||  |                                                            +1.922 |      2.1% |                                                                 -25.81% |      7.4% |
    |              spectral/minimax ||  |                                                            +0.482 |     16.7% |                                                                +125.92% |      3.2% |
    |           spectral/multiplier ||  |                                                           +11.971 |      1.5% |                                                                 -50.48% |      1.5% |
    |                 spectral/para ||  |                                                            +4.370 |      8.7% |                                                                 -67.26% |      2.2% |
    |                spectral/power ||  |                                                            +1.818 |      1.5% |                                                                  +9.97% |      1.4% |
    |               spectral/pretty ||  |                                                         +1.738e-4 |     29.7% |                                                                 -22.21% |     22.6% |
    |            spectral/primetest ||  |                                                            +0.214 |     11.1% |                                                                 +78.32% |      2.4% |
    |               spectral/puzzle ||  |                                                            +2.172 |      9.4% |                                                                 -50.04% |      0.9% |
    |              spectral/rewrite ||  |                                                            +0.631 |     15.4% |                                                                 +16.53% |      3.7% |
    |                  spectral/scc ||  |                                                         +8.460e-5 |     36.5% |                                                                 +48.23% |     22.5% |
    |               spectral/simple ||  |                                                           +10.486 |      5.3% |                                                                 -38.77% |      1.6% |
    |              spectral/sorting ||  |                                                            +3.400 |      3.3% |                                                                 -45.04% |      7.2% |
    |               spectral/sphere ||  |                                                            +1.285 |     16.3% |                                                                 -43.45% |      7.9% |
    |             spectral/treejoin ||  |                                                            +8.973 |      3.5% |                                                                 -58.43% |      1.9% |
    +===============================++==+===================================================================+===========+=========================================================================+===========+
    |                     geom mean ||  |                                                        +Infinity% |           |                                                                         |           |
    +-------------------------------++--+-------------------------------------------------------------------+-----------+-------------------------------------------------------------------------+-----------+
    
    
    # GC (wall) time
    
    +-------------------------------++--+-------------------------------------------------------------------+-----------+-------------------------------------------------------------------------+-----------+
    |                               ||  | f220010ea975d654bb1dedbbf3c58973d61f842469ca5b032f91f73c25e8a46e/ | std. err. | a4dd114f3ec0743b4f6d1cf51642f0c0e65f62e5ba7214694e39e3ddb1ad42fa/ (rel) | std. err. |
    +===============================++==+===================================================================+===========+=========================================================================+===========+
    |                    gc/circsim ||  |                                                            +0.185 |      1.9% |                                                                 +17.06% |      1.0% |
    |                gc/constraints ||  |                                                            +0.180 |      0.6% |                                                                  +5.31% |      0.8% |
    |                   gc/fibheaps ||  |                                                            +0.572 |     17.9% |                                                                 -19.30% |      0.4% |
    |                     gc/fulsom ||  |                                                            +0.375 |      2.5% |                                                                +101.22% |      1.4% |
    |                   gc/gc_bench ||  |                                                         +9.276e-2 |      9.3% |                                                                  -4.51% |      6.7% |
    |                      gc/happy ||  |                                                            +0.113 |      4.7% |                                                                  -4.32% |      1.6% |
    |                       gc/hash ||  |                                                            +0.511 |      4.2% |                                                                 +80.55% |      4.1% |
    |                       gc/lcss ||  |                                                            +0.442 |      4.4% |                                                                 +10.88% |      0.9% |
    |                  gc/mutstore1 ||  |                                                            +1.175 |      7.8% |                                                                 +39.14% |      3.0% |
    |                  gc/mutstore2 ||  |                                                            +2.015 |     10.8% |                                                                 -12.83% |      4.3% |
    |                      gc/power ||  |                                                            +0.408 |      8.5% |                                                                 +57.23% |      2.7% |
    |                 gc/spellcheck ||  |                                                            +0.106 |      2.1% |                                                                 +67.80% |      3.1% |
    |          imaginary/bernouilli ||  |                                                         +4.290e-2 |      6.8% |                                                                +353.31% |      4.4% |
    |        imaginary/digits-of-e1 ||  |                                                         +2.661e-2 |      4.5% |                                                                +336.63% |      2.8% |
    |        imaginary/digits-of-e2 ||  |                                                            +0.108 |     10.8% |                                                                +161.51% |      0.9% |
    |              imaginary/exp3_8 ||  |                                                            +0.456 |      4.1% |                                                                 +82.28% |      2.3% |
    |         imaginary/gen_regexps ||  |                                                            +0.120 |      7.4% |                                                                 +16.07% |      3.4% |
    |           imaginary/integrate ||  |                                                         +4.555e-2 |      3.4% |                                                                +326.50% |      6.7% |
    |               imaginary/kahan ||  |                                                         +1.909e-3 |     76.3% |                                                                 -76.48% |      8.9% |
    |           imaginary/paraffins ||  |                                                            +2.675 |      2.2% |                                                                 -35.97% |      0.4% |
    |              imaginary/primes ||  |                                                            +0.185 |      3.2% |                                                                +199.01% |      3.3% |
    |              imaginary/queens ||  |                                                         +8.858e-3 |      2.8% |                                                                +430.62% |      5.0% |
    |                imaginary/rfib ||  |                                                         +2.812e-4 |      2.1% |                                                                 +72.83% |      6.0% |
    |                 imaginary/tak ||  |                                                         +2.430e-4 |      0.8% |                                                                 +89.63% |      7.2% |
    |        imaginary/wheel-sieve1 ||  |                                                         +5.403e-2 |      6.2% |                                                                 -13.46% |      1.1% |
    |        imaginary/wheel-sieve2 ||  |                                                            +0.900 |      2.2% |                                                                  +4.37% |      3.3% |
    |                imaginary/x2n1 ||  |                                                         +4.950e-3 |     28.3% |                                                                +298.19% |      2.4% |
    |         parallel/blackscholes ||  |                                                         +1.074e-2 |      3.5% |                                                                +132.22% |     11.9% |
    |                parallel/coins ||  |                                                            +0.322 |      3.0% |                                                                 +10.08% |      1.2% |
    |                 parallel/gray ||  |                                                            +0.341 |      4.2% |                                                                 -60.77% |      3.6% |
    |               parallel/mandel ||  |                                                            +0.179 |     28.1% |                                                                  -2.20% |      8.7% |
    |              parallel/matmult ||  |                                                         +9.254e-2 |      8.5% |                                                                 -68.73% |      7.6% |
    |              parallel/minimax ||  |                                                            +0.366 |      2.1% |                                                                 +25.08% |      2.3% |
    |                parallel/nbody ||  |                                                         +1.832e-4 |      7.8% |                                                                  -0.33% |      2.1% |
    |               parallel/parfib ||  |                                                         +5.724e-3 |     24.2% |                                                                +118.45% |     28.7% |
    |              parallel/partree ||  |                                                            +0.931 |      1.2% |                                                                 -50.58% |      2.3% |
    |                 parallel/prsa ||  |                                                            +0.132 |      1.1% |                                                                 -46.93% |      7.5% |
    |               parallel/queens ||  |                                                         +3.295e-2 |     19.0% |                                                                 -13.46% |      9.5% |
    |                  parallel/ray ||  |                                                            +0.216 |      7.0% |                                                                 +20.62% |      6.3% |
    |             parallel/sumeuler ||  |                                                         +1.142e-3 |     19.1% |                                                                 -45.51% |      2.7% |
    |            parallel/transclos ||  |                                                            +0.309 |      7.6% |                                                                 -58.78% |      4.8% |
    |                     real/anna ||  |                                                            +0.209 |      7.7% |                                                                +101.19% |      1.3% |
    |             real/ben-raytrace ||  |                                                            +0.556 |      6.8% |                                                                 -37.67% |      5.6% |
    |                     real/bspt ||  |                                                         +4.263e-2 |      2.0% |                                                                +452.78% |      4.8% |
    |                real/cacheprof ||  |                                                            +0.540 |      6.2% |                                                                 -12.99% |      2.5% |
    |                 real/compress ||  |                                                            +0.304 |      3.7% |                                                                 +66.68% |      3.5% |
    |                real/compress2 ||  |                                                            +0.243 |      5.8% |                                                                +135.67% |      1.8% |
    |                   real/eff/CS ||  |                                                         +9.294e-3 |      6.9% |                                                                 +21.77% |      9.2% |
    |                  real/eff/CSD ||  |                                                         +6.896e-2 |      3.2% |                                                                 +34.11% |      5.9% |
    |                   real/eff/FS ||  |                                                         +9.892e-2 |     16.8% |                                                                 -16.39% |      4.5% |
    |                    real/eff/S ||  |                                                            +1.363 |      7.2% |                                                                 -40.93% |      0.6% |
    |                   real/eff/VS ||  |                                                            +0.193 |     13.0% |                                                                 -46.61% |      2.7% |
    |                  real/eff/VSD ||  |                                                         +2.886e-4 |     14.8% |                                                                 -29.87% |     18.0% |
    |                  real/eff/VSM ||  |                                                         +4.256e-2 |      5.4% |                                                                 +49.60% |      5.0% |
    |                      real/fem ||  |                                                            +0.186 |      4.6% |                                                                +101.50% |      4.9% |
    |                    real/fluid ||  |                                                            +0.144 |      1.0% |                                                                +145.34% |      6.1% |
    |                   real/fulsom ||  |                                                            +0.124 |      6.7% |                                                                +119.43% |      2.8% |
    |                   real/gamteb ||  |                                                            +0.237 |      3.7% |                                                                 +97.87% |      4.8% |
    |                       real/gg ||  |                                                            +0.678 |      4.8% |                                                                 +34.54% |      2.2% |
    |                     real/grep ||  |                                                            +0.495 |     13.7% |                                                                 -25.53% |      1.3% |
    |                   real/hidden ||  |                                                            +0.112 |      5.2% |                                                                +107.44% |      2.2% |
    |                      real/hpg ||  |                                                            +0.312 |      3.0% |                                                                 +38.90% |      2.4% |
    |                    real/infer ||  |                                                            +0.662 |      3.8% |                                                                  +1.71% |      1.2% |
    |                     real/lift ||  |                                                            +0.130 |      3.3% |                                                                 +29.92% |      4.2% |
    |                   real/linear ||  |                                                            +0.325 |      5.2% |                                                                +148.48% |      3.3% |
    |                 real/maillist ||  |                                                            +0.163 |      3.7% |                                                                +156.36% |      1.2% |
    |                  real/mkhprog ||  |                                                         +3.872e-4 |     12.5% |                                                                +197.31% |     11.0% |
    |                   real/parser ||  |                                                            +0.314 |      6.4% |                                                                 +26.59% |      2.5% |
    |                      real/pic ||  |                                                            +0.203 |      4.8% |                                                                +157.82% |      2.0% |
    |                   real/prolog ||  |                                                            +0.227 |      6.0% |                                                                 +10.88% |      1.4% |
    |                  real/reptile ||  |                                                            +0.199 |      6.1% |                                                                 +26.16% |      1.8% |
    |                      real/rsa ||  |                                                         +4.384e-2 |      4.9% |                                                                 +59.28% |      4.1% |
    |                      real/scs ||  |                                                            +0.555 |      9.0% |                                                                 -41.00% |      1.6% |
    |                  real/smallpt ||  |                                                            +1.391 |      4.1% |                                                                +275.80% |      3.1% |
    |                   real/symalg ||  |                                                            +0.115 |      3.2% |                                                                 -43.62% |      2.5% |
    |                  real/veritas ||  |                                                            +0.949 |      9.4% |                                                                 -65.21% |      2.5% |
    |         shootout/binary-trees ||  |                                                            +0.227 |     12.9% |                                                                 +42.92% |      1.5% |
    |       shootout/fannkuch-redux ||  |                                                         +1.798e-4 |      2.1% |                                                                 +56.28% |     17.2% |
    |                shootout/fasta ||  |                                                         +1.335e-2 |      9.9% |                                                                +344.03% |      3.8% |
    |         shootout/k-nucleotide ||  |                                                         +2.483e-3 |     57.3% |                                                                 -35.97% |      5.7% |
    |               shootout/n-body ||  |                                                         +4.230e-4 |      9.3% |                                                                 +66.86% |      4.4% |
    |             shootout/pidigits ||  |                                                            +0.221 |     14.3% |                                                                 +68.67% |      1.6% |
    |   shootout/reverse-complement ||  |                                                         +2.158e-4 |     20.6% |                                                                 -20.20% |      8.1% |
    |        shootout/spectral-norm ||  |                                                         +1.916e-4 |      7.9% |                                                                  -5.74% |      1.9% |
    |               smp/callback001 ||  |                                                            +0.182 |      6.5% |                                                                 +28.67% |      7.1% |
    |               smp/callback002 ||  |                                                            +0.133 |      9.1% |                                                                +114.43% |      3.2% |
    |                      smp/chan ||  |                                                            +0.807 |     41.8% |                                                                 -39.06% |     32.2% |
    |                     smp/sieve ||  |                                                         +3.128e-2 |      5.3% |                                                                 +26.61% |      7.2% |
    |                smp/threads001 ||  |                                                            +0.383 |      1.4% |                                                                 +60.74% |      1.7% |
    |                smp/threads003 ||  |                                                         +1.821e-2 |      5.6% |                                                                  +9.56% |      4.5% |
    |                smp/threads006 ||  |                                                            +0.119 |      4.3% |                                                                  +7.20% |      4.3% |
    |                smp/threads007 ||  |                                                            +0.454 |      1.2% |                                                                 +80.94% |      2.1% |
    |                 spectral/ansi ||  |                                                            +0.339 |      4.6% |                                                                +163.50% |      5.4% |
    |                 spectral/atom ||  |                                                            +1.104 |      5.1% |                                                                 +26.56% |      1.1% |
    |               spectral/awards ||  |                                                            +0.104 |      7.1% |                                                                +101.59% |      2.6% |
    |               spectral/banner ||  |                                                            +0.137 |      3.7% |                                                                +113.69% |      5.6% |
    |                spectral/boyer ||  |                                                            +0.504 |     10.3% |                                                                 +61.18% |      3.2% |
    |               spectral/boyer2 ||  |                                                            +0.199 |      2.3% |                                                                 +84.35% |      1.5% |
    |             spectral/calendar ||  |                                                            +0.105 |      7.6% |                                                                +172.86% |      3.7% |
    |             spectral/cichelli ||  |                                                            +0.326 |     10.9% |                                                                 +16.07% |      1.2% |
    |              spectral/circsim ||  |                                                            +0.254 |      1.3% |                                                                +123.13% |      1.4% |
    |             spectral/clausify ||  |                                                            +0.157 |      6.7% |                                                                +160.57% |      2.4% |
    |          spectral/constraints ||  |                                                            +0.208 |     14.5% |                                                                 +87.34% |      4.3% |
    |         spectral/cryptarithm1 ||  |                                                         +9.335e-2 |      4.7% |                                                                +153.77% |      3.2% |
    |         spectral/cryptarithm2 ||  |                                                         +7.644e-2 |      6.6% |                                                                +162.61% |      8.5% |
    |                  spectral/cse ||  |                                                         +5.929e-2 |      2.4% |                                                                +258.60% |      3.8% |
    |               spectral/dom-lt ||  |                                                            +0.122 |      6.5% |                                                                +590.27% |      3.8% |
    |                spectral/eliza ||  |                                                         +7.181e-2 |     10.1% |                                                                +191.51% |      3.4% |
    |          spectral/exact-reals ||  |                                                         +3.206e-2 |      5.7% |                                                                +373.25% |      1.8% |
    |               spectral/expert ||  |                                                         +7.305e-2 |      1.4% |                                                                +203.56% |      5.1% |
    |                 spectral/fft2 ||  |                                                            +0.171 |      7.2% |                                                                 +68.07% |      1.3% |
    |             spectral/fibheaps ||  |                                                            +0.468 |      3.0% |                                                                 +47.79% |      2.8% |
    |                 spectral/fish ||  |                                                         +9.096e-2 |      6.8% |                                                                +234.91% |      2.9% |
    |                  spectral/gcd ||  |                                                            +0.129 |     10.1% |                                                                 +44.72% |      5.8% |
    | spectral/hartel/comp_lab_zift ||  |                                                            +0.302 |      4.0% |                                                                +114.96% |      6.4% |
    |         spectral/hartel/event ||  |                                                            +0.956 |      6.7% |                                                                 +36.97% |      2.8% |
    |           spectral/hartel/fft ||  |                                                            +0.309 |      6.3% |                                                                +118.68% |      1.7% |
    |        spectral/hartel/genfft ||  |                                                            +1.153 |     10.3% |                                                                 -28.76% |      1.7% |
    |           spectral/hartel/ida ||  |                                                            +0.237 |      3.1% |                                                                +160.76% |      4.1% |
    |     spectral/hartel/listcompr ||  |                                                         +8.459e-2 |      4.2% |                                                                +193.13% |      6.0% |
    |      spectral/hartel/listcopy ||  |                                                            +0.100 |      5.5% |                                                                +179.19% |      2.0% |
    |      spectral/hartel/nucleic2 ||  |                                                         +6.741e-2 |      6.1% |                                                                +174.21% |      1.8% |
    |       spectral/hartel/parstof ||  |                                                            +0.286 |      6.8% |                                                                 +69.75% |      4.1% |
    |         spectral/hartel/sched ||  |                                                            +0.108 |      5.2% |                                                                +158.76% |      1.9% |
    |         spectral/hartel/solid ||  |                                                            +0.180 |      5.5% |                                                                +152.32% |      2.5% |
    |     spectral/hartel/transform ||  |                                                            +0.217 |     11.6% |                                                                 +15.08% |      1.4% |
    |     spectral/hartel/typecheck ||  |                                                         +8.323e-2 |     10.5% |                                                                +147.61% |      4.2% |
    |          spectral/hartel/wang ||  |                                                            +0.550 |      2.1% |                                                                 +55.48% |      2.7% |
    |     spectral/hartel/wave4main ||  |                                                         +8.289e-2 |      2.7% |                                                                +249.14% |      0.9% |
    |              spectral/integer ||  |                                                         +4.177e-2 |      3.5% |                                                                +336.44% |      3.6% |
    |              spectral/knights ||  |                                                         +7.513e-2 |      9.2% |                                                                 +79.34% |      1.0% |
    |               spectral/lambda ||  |                                                            +0.414 |      9.3% |                                                                  -0.48% |      4.7% |
    |           spectral/last-piece ||  |                                                         +4.531e-2 |      5.8% |                                                                +306.91% |      3.8% |
    |                 spectral/lcss ||  |                                                            +0.580 |      4.2% |                                                                 +21.23% |      1.2% |
    |                 spectral/life ||  |                                                            +0.510 |      5.2% |                                                                 +36.52% |      2.8% |
    |               spectral/mandel ||  |                                                         +2.716e-2 |      6.1% |                                                                +367.94% |      6.8% |
    |              spectral/mandel2 ||  |                                                         +4.378e-2 |      6.0% |                                                                 -10.30% |      4.2% |
    |                 spectral/mate ||  |                                                            +0.189 |      7.7% |                                                                 +37.43% |      5.7% |
    |              spectral/minimax ||  |                                                         +4.533e-2 |     26.3% |                                                                +342.65% |      5.5% |
    |           spectral/multiplier ||  |                                                            +1.470 |      1.5% |                                                                  +3.89% |      2.2% |
    |                 spectral/para ||  |                                                            +0.591 |      9.1% |                                                                 -33.19% |      1.5% |
    |                spectral/power ||  |                                                            +0.280 |      4.0% |                                                                 +72.11% |      1.7% |
    |               spectral/pretty ||  |                                                         +2.096e-4 |     16.8% |                                                                 -11.16% |      8.1% |
    |            spectral/primetest ||  |                                                         +1.487e-2 |     10.8% |                                                                +250.86% |      3.6% |
    |               spectral/puzzle ||  |                                                            +0.245 |      9.3% |                                                                 +10.51% |      1.8% |
    |              spectral/rewrite ||  |                                                         +5.608e-2 |     32.5% |                                                                +137.22% |      7.2% |
    |                  spectral/scc ||  |                                                         +1.498e-4 |      5.8% |                                                                  +2.54% |      1.1% |
    |               spectral/simple ||  |                                                            +1.359 |      5.3% |                                                                 +49.60% |      1.1% |
    |              spectral/sorting ||  |                                                            +0.421 |      1.8% |                                                                 +28.87% |      6.4% |
    |               spectral/sphere ||  |                                                            +0.141 |     17.6% |                                                                 -12.82% |      9.6% |
    |             spectral/treejoin ||  |                                                            +1.113 |      3.2% |                                                                  -7.66% |      1.9% |
    +===============================++==+===================================================================+===========+=========================================================================+===========+
    |                     geom mean ||  |                                                           +52.51% |           |                                                                         |           |
    +-------------------------------++--+-------------------------------------------------------------------+-----------+-------------------------------------------------------------------------+-----------+
    
    
    # Elapsed (wall) time
    
    +-------------------------------++--+-------------------------------------------------------------------+-----------+-------------------------------------------------------------------------+-----------+
    |                               ||  | f220010ea975d654bb1dedbbf3c58973d61f842469ca5b032f91f73c25e8a46e/ | std. err. | a4dd114f3ec0743b4f6d1cf51642f0c0e65f62e5ba7214694e39e3ddb1ad42fa/ (rel) | std. err. |
    +===============================++==+===================================================================+===========+=========================================================================+===========+
    |                    gc/circsim ||  |                                                            +1.016 |      1.0% |                                                                  +7.08% |      0.9% |
    |                gc/constraints ||  |                                                            +0.738 |      0.6% |                                                                  -0.01% |      1.2% |
    |                   gc/fibheaps ||  |                                                            +1.400 |      6.9% |                                                                  -6.43% |      0.8% |
    |                     gc/fulsom ||  |                                                            +1.368 |      2.4% |                                                                 +31.14% |      1.0% |
    |                   gc/gc_bench ||  |                                                            +0.476 |      2.1% |                                                                  -6.74% |      2.1% |
    |                      gc/happy ||  |                                                            +1.152 |      3.0% |                                                                  -3.65% |      0.9% |
    |                       gc/hash ||  |                                                            +0.622 |      3.6% |                                                                 +66.86% |      3.6% |
    |                       gc/lcss ||  |                                                            +1.024 |      2.2% |                                                                  +4.68% |      0.6% |
    |                  gc/mutstore1 ||  |                                                            +1.492 |      6.6% |                                                                 +30.95% |      2.8% |
    |                  gc/mutstore2 ||  |                                                            +2.154 |     10.2% |                                                                 -12.26% |      4.3% |
    |                      gc/power ||  |                                                            +1.114 |      3.6% |                                                                 +18.67% |      1.2% |
    |                 gc/spellcheck ||  |                                                            +0.980 |      5.3% |                                                                  -1.44% |      1.0% |
    |          imaginary/bernouilli ||  |                                                            +1.042 |      2.8% |                                                                 +14.20% |      2.7% |
    |        imaginary/digits-of-e1 ||  |                                                            +0.734 |      0.5% |                                                                 +16.34% |      1.0% |
    |        imaginary/digits-of-e2 ||  |                                                            +0.996 |      6.7% |                                                                 +11.44% |      1.2% |
    |              imaginary/exp3_8 ||  |                                                            +2.128 |      3.1% |                                                                 +12.78% |      0.6% |
    |         imaginary/gen_regexps ||  |                                                            +1.034 |      1.0% |                                                                 +12.57% |      5.9% |
    |           imaginary/integrate ||  |                                                            +0.918 |      1.1% |                                                                 +21.12% |      5.2% |
    |               imaginary/kahan ||  |                                                            +1.194 |      3.0% |                                                                  +7.87% |      3.1% |
    |           imaginary/paraffins ||  |                                                            +3.442 |      1.9% |                                                                 -28.64% |      0.3% |
    |              imaginary/primes ||  |                                                            +1.484 |      0.7% |                                                                 +18.34% |      1.5% |
    |              imaginary/queens ||  |                                                            +1.364 |      0.9% |                                                                  -2.78% |      0.5% |
    |                imaginary/rfib ||  |                                                            +0.658 |      2.3% |                                                                 +33.42% |      3.5% |
    |                 imaginary/tak ||  |                                                            +0.846 |      1.7% |                                                                 +12.27% |      2.5% |
    |        imaginary/wheel-sieve1 ||  |                                                            +1.160 |      6.2% |                                                                  +0.52% |      1.3% |
    |        imaginary/wheel-sieve2 ||  |                                                            +1.876 |      1.3% |                                                                  +1.39% |      2.7% |
    |                imaginary/x2n1 ||  |                                                            +1.210 |      0.5% |                                                                  +7.10% |      0.6% |
    |         parallel/blackscholes ||  |                                                            +0.284 |      1.6% |                                                                  +7.00% |      1.2% |
    |                parallel/coins ||  |                                                            +0.500 |      2.3% |                                                                  +8.38% |      1.2% |
    |                 parallel/gray ||  |                                                            +0.866 |      2.3% |                                                                 -62.57% |      1.4% |
    |               parallel/mandel ||  |                                                            +1.110 |     20.6% |                                                                  -8.83% |      5.2% |
    |              parallel/matmult ||  |                                                            +0.969 |      3.9% |                                                                 -55.98% |      1.1% |
    |              parallel/minimax ||  |                                                            +1.234 |      0.8% |                                                                  +2.10% |      1.4% |
    |                parallel/nbody ||  |                                                            +0.136 |      1.6% |                                                                  +8.78% |      3.0% |
    |               parallel/parfib ||  |                                                            +0.618 |      2.1% |                                                                  -2.26% |      2.4% |
    |              parallel/partree ||  |                                                            +1.639 |      0.8% |                                                                 -59.46% |      2.0% |
    |                 parallel/prsa ||  |                                                            +0.735 |      0.3% |                                                                 -29.99% |      1.8% |
    |               parallel/queens ||  |                                                            +0.298 |      2.8% |                                                                  +2.69% |      3.0% |
    |                  parallel/ray ||  |                                                            +1.138 |      2.4% |                                                                 +10.36% |      3.0% |
    |             parallel/sumeuler ||  |                                                            +0.742 |      0.6% |                                                                 -11.61% |      6.0% |
    |            parallel/transclos ||  |                                                            +0.934 |      2.5% |                                                                 -21.19% |      1.2% |
    |                     real/anna ||  |                                                            +1.568 |      1.2% |                                                                 +11.22% |      0.6% |
    |             real/ben-raytrace ||  |                                                           +10.581 |      1.2% |                                                                 -54.82% |      3.7% |
    |                     real/bspt ||  |                                                            +1.350 |      0.8% |                                                                 +14.21% |      0.9% |
    |                real/cacheprof ||  |                                                            +1.362 |      3.0% |                                                                 -11.16% |      1.4% |
    |                 real/compress ||  |                                                            +1.108 |      1.7% |                                                                 +12.63% |      2.0% |
    |                real/compress2 ||  |                                                            +1.212 |      5.0% |                                                                 +14.02% |      1.0% |
    |                   real/eff/CS ||  |                                                            +0.164 |      2.2% |                                                                 -36.63% |      2.1% |
    |                  real/eff/CSD ||  |                                                            +0.991 |      1.7% |                                                                 -44.46% |      2.3% |
    |                   real/eff/FS ||  |                                                            +1.078 |      4.5% |                                                                 -56.77% |      1.6% |
    |                    real/eff/S ||  |                                                            +1.388 |      7.2% |                                                                 -39.04% |      0.7% |
    |                   real/eff/VS ||  |                                                            +0.653 |      3.5% |                                                                 -44.48% |      0.9% |
    |                  real/eff/VSD ||  |                                                         +2.045e-2 |      0.2% |                                                                 -39.93% |     14.7% |
    |                  real/eff/VSM ||  |                                                            +0.620 |      1.2% |                                                                 -48.05% |      2.0% |
    |                      real/fem ||  |                                                            +1.296 |      1.0% |                                                                  +8.49% |      4.5% |
    |                    real/fluid ||  |                                                            +0.956 |      0.8% |                                                                 +22.18% |      2.1% |
    |                   real/fulsom ||  |                                                            +0.700 |      2.0% |                                                                  +8.86% |      1.7% |
    |                   real/gamteb ||  |                                                            +1.654 |      0.8% |                                                                 +11.25% |      2.8% |
    |                       real/gg ||  |                                                            +1.622 |      2.6% |                                                                 +11.59% |      1.5% |
    |                     real/grep ||  |                                                            +1.690 |      6.3% |                                                                 -16.57% |      1.1% |
    |                   real/hidden ||  |                                                            +1.466 |      0.4% |                                                                  +1.22% |      1.8% |
    |                      real/hpg ||  |                                                            +1.192 |      0.7% |                                                                  +1.67% |      1.2% |
    |                    real/infer ||  |                                                            +1.644 |      3.7% |                                                                  -6.08% |      0.6% |
    |                     real/lift ||  |                                                            +1.182 |      1.0% |                                                                  -4.23% |      1.3% |
    |                   real/linear ||  |                                                            +2.092 |      3.4% |                                                                 +16.54% |      1.9% |
    |                 real/maillist ||  |                                                            +1.386 |      1.1% |                                                                 +15.44% |      0.7% |
    |                  real/mkhprog ||  |                                                         +1.034e-2 |      0.2% |                                                                  -0.03% |      0.2% |
    |                   real/parser ||  |                                                            +1.168 |      2.8% |                                                                  -4.46% |      1.3% |
    |                      real/pic ||  |                                                            +0.782 |      2.2% |                                                                 +35.53% |      1.3% |
    |                   real/prolog ||  |                                                            +1.382 |      3.8% |                                                                 -11.28% |      1.1% |
    |                  real/reptile ||  |                                                            +1.314 |      1.2% |                                                                 -12.94% |      0.9% |
    |                      real/rsa ||  |                                                            +1.336 |      0.7% |                                                                 -23.51% |      3.9% |
    |                      real/scs ||  |                                                            +2.864 |      3.5% |                                                                 -57.40% |      1.2% |
    |                  real/smallpt ||  |                                                           +65.354 |      0.9% |                                                                  +8.02% |      0.5% |
    |                   real/symalg ||  |                                                            +1.776 |      2.5% |                                                                 -39.86% |      1.4% |
    |                  real/veritas ||  |                                                            +3.552 |      2.9% |                                                                 -64.47% |      1.7% |
    |         shootout/binary-trees ||  |                                                            +0.758 |      8.2% |                                                                 +13.19% |      1.2% |
    |       shootout/fannkuch-redux ||  |                                                            +0.862 |      1.1% |                                                                 +16.47% |      3.3% |
    |                shootout/fasta ||  |                                                            +1.060 |      1.0% |                                                                  -1.69% |      0.2% |
    |         shootout/k-nucleotide ||  |                                                            +0.422 |      0.4% |                                                                  +1.44% |      1.7% |
    |               shootout/n-body ||  |                                                            +1.166 |      0.7% |                                                                  +7.19% |      2.4% |
    |             shootout/pidigits ||  |                                                            +1.856 |      3.6% |                                                                  -4.09% |      1.3% |
    |   shootout/reverse-complement ||  |                                                         +1.036e-2 |      0.5% |                                                                  -0.54% |      0.4% |
    |        shootout/spectral-norm ||  |                                                            +0.122 |      8.8% |                                                                 -17.91% |   6.5e-2% |
    |               smp/callback001 ||  |                                                            +0.602 |      4.8% |                                                                 +14.93% |      5.6% |
    |               smp/callback002 ||  |                                                            +0.982 |      6.0% |                                                                 +18.33% |      1.7% |
    |                      smp/chan ||  |                                                            +1.252 |     27.0% |                                                                 -25.07% |     15.7% |
    |                     smp/sieve ||  |                                                            +0.114 |      1.9% |                                                                  +3.48% |      4.4% |
    |                smp/threads001 ||  |                                                            +2.014 |      0.8% |                                                                  -0.59% |      1.7% |
    |                smp/threads003 ||  |                                                            +1.198 |      2.7% |                                                                 -10.35% |      0.7% |
    |                smp/threads006 ||  |                                                            +0.206 |      2.6% |                                                                  +3.92% |      2.5% |
    |                smp/threads007 ||  |                                                           +10.002 |      1.1% |                                                                  +8.10% |      1.3% |
    |                 spectral/ansi ||  |                                                            +1.622 |      0.7% |                                                                 +24.03% |      4.0% |
    |                 spectral/atom ||  |                                                            +2.174 |      3.0% |                                                                 +10.03% |      0.8% |
    |               spectral/awards ||  |                                                            +1.448 |      0.5% |                                                                  +3.03% |      1.5% |
    |               spectral/banner ||  |                                                            +1.432 |      0.8% |                                                                  +9.35% |      4.7% |
    |                spectral/boyer ||  |                                                            +1.718 |      6.2% |                                                                  +9.43% |      1.7% |
    |               spectral/boyer2 ||  |                                                            +1.242 |      0.6% |                                                                 +12.87% |      1.5% |
    |             spectral/calendar ||  |                                                            +1.412 |      1.6% |                                                                  +9.06% |      3.4% |
    |             spectral/cichelli ||  |                                                            +1.342 |      2.3% |                                                                  -1.34% |      1.2% |
    |              spectral/circsim ||  |                                                            +1.348 |      0.7% |                                                                 +25.95% |      0.8% |
    |             spectral/clausify ||  |                                                            +1.196 |      0.9% |                                                                 +19.22% |      1.3% |
    |          spectral/constraints ||  |                                                            +1.540 |      4.6% |                                                                  +7.92% |      3.0% |
    |         spectral/cryptarithm1 ||  |                                                            +1.342 |      1.1% |                                                                  +5.66% |      1.4% |
    |         spectral/cryptarithm2 ||  |                                                            +1.240 |      0.5% |                                                                 +10.97% |      2.4% |
    |                  spectral/cse ||  |                                                            +1.158 |      0.6% |                                                                 +10.88% |      0.8% |
    |               spectral/dom-lt ||  |                                                            +1.694 |      1.1% |                                                                 +42.37% |      1.0% |
    |                spectral/eliza ||  |                                                            +1.328 |      1.2% |                                                                  +7.07% |      1.3% |
    |          spectral/exact-reals ||  |                                                            +0.910 |      1.5% |                                                                 +12.74% |      0.9% |
    |               spectral/expert ||  |                                                            +1.158 |      0.6% |                                                                  +7.93% |      1.3% |
    |                 spectral/fft2 ||  |                                                            +1.412 |      3.4% |                                                                  -4.25% |      2.0% |
    |             spectral/fibheaps ||  |                                                            +1.798 |      1.0% |                                                                  +6.56% |      1.5% |
    |                 spectral/fish ||  |                                                            +1.708 |      0.5% |                                                                 +10.07% |      0.8% |
    |                  spectral/gcd ||  |                                                            +1.122 |      1.2% |                                                                  -0.53% |      1.8% |
    | spectral/hartel/comp_lab_zift ||  |                                                            +1.534 |      0.6% |                                                                 +24.24% |      4.4% |
    |         spectral/hartel/event ||  |                                                            +2.096 |      2.9% |                                                                 +11.44% |      1.5% |
    |           spectral/hartel/fft ||  |                                                            +0.820 |      4.4% |                                                                 +33.15% |      1.1% |
    |        spectral/hartel/genfft ||  |                                                            +2.822 |      4.3% |                                                                 -22.25% |      1.5% |
    |           spectral/hartel/ida ||  |                                                            +1.486 |      2.0% |                                                                 +19.37% |      1.5% |
    |     spectral/hartel/listcompr ||  |                                                            +1.304 |      1.0% |                                                                  +8.89% |      4.2% |
    |      spectral/hartel/listcopy ||  |                                                            +1.426 |      1.2% |                                                                  +5.18% |      0.5% |
    |      spectral/hartel/nucleic2 ||  |                                                            +0.952 |      0.6% |                                                                  +3.58% |      1.5% |
    |       spectral/hartel/parstof ||  |                                                            +1.192 |      5.5% |                                                                 +19.79% |      3.9% |
    |         spectral/hartel/sched ||  |                                                            +1.148 |      1.1% |                                                                 +10.62% |      1.0% |
    |         spectral/hartel/solid ||  |                                                            +1.296 |      0.6% |                                                                 +22.23% |      1.8% |
    |     spectral/hartel/transform ||  |                                                            +1.402 |      1.7% |                                                                  -7.27% |      1.1% |
    |     spectral/hartel/typecheck ||  |                                                            +1.374 |      3.4% |                                                                  +2.62% |      0.8% |
    |          spectral/hartel/wang ||  |                                                            +1.656 |      1.4% |                                                                 +16.18% |      2.6% |
    |     spectral/hartel/wave4main ||  |                                                            +0.912 |      1.0% |                                                                 +24.32% |      2.2% |
    |              spectral/integer ||  |                                                            +1.082 |      0.5% |                                                                 +11.45% |      1.6% |
    |              spectral/knights ||  |                                                            +1.958 |      3.0% |                                                                  -5.62% |      0.9% |
    |               spectral/lambda ||  |                                                            +1.516 |      4.6% |                                                                  -7.78% |      4.3% |
    |           spectral/last-piece ||  |                                                            +0.354 |      1.7% |                                                                 +34.96% |      1.8% |
    |                 spectral/lcss ||  |                                                            +2.088 |      2.2% |                                                                  -5.27% |      1.0% |
    |                 spectral/life ||  |                                                            +2.048 |      2.3% |                                                                  -4.01% |      2.4% |
    |               spectral/mandel ||  |                                                            +0.958 |      1.7% |                                                                  +0.84% |      1.3% |
    |              spectral/mandel2 ||  |                                                            +1.116 |      0.3% |                                                                  -5.73% |      0.3% |
    |                 spectral/mate ||  |                                                            +1.800 |      2.2% |                                                                  -4.45% |      3.9% |
    |              spectral/minimax ||  |                                                            +1.100 |      2.3% |                                                                 +13.27% |      1.0% |
    |           spectral/multiplier ||  |                                                            +2.394 |      1.3% |                                                                  -3.67% |      1.0% |
    |                 spectral/para ||  |                                                            +2.042 |      5.4% |                                                                 -26.83% |      0.9% |
    |                spectral/power ||  |                                                            +1.318 |      0.7% |                                                                  +3.04% |      0.8% |
    |               spectral/pretty ||  |                                                         +1.035e-2 |      0.6% |                                                                  -1.13% |      0.2% |
    |            spectral/primetest ||  |                                                            +1.022 |      6.3% |                                                                  +0.58% |      0.7% |
    |               spectral/puzzle ||  |                                                            +1.280 |      2.3% |                                                                  -4.06% |      1.1% |
    |              spectral/rewrite ||  |                                                            +0.930 |      5.5% |                                                                  -1.28% |      0.9% |
    |                  spectral/scc ||  |                                                         +1.024e-2 |      0.3% |                                                                  -0.23% |   8.0e-2% |
    |               spectral/simple ||  |                                                            +2.648 |      2.6% |                                                                 +17.45% |      0.8% |
    |              spectral/sorting ||  |                                                            +1.628 |      0.8% |                                                                  +2.95% |      4.7% |
    |               spectral/sphere ||  |                                                            +1.252 |     12.0% |                                                                 -32.10% |      2.6% |
    |             spectral/treejoin ||  |                                                            +1.998 |      1.9% |                                                                  -7.81% |      1.1% |
    +===============================++==+===================================================================+===========+=========================================================================+===========+
    |                     geom mean ||  |                                                            -2.66% |           |                                                                         |           |
    +-------------------------------++--+-------------------------------------------------------------------+-----------+-------------------------------------------------------------------------+-----------+
    
    
    # instructions
    
    ## no samples
    
    # LLC cache misses
    
    ## no samples
    
    # L1 cache misses
    
    ## no samples
    
    # perf cache-misses
    
    ## no samples
    
    # perf instructions
    
    +-------------------------------++--+-------------------------------------------------------------------+-----------+-------------------------------------------------------------------------+-----------+
    |                               ||  | f220010ea975d654bb1dedbbf3c58973d61f842469ca5b032f91f73c25e8a46e/ | std. err. | a4dd114f3ec0743b4f6d1cf51642f0c0e65f62e5ba7214694e39e3ddb1ad42fa/ (rel) | std. err. |
    +===============================++==+===================================================================+===========+=========================================================================+===========+
    |                    gc/circsim ||  |                                                          +7.231e9 |      0.1% |                                                                  -2.28% |   1.3e-2% |
    |                gc/constraints ||  |                                                          +6.739e9 |   5.6e-2% |                                                                  -0.19% |   5.3e-3% |
    |                   gc/fibheaps ||  |                                                          +8.906e9 |      2.9% |                                                                 -14.97% |   1.6e-2% |
    |                     gc/fulsom ||  |                                                         +1.252e10 |      0.8% |                                                                  +2.30% |   6.5e-2% |
    |                   gc/gc_bench ||  |                                                          +5.195e9 |      5.3% |                                                                  -8.50% |      3.6% |
    |                      gc/happy ||  |                                                         +1.017e10 |   7.5e-2% |                                                                  -2.22% |   1.3e-2% |
    |                       gc/hash ||  |                                                          +8.341e9 |      1.0% |                                                                  -7.74% |      0.3% |
    |                       gc/lcss ||  |                                                         +1.216e10 |      0.5% |                                                                  -1.03% |   4.8e-2% |
    |                  gc/mutstore1 ||  |                                                         +1.350e10 |      1.8% |                                                                 -14.47% |      0.4% |
    |                  gc/mutstore2 ||  |                                                         +1.340e10 |      5.7% |                                                                 -41.97% |      2.0% |
    |                      gc/power ||  |                                                         +1.345e10 |      0.9% |                                                                  -3.67% |   7.3e-2% |
    |                 gc/spellcheck ||  |                                                          +6.923e9 |      0.2% |                                                                  -2.32% |   7.1e-2% |
    |          imaginary/bernouilli ||  |                                                          +7.722e9 |      0.1% |                                                                  +0.36% |   5.1e-2% |
    |        imaginary/digits-of-e1 ||  |                                                          +5.790e9 |   7.1e-2% |                                                                  -0.30% |   2.5e-2% |
    |        imaginary/digits-of-e2 ||  |                                                          +6.350e9 |      0.1% |                                                                  -2.57% |   4.4e-2% |
    |              imaginary/exp3_8 ||  |                                                         +1.290e10 |      0.1% |                                                                  -8.71% |   5.9e-2% |
    |         imaginary/gen_regexps ||  |                                                          +9.418e9 |      0.3% |                                                                  -3.40% |   2.6e-2% |
    |           imaginary/integrate ||  |                                                          +5.736e9 |   3.5e-2% |                                                                  +0.24% |   7.7e-2% |
    |               imaginary/kahan ||  |                                                          +7.949e9 |      0.4% |                                                                  +0.96% |      0.4% |
    |           imaginary/paraffins ||  |                                                         +2.754e10 |      0.3% |                                                                 -26.33% |   8.6e-2% |
    |              imaginary/primes ||  |                                                          +9.667e9 |      0.3% |                                                                  -2.66% |      0.2% |
    |              imaginary/queens ||  |                                                         +1.023e10 |   2.2e-2% |                                                                  +0.06% |   2.0e-2% |
    |                imaginary/rfib ||  |                                                          +5.606e9 |      0.2% |                                                                  +3.49% |      0.5% |
    |                 imaginary/tak ||  |                                                          +6.399e9 |      0.2% |                                                                  +0.96% |      0.3% |
    |        imaginary/wheel-sieve1 ||  |                                                          +5.812e9 |   9.1e-2% |                                                                  -2.66% |   1.7e-2% |
    |        imaginary/wheel-sieve2 ||  |                                                         +1.258e10 |      0.7% |                                                                 -17.11% |   6.0e-2% |
    |                imaginary/x2n1 ||  |                                                          +7.167e9 |   3.7e-2% |                                                                  +0.05% |   1.7e-2% |
    |         parallel/blackscholes ||  |                                                          +7.934e9 |   4.3e-2% |                                                                  -0.04% |   4.5e-2% |
    |                parallel/coins ||  |                                                         +1.277e10 |      0.2% |                                                                  -2.21% |      0.1% |
    |                 parallel/gray ||  |                                                          +7.184e9 |      0.6% |                                                                  -8.02% |      0.3% |
    |               parallel/mandel ||  |                                                         +3.290e10 |      0.3% |                                                                  -1.94% |      0.1% |
    |              parallel/matmult ||  |                                                         +1.194e10 |      0.6% |                                                                  -1.92% |      0.4% |
    |              parallel/minimax ||  |                                                         +3.976e10 |   6.4e-2% |                                                                  +0.12% |      0.2% |
    |                parallel/nbody ||  |                                                          +7.956e8 |   1.2e-3% |                                                                  -0.02% |   1.1e-3% |
    |               parallel/parfib ||  |                                                         +2.795e10 |      1.9% |                                                                  +0.63% |      1.9% |
    |              parallel/partree ||  |                                                         +1.127e10 |      0.1% |                                                                  -4.93% |      0.2% |
    |                 parallel/prsa ||  |                                                         +2.068e10 |      0.2% |                                                                  -0.32% |      0.2% |
    |               parallel/queens ||  |                                                         +1.077e10 |      0.8% |                                                                  -1.77% |      0.1% |
    |                  parallel/ray ||  |                                                         +1.505e10 |      0.1% |                                                                  -1.93% |      0.1% |
    |             parallel/sumeuler ||  |                                                          +4.059e9 |      0.3% |                                                                  +0.06% |      0.4% |
    |            parallel/transclos ||  |                                                         +2.077e10 |      0.1% |                                                                  -1.68% |   9.9e-2% |
    |                     real/anna ||  |                                                          +6.836e9 |      0.8% |                                                                  -6.74% |      0.1% |
    |             real/ben-raytrace ||  |                                                         +1.218e11 |   5.6e-2% |                                                                  -0.38% |   9.5e-3% |
    |                     real/bspt ||  |                                                          +9.565e9 |   7.3e-2% |                                                                  +0.69% |   4.3e-2% |
    |                real/cacheprof ||  |                                                          +8.902e9 |      1.2% |                                                                 -17.05% |   5.4e-2% |
    |                 real/compress ||  |                                                          +7.873e9 |      0.5% |                                                                  -8.56% |   6.9e-2% |
    |                real/compress2 ||  |                                                          +6.896e9 |      0.4% |                                                                  -3.87% |   7.9e-2% |
    |                   real/eff/CS ||  |                                                          +8.073e8 |      0.2% |                                                                  -0.84% |      0.1% |
    |                  real/eff/CSD ||  |                                                          +3.958e9 |   8.3e-2% |                                                                  -1.01% |      0.1% |
    |                   real/eff/FS ||  |                                                          +3.090e9 |      0.9% |                                                                  -3.66% |      0.2% |
    |                    real/eff/S ||  |                                                          +9.183e9 |      3.2% |                                                                 -42.48% |   9.4e-2% |
    |                   real/eff/VS ||  |                                                          +2.762e9 |      2.4% |                                                                 -15.95% |   8.0e-2% |
    |                  real/eff/VSD ||  |                                                          +8.225e7 |   2.0e-2% |                                                                  -0.16% |   1.3e-2% |
    |                  real/eff/VSM ||  |                                                          +1.883e9 |      0.2% |                                                                  -1.55% |   8.5e-2% |
    |                      real/fem ||  |                                                          +7.815e9 |      0.3% |                                                                  -5.16% |   7.3e-2% |
    |                    real/fluid ||  |                                                          +4.995e9 |      0.1% |                                                                  -5.03% |      0.1% |
    |                   real/fulsom ||  |                                                          +3.753e9 |      0.6% |                                                                  -5.17% |   7.4e-2% |
    |                   real/gamteb ||  |                                                         +1.103e10 |      0.3% |                                                                  -4.35% |   6.0e-2% |
    |                       real/gg ||  |                                                         +1.350e10 |      0.6% |                                                                 -11.83% |   2.5e-2% |
    |                     real/grep ||  |                                                         +1.065e10 |      1.8% |                                                                 -11.67% |   4.9e-2% |
    |                   real/hidden ||  |                                                          +7.960e9 |      0.2% |                                                                  -2.36% |   4.3e-2% |
    |                      real/hpg ||  |                                                          +7.039e9 |      0.5% |                                                                  -9.80% |      0.2% |
    |                    real/infer ||  |                                                         +1.235e10 |      0.4% |                                                                 -12.34% |   6.3e-2% |
    |                     real/lift ||  |                                                          +5.190e9 |      0.1% |                                                                  -6.12% |   8.5e-2% |
    |                   real/linear ||  |                                                         +1.086e10 |      0.3% |                                                                  -4.45% |   8.1e-2% |
    |                 real/maillist ||  |                                                          +3.096e9 |      0.8% |                                                                  -2.47% |      0.2% |
    |                  real/mkhprog ||  |                                                          +2.551e7 |      0.3% |                                                                  +0.79% |      1.8% |
    |                   real/parser ||  |                                                          +7.267e9 |      0.7% |                                                                  -9.85% |   8.2e-2% |
    |                      real/pic ||  |                                                          +6.607e9 |      0.5% |                                                                  -1.14% |   5.8e-2% |
    |                   real/prolog ||  |                                                          +6.721e9 |      0.5% |                                                                  -7.39% |   7.5e-2% |
    |                  real/reptile ||  |                                                          +6.945e9 |      0.5% |                                                                  -6.00% |   6.7e-2% |
    |                      real/rsa ||  |                                                          +8.038e9 |   4.7e-2% |                                                                  -0.25% |   2.2e-2% |
    |                      real/scs ||  |                                                          +8.715e9 |      1.3% |                                                                 -11.69% |   3.5e-2% |
    |                  real/smallpt ||  |                                                         +3.016e11 |   6.6e-2% |                                                                  +0.00% |   3.2e-2% |
    |                   real/symalg ||  |                                                         +1.068e10 |   6.7e-2% |                                                                  -2.18% |   5.5e-3% |
    |                  real/veritas ||  |                                                          +7.927e9 |      2.5% |                                                                 -23.49% |      0.1% |
    |         shootout/binary-trees ||  |                                                         +1.248e10 |      0.5% |                                                                  -2.07% |   7.1e-2% |
    |       shootout/fannkuch-redux ||  |                                                         +2.075e10 |   4.3e-5% |                                                                  -0.00% |   4.0e-5% |
    |                shootout/fasta ||  |                                                          +2.912e9 |      0.1% |                                                                  +0.31% |      0.1% |
    |         shootout/k-nucleotide ||  |                                                          +4.696e9 |      0.1% |                                                                  -0.10% |   1.1e-3% |
    |               shootout/n-body ||  |                                                          +4.568e9 |      0.3% |                                                                  +0.41% |      0.3% |
    |             shootout/pidigits ||  |                                                          +9.222e9 |      0.6% |                                                                  -2.46% |   8.7e-2% |
    |   shootout/reverse-complement ||  |                                                      +2320877.200 |      0.2% |                                                                  -7.16% |      1.1% |
    |        shootout/spectral-norm ||  |                                                          +4.254e9 |   3.4e-4% |                                                                  -0.00% |   1.3e-4% |
    |               smp/callback001 ||  |                                                          +2.472e9 |      2.2% |                                                                 -10.92% |      1.5% |
    |               smp/callback002 ||  |                                                          +4.182e9 |      0.2% |                                                                  +1.20% |      0.2% |
    |                      smp/chan ||  |                                                          +9.811e9 |     22.1% |                                                                 -21.36% |     17.7% |
    |                     smp/sieve ||  |                                                          +2.881e9 |      2.4% |                                                                  -0.53% |      0.9% |
    |                smp/threads001 ||  |                                                          +8.223e9 |      0.2% |                                                                  -2.13% |   9.4e-2% |
    |                smp/threads003 ||  |                                                          +8.265e9 |   5.0e-2% |                                                                  -0.13% |   1.7e-2% |
    |                smp/threads006 ||  |                                                          +1.115e9 |      0.7% |                                                                  -4.41% |      0.4% |
    |                smp/threads007 ||  |                                                          +8.346e9 |      0.3% |                                                                  -2.93% |      0.2% |
    |                 spectral/ansi ||  |                                                          +9.364e9 |      0.6% |                                                                  -7.72% |      0.1% |
    |                 spectral/atom ||  |                                                         +1.708e10 |      1.4% |                                                                 -14.40% |      0.1% |
    |               spectral/awards ||  |                                                          +9.481e9 |      0.3% |                                                                  -1.54% |   8.6e-2% |
    |               spectral/banner ||  |                                                          +9.829e9 |      0.3% |                                                                  -2.02% |      0.1% |
    |                spectral/boyer ||  |                                                         +1.182e10 |      0.6% |                                                                  -7.04% |   9.6e-2% |
    |               spectral/boyer2 ||  |                                                         +1.056e10 |      0.2% |                                                                  -4.06% |   4.5e-2% |
    |             spectral/calendar ||  |                                                          +8.338e9 |      0.3% |                                                                  -1.47% |   5.5e-2% |
    |             spectral/cichelli ||  |                                                         +1.064e10 |      1.2% |                                                                  -7.15% |   7.1e-2% |
    |              spectral/circsim ||  |                                                          +9.451e9 |      0.1% |                                                                  -3.61% |   7.8e-2% |
    |             spectral/clausify ||  |                                                          +8.601e9 |      0.3% |                                                                  -0.87% |      0.1% |
    |          spectral/constraints ||  |                                                          +9.129e9 |      0.6% |                                                                  -3.54% |   9.1e-2% |
    |         spectral/cryptarithm1 ||  |                                                          +8.429e9 |   5.7e-2% |                                                                  -0.96% |   7.6e-2% |
    |         spectral/cryptarithm2 ||  |                                                          +7.955e9 |      0.1% |                                                                  -0.67% |      0.2% |
    |                  spectral/cse ||  |                                                          +6.775e9 |      0.1% |                                                                  +0.21% |   6.7e-2% |
    |               spectral/dom-lt ||  |                                                          +8.898e9 |      0.2% |                                                                  -0.40% |   4.2e-2% |
    |                spectral/eliza ||  |                                                          +9.000e9 |      0.2% |                                                                  -0.07% |   7.4e-2% |
    |          spectral/exact-reals ||  |                                                          +6.243e9 |   3.9e-2% |                                                                  -0.08% |   3.9e-2% |
    |               spectral/expert ||  |                                                          +5.914e9 |   8.6e-2% |                                                                  -1.93% |      0.1% |
    |                 spectral/fft2 ||  |                                                          +9.423e9 |      0.2% |                                                                  -3.01% |   3.3e-2% |
    |             spectral/fibheaps ||  |                                                         +1.150e10 |      0.4% |                                                                  -9.27% |   7.0e-2% |
    |                 spectral/fish ||  |                                                          +7.700e9 |      0.3% |                                                                  +0.32% |      0.1% |
    |                  spectral/gcd ||  |                                                          +7.329e9 |      0.6% |                                                                  -3.92% |   3.9e-2% |
    | spectral/hartel/comp_lab_zift ||  |                                                         +1.044e10 |      0.3% |                                                                  -4.03% |   8.6e-2% |
    |         spectral/hartel/event ||  |                                                         +1.553e10 |      1.4% |                                                                 -13.30% |   7.9e-2% |
    |           spectral/hartel/fft ||  |                                                          +6.731e9 |      0.8% |                                                                  -5.89% |   3.6e-2% |
    |        spectral/hartel/genfft ||  |                                                         +1.716e10 |      2.2% |                                                                 -17.75% |   2.2e-2% |
    |           spectral/hartel/ida ||  |                                                          +7.288e9 |      0.4% |                                                                  -5.24% |   7.3e-2% |
    |     spectral/hartel/listcompr ||  |                                                          +6.803e9 |      0.2% |                                                                  -1.51% |   8.1e-2% |
    |      spectral/hartel/listcopy ||  |                                                          +7.494e9 |   7.0e-2% |                                                                  -1.40% |   7.6e-2% |
    |      spectral/hartel/nucleic2 ||  |                                                          +4.896e9 |      0.2% |                                                                  -1.91% |   6.0e-2% |
    |       spectral/hartel/parstof ||  |                                                          +8.434e9 |      0.1% |                                                                  -5.85% |   4.6e-2% |
    |         spectral/hartel/sched ||  |                                                          +6.364e9 |      0.4% |                                                                  -2.99% |   8.9e-2% |
    |         spectral/hartel/solid ||  |                                                          +8.011e9 |      0.3% |                                                                  -2.94% |   7.5e-2% |
    |     spectral/hartel/transform ||  |                                                          +7.214e9 |      1.2% |                                                                  -7.60% |   2.1e-2% |
    |     spectral/hartel/typecheck ||  |                                                          +6.273e9 |      0.2% |                                                                  -1.07% |   5.3e-2% |
    |          spectral/hartel/wang ||  |                                                         +1.352e10 |      0.2% |                                                                  -8.04% |      0.1% |
    |     spectral/hartel/wave4main ||  |                                                          +7.206e9 |   6.4e-2% |                                                                  -1.12% |   3.0e-2% |
    |              spectral/integer ||  |                                                          +7.380e9 |   1.4e-2% |                                                                  +0.53% |   9.4e-2% |
    |              spectral/knights ||  |                                                         +1.479e10 |      0.1% |                                                                  -0.92% |   8.3e-3% |
    |               spectral/lambda ||  |                                                         +1.068e10 |      0.7% |                                                                  -8.82% |   9.5e-2% |
    |           spectral/last-piece ||  |                                                          +2.198e9 |      0.2% |                                                                  -1.76% |   9.9e-2% |
    |                 spectral/lcss ||  |                                                         +1.600e10 |      0.4% |                                                                  -5.05% |   3.0e-2% |
    |                 spectral/life ||  |                                                         +1.331e10 |      0.6% |                                                                  -7.49% |      0.1% |
    |               spectral/mandel ||  |                                                          +7.138e9 |   4.6e-2% |                                                                  -0.85% |   5.0e-2% |
    |              spectral/mandel2 ||  |                                                          +4.092e9 |   6.8e-2% |                                                                  -1.56% |   2.5e-2% |
    |                 spectral/mate ||  |                                                          +8.850e9 |   9.3e-2% |                                                                  -4.65% |   9.1e-2% |
    |              spectral/minimax ||  |                                                          +8.364e9 |      0.3% |                                                                  +0.31% |   8.3e-2% |
    |           spectral/multiplier ||  |                                                         +2.053e10 |   9.6e-2% |                                                                 -14.46% |   7.5e-2% |
    |                 spectral/para ||  |                                                          +9.624e9 |      1.4% |                                                                 -12.19% |   9.0e-2% |
    |                spectral/power ||  |                                                          +9.168e9 |      0.1% |                                                                  -2.29% |   3.7e-2% |
    |               spectral/pretty ||  |                                                      +2392491.600 |      0.4% |                                                                  -8.67% |      0.4% |
    |            spectral/primetest ||  |                                                          +8.416e9 |   3.6e-2% |                                                                  +0.02% |   2.5e-2% |
    |               spectral/puzzle ||  |                                                          +7.272e9 |      1.1% |                                                                  -9.05% |   9.1e-2% |
    |              spectral/rewrite ||  |                                                          +6.145e9 |      0.6% |                                                                  -0.48% |   5.6e-2% |
    |                  spectral/scc ||  |                                                      +2291648.200 |      0.4% |                                                                  -6.06% |      0.8% |
    |               spectral/simple ||  |                                                         +1.867e10 |      1.3% |                                                                 -17.15% |      0.5% |
    |              spectral/sorting ||  |                                                         +1.176e10 |      0.3% |                                                                  -8.08% |   5.6e-2% |
    |               spectral/sphere ||  |                                                          +5.823e9 |      0.8% |                                                                  -4.06% |      0.1% |
    |             spectral/treejoin ||  |                                                         +1.708e10 |      0.5% |                                                                 -14.50% |   3.8e-2% |
    +===============================++==+===================================================================+===========+=========================================================================+===========+
    |                     geom mean ||  |                                                            -5.30% |           |                                                                         |           |
    +-------------------------------++--+-------------------------------------------------------------------+-----------+-------------------------------------------------------------------------+-----------+
    
    
    # perf cycles
    
    +-------------------------------++--+-------------------------------------------------------------------+-----------+-------------------------------------------------------------------------+-----------+
    |                               ||  | f220010ea975d654bb1dedbbf3c58973d61f842469ca5b032f91f73c25e8a46e/ | std. err. | a4dd114f3ec0743b4f6d1cf51642f0c0e65f62e5ba7214694e39e3ddb1ad42fa/ (rel) | std. err. |
    +===============================++==+===================================================================+===========+=========================================================================+===========+
    |                    gc/circsim ||  |                                                          +6.727e9 |      0.3% |                                                                  +0.17% |      0.7% |
    |                gc/constraints ||  |                                                          +6.708e9 |      0.8% |                                                                  +1.86% |      0.5% |
    |                   gc/fibheaps ||  |                                                          +8.387e9 |      5.0% |                                                                 -19.44% |      0.5% |
    |                     gc/fulsom ||  |                                                         +1.295e10 |      1.5% |                                                                 +15.39% |      0.5% |
    |                   gc/gc_bench ||  |                                                          +3.732e9 |      5.9% |                                                                 -12.08% |      4.5% |
    |                      gc/happy ||  |                                                          +4.828e9 |      1.6% |                                                                  -7.32% |      0.5% |
    |                       gc/hash ||  |                                                         +1.017e10 |      2.2% |                                                                 -19.55% |      1.6% |
    |                       gc/lcss ||  |                                                         +1.050e10 |      1.3% |                                                                  +6.68% |      0.9% |
    |                  gc/mutstore1 ||  |                                                         +1.333e10 |      2.8% |                                                                 -11.53% |      8.9% |
    |                  gc/mutstore2 ||  |                                                         +1.691e10 |      6.7% |                                                                 -46.67% |      1.2% |
    |                      gc/power ||  |                                                         +1.146e10 |      2.7% |                                                                  -7.72% |      0.7% |
    |                 gc/spellcheck ||  |                                                          +4.458e9 |      2.4% |                                                                 +13.45% |      2.2% |
    |          imaginary/bernouilli ||  |                                                          +4.778e9 |      5.5% |                                                                 +35.31% |      2.7% |
    |        imaginary/digits-of-e1 ||  |                                                          +3.051e9 |      0.8% |                                                                 +28.11% |      1.3% |
    |        imaginary/digits-of-e2 ||  |                                                          +4.981e9 |      5.2% |                                                                 +10.68% |      1.3% |
    |              imaginary/exp3_8 ||  |                                                         +1.263e10 |      1.7% |                                                                 -11.85% |      1.4% |
    |         imaginary/gen_regexps ||  |                                                          +4.526e9 |      2.6% |                                                                  +4.09% |      0.7% |
    |           imaginary/integrate ||  |                                                          +5.167e9 |      2.5% |                                                                 +22.74% |      1.3% |
    |               imaginary/kahan ||  |                                                         +2.112e10 |      3.1% |                                                                  +9.46% |      3.9% |
    |           imaginary/paraffins ||  |                                                         +2.281e10 |      0.4% |                                                                 -45.21% |      2.0% |
    |              imaginary/primes ||  |                                                          +8.753e9 |      3.1% |                                                                  +2.51% |      1.4% |
    |              imaginary/queens ||  |                                                          +5.157e9 |      0.6% |                                                                  +4.51% |      0.7% |
    |                imaginary/rfib ||  |                                                          +8.659e9 |      2.7% |                                                                 +57.24% |      5.2% |
    |                 imaginary/tak ||  |                                                         +1.408e10 |      2.0% |                                                                 +15.75% |      2.9% |
    |        imaginary/wheel-sieve1 ||  |                                                          +4.195e9 |      0.6% |                                                                  +1.04% |      0.7% |
    |        imaginary/wheel-sieve2 ||  |                                                         +1.294e10 |      2.0% |                                                                 -22.50% |      1.0% |
    |                imaginary/x2n1 ||  |                                                          +4.854e9 |      1.1% |                                                                  +2.94% |      0.6% |
    |         parallel/blackscholes ||  |                                                          +6.420e9 |      1.2% |                                                                  +2.64% |      1.6% |
    |                parallel/coins ||  |                                                          +9.245e9 |      2.1% |                                                                 +14.11% |      1.2% |
    |                 parallel/gray ||  |                                                         +1.116e10 |      2.1% |                                                                 -55.28% |      2.1% |
    |               parallel/mandel ||  |                                                         +2.109e10 |     20.9% |                                                                 -14.40% |      2.0% |
    |              parallel/matmult ||  |                                                         +1.917e10 |      3.2% |                                                                 -48.09% |      1.1% |
    |              parallel/minimax ||  |                                                         +2.711e10 |      0.6% |                                                                  +4.09% |      1.1% |
    |                parallel/nbody ||  |                                                          +4.918e8 |      0.2% |                                                                  +0.99% |      0.5% |
    |               parallel/parfib ||  |                                                         +1.471e10 |      1.7% |                                                                  -1.64% |      2.4% |
    |              parallel/partree ||  |                                                         +2.768e10 |      4.8% |                                                                 -61.30% |      1.1% |
    |                 parallel/prsa ||  |                                                         +1.390e10 |      0.4% |                                                                 -22.81% |      1.6% |
    |               parallel/queens ||  |                                                          +6.658e9 |      1.7% |                                                                  +1.82% |      1.0% |
    |                  parallel/ray ||  |                                                         +2.191e10 |      2.2% |                                                                  +6.44% |      3.3% |
    |             parallel/sumeuler ||  |                                                         +1.517e10 |      0.5% |                                                                  -2.11% |      0.7% |
    |            parallel/transclos ||  |                                                         +1.988e10 |      2.9% |                                                                 -27.40% |      1.0% |
    |                     real/anna ||  |                                                          +7.747e9 |      3.0% |                                                                  +4.08% |      1.0% |
    |             real/ben-raytrace ||  |                                                         +1.448e11 |      1.7% |                                                                 -45.13% |      0.5% |
    |                     real/bspt ||  |                                                          +5.901e9 |      2.4% |                                                                 +40.69% |      1.2% |
    |                real/cacheprof ||  |                                                          +7.933e9 |      3.5% |                                                                 -19.94% |      1.6% |
    |                 real/compress ||  |                                                          +6.898e9 |      2.9% |                                                                  -5.73% |      2.5% |
    |                real/compress2 ||  |                                                          +7.785e9 |      1.8% |                                                                  +2.01% |      1.3% |
    |                   real/eff/CS ||  |                                                          +8.121e8 |      3.7% |                                                                 -32.51% |      4.8% |
    |                  real/eff/CSD ||  |                                                          +4.545e9 |      2.6% |                                                                 -27.08% |      3.3% |
    |                   real/eff/FS ||  |                                                          +6.043e9 |      9.7% |                                                                 -52.03% |      3.8% |
    |                    real/eff/S ||  |                                                          +8.692e9 |      7.6% |                                                                 -62.79% |      3.8% |
    |                   real/eff/VS ||  |                                                          +2.651e9 |      3.9% |                                                                 -41.82% |      3.1% |
    |                  real/eff/VSD ||  |                                                          +3.580e7 |      2.1% |                                                                  -7.59% |      0.7% |
    |                  real/eff/VSM ||  |                                                          +3.064e9 |      3.2% |                                                                 -31.49% |      1.8% |
    |                      real/fem ||  |                                                          +8.200e9 |      1.7% |                                                                  -7.62% |      1.6% |
    |                    real/fluid ||  |                                                          +5.300e9 |      1.0% |                                                                 +16.27% |      2.6% |
    |                   real/fulsom ||  |                                                          +4.364e9 |      5.4% |                                                                  -1.12% |      1.8% |
    |                   real/gamteb ||  |                                                          +9.516e9 |      4.1% |                                                                  -5.90% |      2.3% |
    |                       real/gg ||  |                                                         +1.150e10 |      2.5% |                                                                 -17.25% |      1.6% |
    |                     real/grep ||  |                                                          +9.524e9 |      5.1% |                                                                 -23.34% |      2.4% |
    |                   real/hidden ||  |                                                          +7.703e9 |      2.7% |                                                                  +1.65% |      1.3% |
    |                      real/hpg ||  |                                                          +7.338e9 |      1.4% |                                                                  -5.26% |      3.7% |
    |                    real/infer ||  |                                                          +9.775e9 |      1.8% |                                                                 -19.37% |      0.7% |
    |                     real/lift ||  |                                                          +5.940e9 |      3.1% |                                                                  -9.97% |      2.1% |
    |                   real/linear ||  |                                                         +1.242e10 |      2.8% |                                                                  +5.96% |      1.8% |
    |                 real/maillist ||  |                                                          +6.810e9 |      3.8% |                                                                 +11.11% |      1.5% |
    |                  real/mkhprog ||  |                                                          +2.293e7 |      6.7% |                                                                 +53.34% |     29.6% |
    |                   real/parser ||  |                                                          +7.260e9 |      6.0% |                                                                 -15.49% |      2.2% |
    |                      real/pic ||  |                                                          +6.674e9 |      3.8% |                                                                  +8.19% |      0.9% |
    |                   real/prolog ||  |                                                          +6.451e9 |      3.7% |                                                                  -8.35% |      1.3% |
    |                  real/reptile ||  |                                                          +7.234e9 |      1.9% |                                                                  -6.73% |      1.5% |
    |                      real/rsa ||  |                                                          +4.652e9 |      1.3% |                                                                  -9.65% |      1.4% |
    |                      real/scs ||  |                                                         +1.411e10 |      4.2% |                                                                 -53.95% |      1.2% |
    |                  real/smallpt ||  |                                                         +2.766e11 |      1.2% |                                                                 +13.40% |      0.7% |
    |                   real/symalg ||  |                                                          +6.032e9 |      2.3% |                                                                 -35.06% |      1.1% |
    |                  real/veritas ||  |                                                         +1.903e10 |      1.9% |                                                                 -64.64% |      2.6% |
    |         shootout/binary-trees ||  |                                                          +8.546e9 |      1.4% |                                                                  +8.40% |      2.4% |
    |       shootout/fannkuch-redux ||  |                                                         +1.080e10 |      0.6% |                                                                  +5.70% |      3.0% |
    |                shootout/fasta ||  |                                                          +4.239e9 |      2.9% |                                                                  +7.11% |      2.0% |
    |         shootout/k-nucleotide ||  |                                                          +3.733e9 |      1.5% |                                                                  +0.44% |      2.0% |
    |               shootout/n-body ||  |                                                         +2.242e10 |      1.0% |                                                                  +2.63% |      0.5% |
    |             shootout/pidigits ||  |                                                         +1.471e10 |      9.2% |                                                                 -19.38% |      1.6% |
    |   shootout/reverse-complement ||  |                                                      +3037247.600 |      3.5% |                                                                  -1.09% |      4.8% |
    |        shootout/spectral-norm ||  |                                                          +1.848e9 |      0.6% |                                                                  +0.47% |      0.5% |
    |               smp/callback001 ||  |                                                          +5.680e9 |      6.5% |                                                                 +41.72% |      8.9% |
    |               smp/callback002 ||  |                                                          +6.617e9 |      2.7% |                                                                 +50.46% |      1.6% |
    |                      smp/chan ||  |                                                          +8.185e9 |     24.1% |                                                                 -34.57% |     10.0% |
    |                     smp/sieve ||  |                                                          +2.441e9 |      1.6% |                                                                  +2.26% |      2.2% |
    |                smp/threads001 ||  |                                                         +1.861e10 |      2.2% |                                                                  -0.16% |      0.7% |
    |                smp/threads003 ||  |                                                         +2.031e10 |      0.3% |                                                                  -2.12% |      0.2% |
    |                smp/threads006 ||  |                                                          +2.590e9 |      5.0% |                                                                  -0.08% |      4.0% |
    |                smp/threads007 ||  |                                                         +2.125e10 |      0.8% |                                                                  +3.65% |      0.7% |
    |                 spectral/ansi ||  |                                                         +1.262e10 |      2.9% |                                                                 -14.00% |      2.9% |
    |                 spectral/atom ||  |                                                         +1.748e10 |      3.7% |                                                                 -23.60% |      0.4% |
    |               spectral/awards ||  |                                                          +6.880e9 |      2.7% |                                                                 +14.50% |      2.7% |
    |               spectral/banner ||  |                                                          +8.589e9 |      2.4% |                                                                  +0.81% |      3.6% |
    |                spectral/boyer ||  |                                                         +1.286e10 |      7.3% |                                                                  -7.98% |      2.4% |
    |               spectral/boyer2 ||  |                                                          +6.631e9 |      2.5% |                                                                  +2.27% |      1.4% |
    |             spectral/calendar ||  |                                                          +8.831e9 |      3.1% |                                                                  -0.12% |      1.1% |
    |             spectral/cichelli ||  |                                                          +7.592e9 |      5.1% |                                                                  -8.85% |      1.2% |
    |              spectral/circsim ||  |                                                          +8.822e9 |      1.1% |                                                                  +9.39% |      1.3% |
    |             spectral/clausify ||  |                                                          +7.098e9 |      3.5% |                                                                 +13.69% |      0.6% |
    |          spectral/constraints ||  |                                                          +9.868e9 |     13.6% |                                                                  -9.16% |      2.3% |
    |         spectral/cryptarithm1 ||  |                                                          +7.930e9 |      0.6% |                                                                  +4.88% |      2.2% |
    |         spectral/cryptarithm2 ||  |                                                          +6.201e9 |      1.7% |                                                                 +22.21% |      4.6% |
    |                  spectral/cse ||  |                                                          +5.529e9 |      2.3% |                                                                 +36.96% |      1.6% |
    |               spectral/dom-lt ||  |                                                          +8.920e9 |      3.9% |                                                                 +17.19% |      1.1% |
    |                spectral/eliza ||  |                                                          +6.312e9 |      4.2% |                                                                 +25.22% |      1.8% |
    |          spectral/exact-reals ||  |                                                          +3.863e9 |      0.8% |                                                                 +24.24% |      1.1% |
    |               spectral/expert ||  |                                                          +5.142e9 |      0.7% |                                                                 +16.75% |      2.7% |
    |                 spectral/fft2 ||  |                                                          +6.779e9 |      3.6% |                                                                  -6.22% |      0.8% |
    |             spectral/fibheaps ||  |                                                         +1.181e10 |      2.5% |                                                                  -9.49% |      2.2% |
    |                 spectral/fish ||  |                                                          +8.454e9 |      3.0% |                                                                 +34.89% |      1.6% |
    |                  spectral/gcd ||  |                                                          +5.439e9 |      2.8% |                                                                  +5.58% |      1.3% |
    | spectral/hartel/comp_lab_zift ||  |                                                         +1.064e10 |      2.4% |                                                                  +5.80% |      1.8% |
    |         spectral/hartel/event ||  |                                                         +1.522e10 |      4.8% |                                                                 -14.94% |      1.0% |
    |           spectral/hartel/fft ||  |                                                          +7.419e9 |      3.2% |                                                                  -9.50% |      1.0% |
    |        spectral/hartel/genfft ||  |                                                         +1.797e10 |      5.6% |                                                                 -35.46% |      0.8% |
    |           spectral/hartel/ida ||  |                                                          +8.607e9 |      2.5% |                                                                  +7.12% |      1.3% |
    |     spectral/hartel/listcompr ||  |                                                          +7.988e9 |      2.7% |                                                                  -1.93% |      1.7% |
    |      spectral/hartel/listcopy ||  |                                                          +8.841e9 |      3.0% |                                                                  +2.63% |      1.5% |
    |      spectral/hartel/nucleic2 ||  |                                                          +4.599e9 |      2.4% |                                                                 +12.23% |      1.4% |
    |       spectral/hartel/parstof ||  |                                                          +7.007e9 |      0.9% |                                                                  +4.17% |      1.1% |
    |         spectral/hartel/sched ||  |                                                          +5.932e9 |      2.8% |                                                                 +10.37% |      2.0% |
    |         spectral/hartel/solid ||  |                                                          +7.705e9 |      4.6% |                                                                 +10.98% |      2.0% |
    |     spectral/hartel/transform ||  |                                                          +7.115e9 |      3.6% |                                                                  -6.96% |      0.6% |
    |     spectral/hartel/typecheck ||  |                                                          +6.432e9 |      4.5% |                                                                 +13.35% |      1.5% |
    |          spectral/hartel/wang ||  |                                                         +1.276e10 |      3.0% |                                                                  -5.54% |      1.1% |
    |     spectral/hartel/wave4main ||  |                                                          +4.895e9 |      2.1% |                                                                 +14.79% |      1.1% |
    |              spectral/integer ||  |                                                          +5.460e9 |      1.4% |                                                                 +27.62% |      2.0% |
    |              spectral/knights ||  |                                                          +7.456e9 |      2.5% |                                                                  +0.15% |      0.8% |
    |               spectral/lambda ||  |                                                          +8.495e9 |      4.6% |                                                                 -17.66% |      2.4% |
    |           spectral/last-piece ||  |                                                          +2.052e9 |      3.5% |                                                                 +15.33% |      2.1% |
    |                 spectral/lcss ||  |                                                         +1.703e10 |      5.9% |                                                                 -19.16% |      1.4% |
    |                 spectral/life ||  |                                                         +1.437e10 |      5.1% |                                                                 -16.69% |      1.2% |
    |               spectral/mandel ||  |                                                          +4.010e9 |      1.6% |                                                                 +28.02% |      0.7% |
    |              spectral/mandel2 ||  |                                                          +5.691e9 |      1.2% |                                                                 -22.91% |      0.4% |
    |                 spectral/mate ||  |                                                         +1.025e10 |      7.8% |                                                                 -16.31% |      2.4% |
    |              spectral/minimax ||  |                                                          +5.289e9 |      9.9% |                                                                 +22.94% |      1.9% |
    |           spectral/multiplier ||  |                                                         +2.178e10 |      0.4% |                                                                 -30.58% |      0.4% |
    |                 spectral/para ||  |                                                         +1.682e10 |      9.6% |                                                                 -53.63% |      1.4% |
    |                spectral/power ||  |                                                         +1.111e10 |      2.8% |                                                                 -33.28% |      0.9% |
    |               spectral/pretty ||  |                                                      +3304910.400 |      6.4% |                                                                 -14.38% |      2.1% |
    |            spectral/primetest ||  |                                                          +3.756e9 |      1.3% |                                                                 +16.82% |      1.4% |
    |               spectral/puzzle ||  |                                                          +6.440e9 |      2.4% |                                                                 -14.90% |      2.7% |
    |              spectral/rewrite ||  |                                                          +4.998e9 |     14.1% |                                                                  -0.09% |      2.0% |
    |                  spectral/scc ||  |                                                      +2847002.000 |      1.2% |                                                                  -4.03% |      0.8% |
    |               spectral/simple ||  |                                                         +2.130e10 |      3.0% |                                                                 -32.50% |      1.0% |
    |              spectral/sorting ||  |                                                          +9.997e9 |      3.6% |                                                                 -14.57% |      1.9% |
    |               spectral/sphere ||  |                                                          +8.080e9 |     14.1% |                                                                 -44.73% |      4.0% |
    |             spectral/treejoin ||  |                                                         +1.541e10 |      2.4% |                                                                 -29.01% |      0.5% |
    +===============================++==+===================================================================+===========+=========================================================================+===========+
    |                     geom mean ||  |                                                            -7.52% |           |                                                                         |           |
    +-------------------------------++--+-------------------------------------------------------------------+-----------+-------------------------------------------------------------------------+-----------+
    
    • @duog, did you disable CPU frequency scaling and otherwise quiet down background tasks when taking these measurements? The changes in CPU times seem a tad unexpected. In particular, I wouldn't have thought that mutator time would change appreciably.

    • I didn't disable CPU frequency scaling, or try too hard to quiet down background tasks. I did use cset shield, giving 8 cores to the benchmarks (i.e. exclusive cpuset), which I thought would be good enough?

      Mutator -15% sure is surprising.

      There is a small problem with the patch, causing one of the condition variables to be signalled far too often which I'm fixing.

    • Reran here https://gitlab.haskell.org/-/snippets/1867

      similar (though worse a bit worse) results.

    0% Loading or .
    You are about to add 0 people to the discussion. Proceed with caution.
    Finish editing this message first!
    Please register or to comment