- 26 Dec, 2018 1 commit
-
-
Sebastian Graf authored
Summary: We don't want the result in the repo as it's a sizeable binary file that doesn't compress well. Storing the output file in the repository becomes infeasible for large inputs. There are two possible remedies: 1. Generate the result files during `make boot` (Phab:D5426). We discovered some drawbacks (like missing dependency files to build `compress` during boot) to this approach which make it infeasible. 2. Shrink the output files, for example by hashing the string that we would normally output and compare that instead. This patch implements the second alternative. This somewhat distorts the runtime profile, so we might want to consider doing hashing within the benchmark runner in the future. Test Plan: make boot Reviewers: AndreasK, nomeata, O26 nofib, osa1 Reviewed By: AndreasK, osa1 Subscribers: osa1 Differential Revision: https://phabricator.haskell.org/D5469
-
- 22 Dec, 2018 1 commit
-
-
Fangyi Zhou authored
Summary: For links in subpackages as well. https://phabricator.haskell.org/D5257 Test Plan: Manually verify links Reviewers: mpickering, bgamari, O26 nofib, osa1 Reviewed By: osa1 GHC Trac Issues: #15733 Differential Revision: https://phabricator.haskell.org/D5260
-
- 21 Dec, 2018 1 commit
-
-
Sebastian Graf authored
Summary: `runstdtest` switched from `-S` to `-s` output a while ago. That broke parsing of maximum and average residency numbers. This commit makes sure that at least maximum residency is parsed correctly from `-s` output, while leaving the logic for `-S` output. Reviewers: simonmar, bgamari, simonpj, osa1, AndreasK, O26 nofib Reviewed By: bgamari GHC Trac Issues: #16003 Differential Revision: https://phabricator.haskell.org/D5418
-
- 22 Nov, 2018 2 commits
-
-
Sebastian Graf authored
Summary: When we don't remove the generated files, `make boot` won't regenerate them. That in turn leads to expected output failures after bumping `{FAST,NORM,SLOW}_OPTS`. Test Plan: make clean && make boot && make Reviewers: AndreasK, mpickering, osa1, alpmestan, O26 nofib Reviewed By: alpmestan Differential Revision: https://phabricator.haskell.org/D5365
-
Sebastian Graf authored
Summary: I'm not sure why, but after D4989 (maybe also before) some binary artifacts crept into the working tree. Reviewers: AndreasK, mpickering, osa1, alpmestan, O26 nofib Reviewed By: alpmestan Differential Revision: https://phabricator.haskell.org/D5366
-
- 20 Nov, 2018 1 commit
-
-
Sebastian Graf authored
Summary: The `make boot` phase of `real/compress` generates files that are cleaned up by `make clean` with `rm`. Doing `make clean` without a prior `make boot` leads to a failure. This just supplies `-f` to `rm` so that plain `make clean` no longer fails. Reviewers: O26 nofib Differential Revision: https://phabricator.haskell.org/D5359
-
- 14 Nov, 2018 1 commit
-
-
Andreas Klebinger authored
Runtime for nofib benchmarks was all over the place. This patch adjusts runtime for most benchmarks such that it falls into the 0.2-2s range. This means that: * A default run will take longer * Time spent will be better distributed among benchmarks. * More benchmarks have runtimes long enough to be used for runtime analysis. Some more changes were done which go hand in hand with changing runtimes. * Some benchmarks now create their input files during boot. * Moved input files for anna in their own directory. * Remove printing of output for some of the floating point heavy benchmarks. * Added a comment about desired runtimes to README. * Made grep actually benchmark something. * Throw cachgrind out of the default benchmarks. The nondeterministic behaviour has been an issue for a while and it doesn't seem like an essential benchmark. Test Plan: run nofib in modes slow/normal/fast Reviewers: O26 nofib, alpmestan Reviewed By: alpmestan Subscribers: sgraf, alpmestan Differential Revision: https://phabricator.haskell.org/D4989
-
- 27 Aug, 2018 1 commit
-
-
Andreas Klebinger authored
Summary: This removes a lot of noise from the nofib output. Test Plan: running nofib Reviewers: O26 nofib, alpmestan Reviewed By: alpmestan Subscribers: alpmestan Differential Revision: https://phabricator.haskell.org/D4952
-
- 22 Aug, 2018 1 commit
-
-
Sebastian Graf authored
Summary: The next step of the MonadFail Proposal broke nofib's lambda benchmark. This commit fixes that in an unintrusive way. Reviewers: O26 nofib, RyanGlScott, bgamari Reviewed By: RyanGlScott Subscribers: monoidal Differential Revision: https://phabricator.haskell.org/D5058
-
- 20 Jun, 2018 1 commit
-
-
Gabor Greif authored
-
- 16 Jun, 2018 5 commits
-
-
Andreas Klebinger authored
We set -O2 in NoFibHcOpts which is then applied to all benchmarks run. Adding -O2 in individual benchmarks is therefore redundant. It also leads to issues when testing performance flags via EXTRA_HC_OPTS. Individual Makefiles attach -O2 last. This means all flags set by -O2 could not be disabled with -fno-<flag> as they were reenabled by the later -O2 switch. Test Plan: Using Reviewers: bgamari, jmct, O26 nofib Differential Revision: https://phabricator.haskell.org/D4829
-
Matthew Pickering authored
Reviewers: michalt, bgamari, O26 nofib, goldfire Reviewed By: michalt, O26 nofib Differential Revision: https://phabricator.haskell.org/D4045
-
Douglas Wilson authored
Reviewers: O26 nofib, michalt Reviewed By: O26 nofib, michalt Subscribers: michalt Differential Revision: https://phabricator.haskell.org/D4391
-
Andreas Klebinger authored
These use putStrLn so clearly we are not producing binary data. This caused failures on windows. Reviewers: O26 nofib, bgamari Reviewed By: bgamari Subscribers: bgamari GHC Trac Issues: #14656 Differential Revision: https://phabricator.haskell.org/D4705
-
Andreas Klebinger authored
Summary: This makes it easier to run nofib using nix. Test Plan: Using it. Reviewers: O26 nofib, bgamari Reviewed By: bgamari Differential Revision: https://phabricator.haskell.org/D4756
-
- 04 May, 2018 1 commit
-
-
Simon Peyton Jones authored
-
- 08 Feb, 2018 1 commit
-
-
Andreas Klebinger authored
Summary: My msys instance at least reports MINGW instead of MSYS for uname. This commit adjusts the regex to match either one. Without this some errors occur because of missing .exe extensions in file names. This fixes #14654 Test Plan: make Reviewers: O26 nofib, Phyx, bgamari Reviewed By: Phyx, bgamari Subscribers: bgamari, Phyx GHC Trac Issues: #14654 Differential Revision: https://phabricator.haskell.org/D4297
-
- 17 Jan, 2018 1 commit
-
-
Ömer Sinan Ağacan authored
Reviewers: O26 nofib Differential Revision: https://phabricator.haskell.org/D4320
-
- 28 Dec, 2017 1 commit
-
-
Gabor Greif authored
-
- 23 Oct, 2017 2 commits
-
-
Joachim Breitner authored
-
Joachim Breitner authored
-
- 22 Oct, 2017 2 commits
-
-
Joachim Breitner authored
-
Joachim Breitner authored
if I read http://gcc.gnu.org/onlinedocs/gcc/Inline.html correctly. Also, clean generated files.
-
- 14 Sep, 2017 1 commit
-
-
Joachim Breitner authored
so that it builds with GHC-8.3 post 8ae263c.
-
- 23 Aug, 2017 1 commit
-
-
Gabor Greif authored
-
- 22 Aug, 2017 3 commits
-
-
Simon Peyton Jones authored
-
Simon Peyton Jones authored
-
Simon Peyton Jones authored
-
- 15 Aug, 2017 4 commits
-
-
Ben Gamari authored
See https://phabricator.haskell.org/D3030#98590. The current master uses the diff alias for comparison, which pollutes stdout. I fixed the tr -d '\r' calls that previously were in place, but broken due to escaping. I also did the same for golden master generation in shootout Makefiles. Test Plan: ``` make clean && \ make NoFibRuns=1 2>&1 > nofib.log && \ nofib-analyse/nofib-analyse nofib.log ``` Differential Revision: https://phabricator.haskell.org/D3450
-
Ben Gamari authored
Summary: It's not required by the POSIX specification and OS X doesn't support it; instead use uname -s. Test Plan: V Reviewers: O26 nofib, michalt, mpickering Reviewed By: O26 nofib, michalt, mpickering Subscribers: mpickering GHC Trac Issues: #13711 Differential Revision: https://phabricator.haskell.org/D3594
-
Matthew Pickering authored
Summary: They are originally from https://github.com/AndrasKovacs/misc-stuff/blob/master/haskell/Eff/EffBench.hs They show interesting interactions with call arity, spec constr and SAT. Reviewers: O26 nofib, michalt, simonpj, bgamari Reviewed By: bgamari Subscribers: RyanGlScott GHC Trac Issues: #13892 Differential Revision: https://phabricator.haskell.org/D3683
-
Ben Gamari authored
Reviewers: O26 nofib, michalt Reviewed By: O26 nofib, michalt Subscribers: michalt Differential Revision: https://phabricator.haskell.org/D3730
-
- 07 Jun, 2017 2 commits
-
-
Michal Terepeta authored
Summary: By following the naming conventions of the build system we can simplify the `Makefile`s a bit. This patch also avoids having to explicitly pass the flags to `runstdtest` for `fasta`, `k-nucleotide` and `reverse-complement`. The only consquence of this is that it's a requirement to run `make boot` before `make` for these benchmarks. But that is already the case since `.depend` files are generated by with `make boot`. Finally, this also update the `.gitignore` with the new names of the output/input files. Signed-off-by:
Michal Terepeta <michal.terepeta@gmail.com> Test Plan: build & run Reviewers: bgamari Reviewed By: bgamari Differential Revision: https://phabricator.haskell.org/D3412
-
Ben Gamari authored
-
- 04 May, 2017 4 commits
-
-
Michal Terepeta authored
Summary: This creates `runtime_files` subdirectory for benchmarks that need some files at runtime. This make it clear what files are actually needed to run the benchmarks and makes it much easier to support building/running them out of separate build directory. This affects the following benchmarks: - real/anna - real/cacheprof - real/fluid - real/hidden - real/maillist - real/prolog - real/scs - spectral/expert - spectral/mate - spectral/para - spectral/treejoin Signed-off-by:
Michal Terepeta <michal.terepeta@gmail.com> Test Plan: build & run Reviewers: bgamari Reviewed By: bgamari Subscribers: snowleopard Differential Revision: https://phabricator.haskell.org/D3411
-
Michal Terepeta authored
I've mistakenly added it as a workaround to build problems, but the whole problem was only due a missing `.depend` file (which is created by `make boot` and interestigly is not cleaned by `make clean`). In any way, the `HS_SRCS` is simply unnecessary and can be removed. Signed-off-by:
Michal Terepeta <michal.terepeta@gmail.com> Test Plan: build & run Reviewers: bgamari Reviewed By: bgamari Differential Revision: https://phabricator.haskell.org/D3389
-
Michal Terepeta authored
By simply renaming the expected output files to follow the usual conventions, we can simplify the `Makefile` a bit. Signed-off-by:
Michal Terepeta <michal.terepeta@gmail.com> Test Plan: build & run Reviewers: bgamari Reviewed By: bgamari Differential Revision: https://phabricator.haskell.org/D3366
-
Michal Terepeta authored
The benchmark only needed a small update to the expected stdandard output file (missing newline). Signed-off-by:
Michal Terepeta <michal.terepeta@gmail.com> Test Plan: build & run Reviewers: dfeuer, bgamari Reviewed By: dfeuer Differential Revision: https://phabricator.haskell.org/D3363
-
- 15 Mar, 2017 2 commits
-
-
Michal Terepeta authored
Summary: This removes the unnecessary `OTHER_SUBDIRS` variable, since the subdirectories mentioned there are already in `SUBDIRS` (the benchmarks have been enabled in previous commits). Signed-off-by:
Michal Terepeta <michal.terepeta@gmail.com> Test Plan: build & run Reviewers: bgamari, dfeuer Reviewed By: dfeuer Differential Revision: https://phabricator.haskell.org/D3342
-
Michal Terepeta authored
Summary: Because it's at the beginning of the line with `SRC_HC_OPTS`, it causes `make` ignore those options. This commit removes that character and makes everything work. Signed-off-by:
Michal Terepeta <michal.terepeta@gmail.com> Test Plan: manually verify that the options are passed to GHC Reviewers: bgamari, dfeuer Reviewed By: dfeuer Subscribers: dfeuer Differential Revision: https://phabricator.haskell.org/D3344
-