Compare revisions

Sylvain Henry · Simon Jakobi · Ben Gamari · Andreas Klebinger · Ben Gamari · Ben Gamari
--- a/.gitignore
+++ b/.gitignore
@@ -10,6 +10,11 @@ perf.data
 perf.data.*
 dist-newstyle/
 .ghc.environment.*
+_make
+tags
+# Common for hackaged head workarounds
+cabal.project.local
 # Specific generated files
 nofib-analyse/nofib-analyse

--- a/.gitlab-ci.yml
+++ b/.gitlab-ci.yml
+# Commit taken from https://gitlab.haskell.org/ghc/ci-images
 variables:
-  DOCKER_REV: 2b69e99de97bd5bf1fbdbf45852231c3dcb602b6
+  DOCKER_REV: f2d12519f45a13a61fcca03a949f927ceead6492
-validate:
+  # Always start with a fresh clone to avoid non-hermetic builds
-  image: "registry.gitlab.haskell.org/ghc/ci-images/x86_64-linux-deb9:$DOCKER_REV"
+  GIT_STRATEGY: clone
+.validate-hadrian:
+  image: "registry.gitlab.haskell.org/ghc/ci-images/x86_64-linux-deb10:$DOCKER_REV"
  tags:
    - x86_64-linux
  before_script:
+    - sudo chown ghc:ghc -R .
    - git clean -xdf
-    - sudo apt install -y time
+    - $GHC --version
-    - ghc --version
    - cabal --version
  script:
-    - make clean
+    - git submodule update --init --recursive
+    - $GHC --version
    - cabal update
-    - make boot mode=fast
+    - cabal new-run -w $GHC nofib-run -- -o out -w "$GHC" $EXTRA_ARGS
-    - "make mode=fast NoFibRuns=1 2>&1 | tee log"
+    - mkdir -p results
-    - "nofib-analyse/nofib-analyse log"
+    - $GHC --info > results/compiler-info
-    - |
+    - cp _make/out/*.results.tsv results
-      # The following checks that `make distclean` removes any files reported
+  artifacts:
-      # by `git clean -fxd`
+    paths:
-      make distclean
+      - results
-      files=$(git clean -nxd | cut -d" " -f3 | sed "/log/d")
-      if ! [ -z $files ]
+validate-hadrian-normal:
-      then
+  extends:
-        echo "The following files weren't cleaned:\n$files"
+    - .validate-hadrian
-        exit 1
+  variables:
-      fi
+    EXTRA_ARGS: "--speed=Norm"
+validate-hadrian-fast:
+  extends:
+    - .validate-hadrian
+  variables:
+    EXTRA_ARGS: "--speed=Fast"
--- a/README.make.mkd
+++ b/README.make.mkd
+# NoFib: Legacy make build system
+This describes NoFib's legacy `make`-based build system. Note that you are
+strongly encouraged to use the newer Shake-based build system, described in
+[`shake/README.mkd`](shake/README.mkd).
+When nofib is being used to test a compiler built from source, the `nofib`
+directory should be the same level in the tree as `compiler` and `libraries`.
+This makes sure that NoFib picks up the stage 2 compiler from the surrounding
+GHC source tree.  However, you can also clone this repository in isolation, in
+which case it will pick `$(which ghc)` or whatever the `HC` environment
+variable is set to.
+There's also a `easy.sh` helper script, which as name implies, is automated and
+easy way to run `nofib`.  See the section at the end of this document for its
+usage.
+## Usage
+<details>
+  <summary>Git symlink support for Windows machines</summary>
+  NoFib uses a few symlinks here and there to share code between benchmarks.
+  Git for Windows has symlinks support for some time now, but
+  [it may not be enabled by default](https://stackoverflow.com/a/42137273/388010).
+  You will notice strange `make boot` failures if it's not enabled for you.
+  Make sure you follow the instructions in the link to enable symlink support,
+  possibly as simple as through `git config core.symlinks true` or cloning with
+  `git clone -c core.symlinks=true <URL>`.
+</details>
+Install [`cabal-install-2.4`](https://www.haskell.org/cabal/download.html) or later.
+Then, to run the tests, execute:
+```bash
+$ make clean # or git clean -fxd, it's faster
+$ # Generates input files for the benchmarks and builds compilation
+$ # dependencies for make (ghc -M)
+$ make boot
+$ # Builds the benchmarks and runs them $NoFibRuns (default: 5) times
+$ make
+```
+This will put the results in the file `nofib-log`. You can pass extra
+options to a nofib run using the `EXTRA_HC_OPTS` variable like this:
+```bash
+$ make clean
+$ make boot
+$ make EXTRA_HC_OPTS="-fllvm"
+```
+Likewise, you can pass additional arguments (e.g. RTS flags) to the command
+itself by using the `EXTRA_RUNTEST_OPTS` variable like this:
+    make EXTRA_RUNTEST_OPTS="-- +RTS -A2M -RTS"
+The `--` here ensures that `runtest` doesn't attempt to interpret any of the
+given flags as its own.
+**Note:** to get all the results, you have to `clean` and `boot` between
+separate `nofib` runs.
+To compare the results of multiple runs, save the output in a logfile
+and use the program in `./nofib-analyse/nofib-analyse`, for example:
+```bash
+...
+$ make 2>&1 | tee nofib-log-6.4.2
+...
+$ make 2>&1 | tee nofib-log-6.6
+$ nofib-analyse nofib-log-6.4.2 nofib-log-6.6 | less
+```
+to generate a comparison of the runs in captured in `nofib-log-6.4.2`
+and `nofib-log-6.6`. When making comparisons, be careful to ensure
+that the things that changed between the builds are only the things
+that you _wanted_ to change. There are lots of variables: machine,
+GHC version, GCC version, C libraries, static vs. dynamic GMP library,
+build options, run options, and probably lots more. To be on the safe
+side, make both runs on the same unloaded machine.
+## Modes
+Each benchmark is runnable in three different time `mode`s:
+- `fast`: 0.1-0.2s
+- `norm`: 1-2s
+- `slow`: 5-10s
+You can control which mode to run by setting an additional `mode` variable for
+`make`. The default is `mode=norm`. Example for `mode=fast`:
+```bash
+$ make clean
+$ make boot mode=fast
+$ make mode=fast
+```
+Note that the `mode`s set in `make boot` and `make` need to agree. Otherwise you
+will get output errors, because `make boot` will generate input files for a
+different `mode`. A more DRY way to control the `mode` would be
+```bash
+$ make clean
+$ export mode=fast
+$ make boot
+$ make
+```
+As CPU architectures advance, the above running times may drift and
+occasionally, all benchmarks will need adjustments.
+Be aware that `nofib-analyse` will ignore the result if it falls below 0.2s.
+This is the default of its `-i` option, which is of course incompatible with
+`mode=fast`. In that case, you should just set `-i` as appropriate, even
+deactivate it with `-i 0`.
+## Boot vs. benchmarked GHC
+The `nofib-analyse` utility is compiled with `BOOT_HC` compiler,
+which may be different then the GHC under the benchmark.
+You can control which GHC you benchmark with `HC` variable
+```bash
+$ make clean
+$ make boot HC=ghc-head
+$ make HC=ghc-head 2>&1 | tee nofib-log-ghc-head
+```
+## Configuration
+There are some options you might want to tweak; search for nofib in
+`../mk/config.mk`, and override settings in `../mk/build.mk` as usual.
+## Extra Metrics: Valgrind
+To get instruction counts, memory reads/writes, and "cache misses",
+you'll need to get hold of Cachegrind, which is part of
+[Valgrind](http://valgrind.org).
+You can then pass `-cachegrind` as `EXTRA_RUNTEST_OPTS`. Counting
+instructions slows down execution by a factor of ~30. But it's
+a deterministic metric, so you can combine it with `NoFibRuns=1`:
+```bash
+$ (make EXTRA_RUNTEST_OPTS="-cachegrind" NoFibRuns=1) 2>&1 | tee nofib-log
+```
+Optionally combine this with `mode=fast`, see [Modes](#modes).
+## Extra Packages
+Some benchmarks aren't run by default and require extra packages are
+installed for the GHC compiler being tested. These packages include:
+ * `old-time`: for `gc` benchmarks
+ * `stm`: for smp benchmarks
+ * `parallel`: for parallel benchmarks
+ * `random`: for various benchmarks
+These can be installed with
+```bash
+cabal v1-install --allow-newer -w $HC random parallel old-time
+```
+## easy.sh
+```
+./easy.sh - easy nofib
+Usage: ./easy.sh [ -m mode ] /path/to/baseline/ghc /path/to/new/ghc"
+GHC paths can point to the root of the GHC repository,
+if it's build with Hadrian.
+Available options:
+  -m MODE  nofib mode: fast norm slow
+This script caches the results using the sha256 of ghc executable.
+Remove these files, if you want to rerun the benchmark.
+```
--- a/README.md
+++ b/README.md
 # NoFib: Haskell Benchmark Suite
-This is the root directory of the "NoFib Haskell benchmark suite". It
+This is the root directory of the "NoFib Haskell benchmark suite".
-should be part of a GHC source tree, that is the 'nofib' directory
+There are currently two means of running the `nofib` benchmarks:
-should be at the same level in the tree as 'compiler' and 'libraries'.
-This makes sure that NoFib picks up the stage 2 compiler from the
-surrounding GHC source tree.
-You can also clone this repository in isolation, in which case it will
+ * [the `shake`-based build system](shake/README.mkd)
-pick `$(which ghc)` or whatever the `HC` environment variable is set to.
+ * [the legacy `make`-based build system](README.make.mkd)
-Additional information can also be found on
+Users are generally encouraged to use the former when possible. See the linked
-[NoFib's wiki page](https://ghc.haskell.org/trac/ghc/wiki/Building/RunningNoFib).
+READMEs for usage instructions.
-There's also a `easy.sh` helper script, which as name implies, is
-automated and easy way to run `nofib`.
-See the section at the end of README for its usage.
-## Using
-<details>
-  <summary>Git symlink support for Windows machines</summary>
-  NoFib uses a few symlinks here and there to share code between benchmarks.
-  Git for Windows has symlinks support for some time now, but
-  [it may not be enabled by default](https://stackoverflow.com/a/42137273/388010).
-  You will notice strange `make boot` failures if it's not enabled for you.
-  Make sure you follow the instructions in the link to enable symlink support,
-  possibly as simple as through `git config core.symlinks true` or cloning with
-  `git clone -c core.symlinks=true <URL>`.
-</details>
-Install [`cabal-install-2.4`](https://www.haskell.org/cabal/download.html) or later.
-Then, to run the tests, execute:
+Additional information can also be found on
+[NoFib's wiki page](https://gitlab.haskell.org/ghc/ghc/-/wikis/building/running-nofib).
-```
-$ make clean # or git clean -fxd, it's faster
-$ # Generates input files for the benchmarks and builds compilation
-$ # dependencies for make (ghc -M)
-$ make boot
-$ # Builds the benchmarks and runs them $NoFibRuns (default: 5) times
-$ make
-```
-This will put the results in the file `nofib-log`. You can pass extra
-options to a nofib run using the `EXTRA_HC_OPTS` variable like this:
-```
-$ make clean
-$ make boot
-$ make EXTRA_HC_OPTS="-fllvm"
-```
-**Note:** to get all the results, you have to `clean` and `boot` between
-separate `nofib` runs.
-To compare the results of multiple runs, save the output in a logfile
-and use the program in `./nofib-analyse/nofib-analyse`, for example:
-```
+## Adding benchmarks
-...
-$ make 2>&1 | tee nofib-log-6.4.2
-...
-$ make 2>&1 | tee nofib-log-6.6
-$ nofib-analyse nofib-log-6.4.2 nofib-log-6.6 | less
-```
-to generate a comparison of the runs in captured in `nofib-log-6.4.2`
+If you add a benchmark try to set the problem sizes for
-and `nofib-log-6.6`. When making comparisons, be careful to ensure
+fast/normal/slow reasonably. [Modes](#modes) lists the recommended brackets for
-that the things that changed between the builds are only the things
+each mode.
-that you _wanted_ to change. There are lots of variables: machine,
-GHC version, GCC version, C libraries, static vs. dynamic GMP library,
-build options, run options, and probably lots more. To be on the safe
-side, make both runs on the same unloaded machine.
-## Modes
+### Benchmark runtimes
-Each benchmark is runnable in three different time `mode`s:
+Benchmark should ideally support running in three different modes:
 - `fast`: 0.1-0.2s
 - `norm`: 1-2s
 - `slow`: 5-10s
-You can control which mode to run by setting an additional `mode` variable for
+You can look at existing benchmarks for how this is usually achieved.
-`make`. The default is `mode=norm`. Example for `mode=fast`:
-```
-$ make clean
-$ make boot mode=fast
-$ make mode=fast
-```
-Note that the `mode`s set in `make boot` and `make` need to agree. Otherwise you
-will get output errors, because `make boot` will generate input files for a
-different `mode`. A more DRY way to control the `mode` would be
-```
-$ make clean
-$ export mode=fast
-$ make boot
-$ make
-```
-As CPU architectures advance, the above running times may drift and
-occasionally, all benchmarks will need adjustments.
-Be aware that `nofib-analyse` will ignore the result if it falls below 0.2s.
-This is the default of its `-i` option, which is of course incompatible with
-`mode=fast`. In that case, you should just set `-i` as appropriate, even
-deactivate it with `-i 0`.
-## Boot vs. benchmarked GHC
-The `nofib-analyse` utility is compiled with `BOOT_HC` compiler,
-which may be different then the GHC under the benchmark.
-You can control which GHC you benchmark with `HC` variable
-```
-$ make clean
-$ make boot HC=ghc-head
-$ make HC=ghc-head 2>&1 | tee nofib-log-ghc-head
-```
-## Configuration
-There are some options you might want to tweak; search for nofib in
-`../mk/config.mk`, and override settings in `../mk/build.mk` as usual.
-## Extra Metrics: Valgrind
-To get instruction counts, memory reads/writes, and "cache misses",
-you'll need to get hold of Cachegrind, which is part of
-[Valgrind](http://valgrind.org).
-You can then pass `-cachegrind` as `EXTRA_RUNTEST_OPTS`. Counting
-instructions slows down execution by a factor of ~30. But it's
-a deterministic metric, so you can combine it with `NoFibRuns=1`:
-```
-$ (make EXTRA_RUNTEST_OPTS="-cachegrind" NoFibRuns=1) 2>&1 | tee nofib-log
-```
-Optionally combine this with `mode=fast`, see [Modes](#modes).
-## Extra Packages
-Some benchmarks aren't run by default and require extra packages are
-installed for the GHC compiler being tested. These packages include:
- * `old-time`: for `gc` benchmarks
- * `stm`: for smp benchmarks
- * `parallel`: for parallel benchmarks
- * `random`: for various benchmarks
-These can be installed with
-```
-cabal v1-install --allow-newer -w $HC random parallel old-time
-````
-## Adding benchmarks
-If you add a benchmark try to set the problem sizes for
-fast/normal/slow reasonably. [Modes](#modes) lists the recommended brackets for
-each mode.
 ### Benchmark Categories
 So you have a benchmark to submit but don't know in which subfolder to put it? Here's some
@@ -218,7 +79,7 @@ Gen 1 heaps just amplifies the problem.
 As a rule of thumb on how to ensure this: Make sure that your benchmark doesn't
 just build up one big data and consume it in a final step, but rather that the
 working set grows and shrinks (e.g. is approximately constant) over the whole
-run of the benchmark. You can ensure this by iterating your main logic `$n` 
+run of the benchmark. You can ensure this by iterating your main logic `$n`
 times (how often depends on your program, but in the ball park of 100-1000).
 You can test stability by plotting productivity curves for your `fast` settings
 with the `prod.py` script attached to #15999.
@@ -234,20 +95,3 @@ particular compiler runs. Recent GHC versions provide the `-fproc-alignment`
 flag to pad procedures, ensuring slightly better stability across runs. If you
 are seeing an unexpected change in performance try adding `-fproc-alignment=64`
 the compiler flags of both your baseline and test tree.
-## easy.sh
-```
-./easy.sh - easy nofib
-Usage: ./easy.sh [ -m mode ] /path/to/baseline/ghc /path/to/new/ghc"
-GHC paths can point to the root of the GHC repository,
-if it's build with Hadrian.
-Available options:
-  -m MODE  nofib mode: fast norm slow
-This script caches the results using the sha256 of ghc executable.
-Remove these files, if you want to rerun the benchmark.
-```
--- a/Simon-nofib-notes
+++ b/Simon-nofib-notes
@@ -423,6 +423,11 @@ sorting
 ~~~~~~~
 Same issue with GHC.IO.Encoding.UTF8 as treejoin
+life
+~~~~
+The call to zipWith3 in row is quite close to the inlining threshold.
+Makes a difference of about 2% last time it flipped.
 ---------------------------------------
 	Real suite

--- a/cabal.project
+++ b/cabal.project
+packages: shake
--- a/cabal.project.head-hackage
+++ b/cabal.project.head-hackage
+-- A cabal.project file to be used with hackage head.
+-- Use by running `cabal --project-file nofib.head <usual command>`
+packages: shake
+repository head.hackage.ghc.haskell.org
+   url: https://ghc.gitlab.haskell.org/head.hackage/
+   secure: True
+   key-threshold: 3
+   root-keys:
+       f76d08be13e9a61a377a85e2fb63f4c5435d40f8feb3e12eb05905edb8cdea89
+       26021a13b401500c8eb2761ca95c61f2d625bfef951b939a8124ed12ecf07329
+       7541f32a4ccca4f97aea3b22f5e593ba2c0267546016b992dfadcd2fe944e55d
--- a/common/NofibUtils.hs
+++ b/common/NofibUtils.hs
@@ -10,7 +10,31 @@ import System.Environment (getArgs)
 -- | A very simple hash function so that we don't have to store and compare
 -- huge output files.
 hash :: String -> Int
-hash = foldl' (\acc c -> ord c + acc*31) 0
+hash str = foldl' (\acc c -> ord c + acc*31) 0 str
+{-# INLINE hash #-}
+{-
+Note: Originally, `hash` was eta-reduced and not explicitly inlined, and as a
+result the `foldl'` call here was not saturated.  Thus the definition of `hash`
+was simple enough to inline into the call site, where the provided string
+allowed `foldl'` to inline into `foldr`, which then enabled fusion, avoiding
+potentially non-trivial allocation overhead.
+In !5259, we're reducing the arity of `foldl'`, so that it can inline with just
+two arguments.  This yields performance improvements in common idiomatic code,
+see !5259 for details.
+That reduced arity makes `foldl'` inline into even the eta-reduced `hash`,
+which then (for lack of an INLINE here) also inlined `foldr` and the fusion
+opportunity was lost.
+Quoting Simon, <https://gitlab.haskell.org/ghc/ghc/-/merge_requests/5259#note_341945>
+    * let's add that INLINE to hash in NofibUtils. We don't usually mess with
+      nofib, but we don't want to perpetuate reliance on a fluke.
+In addition, eta-expanding `hash`.  It will now saturate both the original
+and the post-!5259 `foldl'`.
+-}
 -- | Using @salt xs@ on an loop-invariant @xs@ inside a loop prevents the
 -- compiler from floating out the input parameter.
@@ -27,4 +51,4 @@ salt xs = do
  --            executable, otherwise this isn't really 'pure'
  --            anymore.
  pure (take (max (maxBound - 1) s) xs)
 #endif
\ No newline at end of file
--- a/gc/cacheprof/Main.hs
+++ b/gc/cacheprof/Main.hs
@@ -31,6 +31,7 @@
 module Main ( main ) where
 import Data.Char
+import Prelude hiding (null, length, or, foldr, maximum, concat, concatMap, foldl, foldr1, foldl1, sum, all, any, and, elem, notElem)
 import Data.List
 import System.IO
 import System.Environment

--- a/gc/cacheprof/cacheprof.stdin
+++ b/gc/cacheprof/cacheprof.stdin
--- a/gc/circsim/Main.lhs
+++ b/gc/circsim/Main.lhs
@@ -33,7 +33,9 @@ David J. King & John O'Donnell
 January, 1998
 > import System.Environment
+> import Control.Monad (forM_)
 > import Data.List
+> import Prelude hiding (length, or, foldr, maximum, concat, foldl)
 > data BinTree a b = Cell a
 >		   | Node b (BinTree a b) (BinTree a b)
@@ -656,8 +658,10 @@ To run (with ghc) for a (8 bit register) circuit over 1000 cycles
 % circ_sim 8 1000
 > main :: IO ()
-> main = getArgs >>= \[num_bits, num_cycles] ->
+> main = forM_ [1..97] $ const $ do
->	 print (run (read num_bits) (read num_cycles))
+>   (num_bits:num_cycles:_) <- getArgs
+>   -- We save ourselfs some trouble and don't produce output in the gc variant
+>   return $! (length . show $ (run (read num_bits) (read num_cycles))) `seq` ()
 > run :: Int -> Int -> [[Boolean]]

--- a/gc/circsim/Makefile
+++ b/gc/circsim/Makefile
@@ -2,9 +2,9 @@ TOP = ../..
 include $(TOP)/mk/boilerplate.mk
-FAST_OPTS = 8 100
+FAST_OPTS = 8   4
-NORM_OPTS = 8 3000
+NORM_OPTS = 8  40
-SLOW_OPTS = 8 5000
+SLOW_OPTS = 8 200
 ifeq "$(HEAP)" "LARGE"
 PROG_ARGS += +RTS -H256m -RTS

--- a/gc/circsim/circsim.faststdout
+++ b/gc/circsim/circsim.faststdout
-[[F,F,F,F,F,F,F,F],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T],[T,T,T,T,T,T,T,T]]
--- a/gc/circsim/circsim.slowstdout
+++ b/gc/circsim/circsim.slowstdout
--- a/gc/circsim/circsim.stdout
+++ b/gc/circsim/circsim.stdout
--- a/gc/constraints/Main.hs
+++ b/gc/constraints/Main.hs
@@ -3,20 +3,21 @@
 	See Proceedings of WAAAPL '99
 -}
-import Prelude hiding (Maybe(Just,Nothing))
 import Data.List
+import Prelude hiding (Maybe(Just,Nothing), null, length, or, foldr, maximum, concat, foldl, foldr1, foldl1, sum, all, elem, notElem)
 import System.Environment
+import Control.Monad (forM_)
 -----------------------------
 -- The main program
 -----------------------------
-main = do
+main = forM_ [1..240] $ const $ do
- [arg] <- getArgs
+  [arg] <- getArgs
- let
+  let
-	n = read arg :: Int
+    n = read arg :: Int
-   	try algorithm = print (length (search algorithm (queens n)))
+    try algorithm = print (length (search algorithm (queens n)))
- sequence_ (map try [bt, bm, bjbt, bjbt', fc])
+  sequence_ (map try [bt, bm, bjbt, bjbt', fc])
 -----------------------------
 -- Figure 1. CSPs in Haskell.

--- a/gc/constraints/Makefile
+++ b/gc/constraints/Makefile
 TOP = ../..
 include $(TOP)/mk/boilerplate.mk
-FAST_OPTS = 7
+FAST_OPTS = 6
-# NORM_OPTS should probably be 8 or 9
+NORM_OPTS = 7
-NORM_OPTS = 10
+SLOW_OPTS = 8
-SLOW_OPTS = 11
 ifeq "$(HEAP)" "LARGE"
 PROG_ARGS += +RTS -H330m -RTS

--- a/gc/constraints/constraints.faststdout
+++ b/gc/constraints/constraints.faststdout
-40
+4
-40
+4
-40
+4
-40
+4
-40
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
+4
--- a/gc/constraints/constraints.slowstdout
+++ b/gc/constraints/constraints.slowstdout
-2680
+92
-2680
+92
-2680
+92
-2680
+92
-2680
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
+92
--- a/gc/constraints/constraints.stdout
+++ b/gc/constraints/constraints.stdout
-724
+40
-724
+40
-724
+40
-724
+40
-724
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
+40
No results found