GitLab

Tweag conveniently provides me a build server. I would like to use it. It is naturally using NixOS, given Tweag's expertise in Nix. However, on a fresh checkout (fd7ea0fe), validation fails. I have attached the full testsuite log. Here is the summary:

==== STAGE 1 TESTS ==== 

Unexpected results from:
TEST="T2632"

SUMMARY for test run started at Sun May  3 17:14:48 2020 
0:00:00.228431 spent to go through
       2 total tests, which gave rise to
       6 test cases, of which
       4 were skipped

       0 had missing libraries
       1 expected passes
       0 expected failures

       0 caused framework failures
       0 caused framework warnings
       0 unexpected passes
       1 unexpected failures
       0 unexpected stat failures
       0 fragile tests

Unexpected failures:
   /tmp/ghctest-2xq8mmzf/test   spaces/T2632.run  T2632 [exit code non-0] (normal)

==== STAGE 2 TESTS ==== 

Unexpected results from:
TEST="T10508_api T10596 T10796a T10796b T13366 T13702 T14028 T17073 T5358 T5976 T6132 T8987 TH_exn1 TH_exn2 TH_finalizer TH_runIO break009 break011 break017 break024 dynCompileExpr ghcilink003 haddockHoogleTest haddockHtmlTest haddockHypsrcTest haddockLatexTest prog001 readFail032 readFail048"

SUMMARY for test run started at Sun May  3 17:06:14 2020 
0:08:32.887913 spent to go through
    7449 total tests, which gave rise to
   29132 test cases, of which
   19045 were skipped

      45 had missing libraries
    7723 expected passes
     170 expected failures

       0 caused framework failures
       0 caused framework warnings
       1 unexpected passes
      29 unexpected failures
       0 unexpected stat failures
      13 fragile tests

Unexpected passes:
   /tmp/ghctest-haatv1z5/test   spaces/quasiquotation/T14028.run  T14028 [unexpected] (dyn)

Unexpected failures:
   /tmp/ghctest-haatv1z5/test   spaces/ghci.debugger/scripts/break009.run               break009 [bad stdout] (ghci-ext)
   /tmp/ghctest-haatv1z5/test   spaces/ghci.debugger/scripts/break011.run               break011 [bad stdout] (ghci-ext)
   /tmp/ghctest-haatv1z5/test   spaces/ghci.debugger/scripts/break017.run               break017 [bad stdout] (ghci-ext)
   /tmp/ghctest-haatv1z5/test   spaces/ghci.debugger/scripts/break024.run               break024 [bad stdout] (ghci-ext)
   /tmp/ghctest-haatv1z5/test   spaces/ghc-api/dynCompileExpr/dynCompileExpr.run        dynCompileExpr [bad exit code (139)] (normal)
   /tmp/ghctest-haatv1z5/test   spaces/ghci/linking/ghcilink003.run                     ghcilink003 [bad exit code (2)] (normal)
   /tmp/ghctest-haatv1z5/test   spaces/haddock/haddock_testsuite/haddockHoogleTest.run  haddockHoogleTest [bad exit code (2)] (normal)
   /tmp/ghctest-haatv1z5/test   spaces/haddock/haddock_testsuite/haddockHtmlTest.run    haddockHtmlTest [bad exit code (2)] (normal)
   /tmp/ghctest-haatv1z5/test   spaces/haddock/haddock_testsuite/haddockHypsrcTest.run  haddockHypsrcTest [bad exit code (2)] (normal)
   /tmp/ghctest-haatv1z5/test   spaces/haddock/haddock_testsuite/haddockLatexTest.run   haddockLatexTest [bad exit code (2)] (normal)
   /tmp/ghctest-haatv1z5/test   spaces/ghci/prog001/prog001.run                         prog001 [bad stdout] (ghci-ext)
   /tmp/ghctest-haatv1z5/test   spaces/parser/should_fail/readFail032.run               readFail032 [stderr mismatch] (normal)
   /tmp/ghctest-haatv1z5/test   spaces/parser/should_fail/readFail048.run               readFail048 [stderr mismatch] (normal)
   /tmp/ghctest-haatv1z5/test   spaces/ghc-api/T10508_api.run                           T10508_api [bad exit code (139)] (normal)
   /tmp/ghctest-haatv1z5/test   spaces/th/T10596.run                                    T10596 [exit code non-0] (ext-interp)
   /tmp/ghctest-haatv1z5/test   spaces/th/T10796a.run                                   T10796a [exit code non-0] (ext-interp)
   /tmp/ghctest-haatv1z5/test   spaces/th/T10796b.run                                   T10796b [stderr mismatch] (ext-interp)
   /tmp/ghctest-haatv1z5/test   spaces/th/T13366.run                                    T13366 [exit code non-0] (ext-interp)
   /tmp/ghctest-haatv1z5/test   spaces/th/T13366.run                                    T13366 [exit code non-0] (normal)
   /tmp/ghctest-haatv1z5/test   spaces/dynlibs/T13702.run                               T13702 [bad stderr] (normal)
   /tmp/ghctest-haatv1z5/test   spaces/hpc/T17073.run                                   T17073 [bad stdout] (hpc)
   /tmp/ghctest-haatv1z5/test   spaces/th/T5358.run                                     T5358 [stderr mismatch] (ext-interp)
   /tmp/ghctest-haatv1z5/test   spaces/th/T5976.run                                     T5976 [stderr mismatch] (ext-interp)
   /tmp/ghctest-haatv1z5/test   spaces/runghc/T6132.run                                 T6132 [exit code non-0] (normal)
   /tmp/ghctest-haatv1z5/test   spaces/th/T8987.run                                     T8987 [stderr mismatch] (ext-interp)
   /tmp/ghctest-haatv1z5/test   spaces/th/TH_exn1.run                                   TH_exn1 [stderr mismatch] (ext-interp)
   /tmp/ghctest-haatv1z5/test   spaces/th/TH_exn2.run                                   TH_exn2 [stderr mismatch] (ext-interp)
   /tmp/ghctest-haatv1z5/test   spaces/th/TH_finalizer.run                              TH_finalizer [exit code non-0] (ext-interp)
   /tmp/ghctest-haatv1z5/test   spaces/th/TH_runIO.run                                  TH_runIO [stderr mismatch] (ext-interp)

Fragile test passes:
   /tmp/ghctest-haatv1z5/test   spaces/libraries/base/tests/CPUTime001.run          CPUTime001 [fragile] (normal)
   /tmp/ghctest-haatv1z5/test   spaces/concurrent/should_run/hs_try_putmvar003.run  hs_try_putmvar003 [fragile] (threaded1)
   /tmp/ghctest-haatv1z5/test   spaces/ghci/linking/T11531.run                      T11531 [fragile] (normal)
   /tmp/ghctest-haatv1z5/test   spaces/ghci/should_run/T3171.run                    T3171 [fragile] (normal)
   /tmp/ghctest-haatv1z5/test   spaces/concurrent/should_run/T5611.run              T5611 [fragile] (normal)
   /tmp/ghctest-haatv1z5/test   spaces/concurrent/should_run/T5611a.run             T5611a [fragile] (normal)

Fragile test failures:
   /tmp/ghctest-haatv1z5/test   spaces/concurrent/prog001/concprog001.run    concprog001 [fragile] (threaded2)
   /tmp/ghctest-haatv1z5/test   spaces/profiling/should_run/heapprof001.run  heapprof001 [fragile] (ghci-ext-prof)
   /tmp/ghctest-haatv1z5/test   spaces/profiling/should_run/heapprof001.run  heapprof001 [fragile] (prof)
   /tmp/ghctest-haatv1z5/test   spaces/runghc/T-signals-child.run            T-signals-child [fragile] (threaded1)
   /tmp/ghctest-haatv1z5/test   spaces/profiling/should_run/T15897.run       T15897 [fragile] (profasm)
   /tmp/ghctest-haatv1z5/test   spaces/profiling/should_run/T5559.run        T5559 [fragile] (ghci-ext-prof)
   /tmp/ghctest-haatv1z5/test   spaces/profiling/should_run/T5559.run        T5559 [fragile] (prof)

The problems seen here are ones of configuration. As the comments below point out (responding to a differently phrased initial bug report), I should use ghc.nix to set up my environment. However, given that I have forgotten to do this, it would seem that ./configure should flag problems.

I'm happy to help debug this, as I imagine it will take some work. But I don't even know where to begin or how many of the failures are to be expected.

testsuite.txt