Lots of spurious failures in testsuite on Mac
In a fresh checkout of GHC (with some changes that should in no way affect the behavior of GHC), I observe the following failures on an M1 Mac:
Unexpected failures:
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/linters/changelogs.run changelogs [bad stdout] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/plugin-recomp-change.run plugin-recomp-change [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/plugin-recomp-change-2.run plugin-recomp-change-2 [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/plugin-recomp-flags.run plugin-recomp-flags [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/plugin-recomp-pure.run plugin-recomp-pure [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/plugins-ghci.run plugins-ghci [bad exit code (139)] (ghci)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/plugins01.run plugins01 [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/plugins08.run plugins08 [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/plugins09.run plugins09 [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/plugins11.run plugins11 [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/plugins12.run plugins12 [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/T10294.run T10294 [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/T10294a.run T10294a [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/ghci/linking/dyn/T10955dyn.run T10955dyn [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/rts/linker/T11223/T11223_link_order_a_b_2_fail.run T11223_link_order_a_b_2_fail [bad stderr] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/rts/linker/T11223/T11223_simple_duplicate_lib.run T11223_simple_duplicate_lib [bad stderr] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/typecheck/should_compile/T11462.run T11462 [exit code non-0] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/typecheck/should_compile/T11525.run T11525 [exit code non-0] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/T12567a.run T12567a [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/rts/T13676.run T13676 [bad stderr] (ghci)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/ghci/should_run/T15633a.run T15633a [bad exit code (139)] (ghci)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/ghci/should_run/T15633b.run T15633b [bad exit code (139)] (ghci)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/T16104.run T16104 [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/driver/T16167.run T16167 [bad stdout] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/T16260.run T16260 [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/T20417.run T20417 [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/T20803a.run T20803a [exit code non-0] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/T20803b.run T20803b [stderr mismatch] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/tcplugins/TcPlugin_Args.run TcPlugin_Args [exit code non-0] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/tcplugins/TcPlugin_EmitWanted.run TcPlugin_EmitWanted [stderr mismatch] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/tcplugins/TcPlugin_Nullary.run TcPlugin_Nullary [exit code non-0] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/tcplugins/TcPlugin_Rewrite.run TcPlugin_Rewrite [exit code non-0] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/tcplugins/TcPlugin_TyFam.run TcPlugin_TyFam [exit code non-0] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/test-defaulting-plugin.run test-defaulting-plugin [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/test-defaulting-plugin-fail.run test-defaulting-plugin-fail [bad stderr] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/test-echo-in-line.run test-echo-in-line [bad stdout] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/test-echo-in-line-many-args.run test-echo-in-line-many-args [bad exit code (2)] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/test-echo-in-turn.run test-echo-in-turn [bad stdout] (normal)
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/ghctest-1khi68vu/test spaces/testsuite/tests/plugins/test-echo-in-turn-many-args.run test-echo-in-turn-many-args [bad exit code (2)] (normal)
In addition, I see this output toward the top of my test run:
rae:23:01:42 ~/ghc/ghc/testsuite> runtests T11462
--build-root=_build --flavour=default -j9 --flavour=devel2+werror test --only=T11462 --freeze1 --freeze2 --docs=none
Up to date
| Run Testsuite GetExtraDeps: none
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/tmpfic54nbg/test.hs:2:8: error:
Could not find module ‘Prelude’
Perhaps you haven't installed the "dyn" libraries for package ‘base-4.16.0.0’?
Use -v (or `:set -v` in ghci) to see a list of the files searched for.
|
2 | module Main where
| ^^^^
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/tmp25fhpi0a/test.hs:2:8: error:
Could not find module ‘Prelude’
Perhaps you haven't installed the profiling libraries for package ‘base-4.16.0.0’?
Use -v (or `:set -v` in ghci) to see a list of the files searched for.
|
2 | module Main where
| ^^^^
# ghc-config (for _build/test/ghcconfig)
| Run Testsuite RunTest: none => none
/opt/homebrew/bin/python3 testsuite/driver/runtests.py --rootdir=testsuite/tests --rootdir=libraries/binary/tests --rootdir=libraries/bytestring/tests --rootdir=libraries/directory/tests --rootdir=libraries/process/tests --rootdir=libraries/exceptions/tests --rootdir=libraries/ghc-heap/tests --rootdir=libraries/hpc/tests --rootdir=libraries/template-haskell/tests --rootdir=libraries/text/tests --rootdir=libraries/unix/tests --rootdir=libraries/array/tests --rootdir=libraries/base/tests --rootdir=libraries/deepseq/tests --rootdir=libraries/exceptions/tests --rootdir=libraries/filepath/tests --rootdir=libraries/ghc-compact/tests --rootdir=libraries/ghc-prim/tests --rootdir=libraries/haskeline/tests --rootdir=libraries/pretty/tests --rootdir=libraries/stm/tests --top /Users/rae/ghc/ghc/testsuite -e windows=False -e darwin=True -e config.local=False -e config.cleanup=True -e config.accept=False -e config.accept_platform=False -e config.accept_os=False -e 'config.exeext='\'''\''' -e config.compiler_debugged=True -e ghc_with_native_codegen=True -e config.have_ncg=True -e config.have_llvm=True -e config.compiler_profiled=False -e config.have_RTS_linker=True -e 'config.package_conf_cache_file="/Users/rae/ghc/ghc/_build/stage1/lib/package.conf.d/package.cache"' -e 'config.libdir="/Users/rae/ghc/ghc/_build/stage1/lib"' -e config.have_interp=True -e config.unregisterised=False -e 'ghc_compiler_always_flags='\'' -dcore-lint -dstg-lint -dcmm-lint -no-user-package-db -fno-dump-with-ways -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output'\''' -e ghc_with_dynamic_rts=False -e ghc_with_threaded_rts=True -e config.have_fast_bignum=True -e ghc_with_smp=True -e config.ghc_dynamic=False -e config.leading_underscore=True -e 'config.wordsize="64"' -e 'config.os="darwin"' -e 'config.arch="aarch64"' -e 'config.platform="aarch64-apple-darwin"' -e config.stage=2 --config gs=gs --config 'timeout_prog="/Users/rae/ghc/ghc/_build/testsuite/timeout/install-inplace/bin/timeout"' --config stats_files_dir=_build/stage1/haddock-timing-files --threads=9 --config-file=testsuite/config/ghc --only=T11462 -e config.speed=1 --summary-file=testsuite_summary.txt --verbose=2 --config 'compiler="/Users/rae/ghc/ghc/_build/stage1/bin/ghc"' --config 'ghc_pkg="/Users/rae/ghc/ghc/_build/stage1/bin/ghc-pkg"' --config haddock= --config 'hp2ps="/Users/rae/ghc/ghc/_build/stage1/bin/hp2ps"' --config 'hpc="/Users/rae/ghc/ghc/_build/stage1/bin/hpc"' -e config.in_tree_compiler=True
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/tmpy21t5tz1/test.hs:2:8: error:
Could not find module ‘Prelude’
Perhaps you haven't installed the "dyn" libraries for package ‘base-4.16.0.0’?
Use -v (or `:set -v` in ghci) to see a list of the files searched for.
|
2 | module Main where
| ^^^^
/var/folders/mq/4sk7fqqs3tgggt70bhp2l7vh0000gn/T/tmpav7fts91/test.hs:2:8: error:
Could not find module ‘Prelude’
Perhaps you haven't installed the profiling libraries for package ‘base-4.16.0.0’?
Use -v (or `:set -v` in ghci) to see a list of the files searched for.
|
2 | module Main where
| ^^^^
That looks alarming, but somehow the test runs anyway. Surprisingly, the test passes (it's T11462), even though the original big run of the testsuite records that one as failing.
:(