Testsuite not reporting errors for DYN way on OS X

Using GHC 7.6.3, on OS X 10.8.5, for the program: main = putStrLn "Hello World", compiling with ghc --make -dynamic Main.hs, I get:

~/Documents/devel/test$ ./Main 
dyld: Library not loaded: /usr/local/lib/ghc-7.6.3/base-4.6.0.1/libHSbase-4.6.0.1-ghc7.6.3.dylib
  Referenced from: /Users/christiaan/Documents/devel/test/./Main
  Reason: image not found
Trace/BPT trap: 5

The reason for this is that:

• I installed GHC in: /opt/ghc/7.6.3 instead of the default /usr/local.
• GHC-bundled libraries get an OS X install_name with a prefix of /usr/local/ instead of /opt/ghc/7.6.3/, meaning that the runtime linker will be looking in the wrong place.

So, I wondered why this bug never showed in the testsuite and decided to test:

/opt/ghc/7.6.3/src/ghc/testsuite (ghc-7.6)$ make WAY=dyn TEST=10queens
…
=====> 10queens(dyn) 1834 of 3403 [0, 0, 0]
cd ./programs/10queens && '/opt/ghc/7.6.3/src/ghc/inplace/bin/ghc-stage2' -fforce-recomp -dcore-lint -dcmm-lint -dno-debug-output -no-user-package-db -rtsopts  -fno-ghci-history --make -o 10queens Main -O -dynamic   >10queens.comp.stderr 2>&1
cd ./programs/10queens && ./10queens    </dev/null >10queens.run.stdout 2>10queens.run.stderr

OVERALL SUMMARY for test run started at Fri Jan 31 09:42:45 CET 2014
    3403 total tests, which gave rise to
   13561 test cases, of which
       0 caused framework failures
   13560 were skipped

       1 expected passes
       0 had missing libraries
       0 expected failures
       0 unexpected passes
       0 unexpected failures

However, when I run the 10queens program myself:

/opt/ghc/7.6.3/src/ghc/testsuite (ghc-7.6)$ tests/programs/10queens/10queens 
dyld: Library not loaded: /usr/local/lib/ghc-7.6.3.20130421/base-4.6.0.1/libHSbase-4.6.0.1-ghc7.6.3.20130421.dylib
  Referenced from: /opt/ghc/7.6.3/src/ghc/testsuite/tests/programs/10queens/10queens
  Reason: image not found
Trace/BPT trap: 5

I get a similar error as the one reported above.

Due to commit f7be53ac, these errors will no longer show in GHC 7.8. However, I feel that the testsuite is now giving a false sense of security in terms of dynamic linking. Obviously dynamic linking was broken in 7.6, but the testsuite did not catch it!

Sadly, this behaviour can now only be verified in the 7.6 branch, and not in 7.8 or HEAD. Hopefully somebody more knowledgeable of the testsuite can comment why dynamic linking worked when an executable was run "within" the testsuite, whilst being broken when run normally.

Trac metadata

Trac field	Value
Version	7.6.3
Type	Bug
TypeOfFailure	OtherFailure
Priority	normal
Resolution	Unresolved
Component	Test Suite
Test case
Differential revisions
BlockedBy
Related
Blocking
CC
Operating system
Architecture