Skip to content

compile_and_run tests should compare stderr of compilation

Normal should_compile tests always compare stderr of the compilation so that changes in error messages etc are tracked by the testsuite.

On the other hand, compile_and_run ignores stderr from compiling the file which potentially hides some bad error messages or warnings about tests which might mean they are testing the wrong thing etc.

The proposal is to also always compare stderr for compile_and_run tests.

This causes problems with the ghci way because the program doesn't exit with a non-zero exit if the compilation fails for some reason so you get a pretty useless error message.

To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information