Convert reqlib tests to a head.hackage testsuite

This sounds wonderful, thanks!

Do you know what is going on here in the CI job? It says Test of ghc-tests failed (code 1), but the overall CI job still succeeded, which is worrisome.

added 2 commits

• 8543f579 - Add initial support for running test-suites for packages
• 7eaaf259 - Convert reqlib tests to new head.hackage infra

Compare with previous version

@RyanGlScott I pushed an update which should fix that.

Thanks! I think you'll also need to rebase on top of master (to bring in commit 29ef2b04) in order to fix the build-master CI failure. Beyond that, LGTM.

Seems like the build fails on 9.0.. will try locally.

added 1 commit

• 2c1f74ac - Convert reqlib tests to new head.hackage infra

Compare with previous version

added 28 commits

• 2c1f74ac...3b01c758 - 26 commits from branch master
• 6583f7a0 - Add initial support for running test-suites for packages
• fa403a03 - Convert reqlib tests to new head.hackage infra

Compare with previous version

Any idea why CI is failing @RyanGlScott ?

Hm, it's not clear at a glance why those tests would be hanging (and only on 9.2+ at that). Can you reproduce this locally?

No they don't hang for me locally.

added 1 commit

• 81670115 - Remove flaky tests

Compare with previous version

How bizarre. Ultimately, I think your approach of commenting out the flaky tests is the right path forward for now. We can always open an issue as a reminder to later investigate why the flaky tests are failing.

approved this merge request

Still seems to be hanging..

mentioned in issue ghc#20032 (closed)

added 1 commit

• 6caf6e54 - comment out some more

Compare with previous version

added 25 commits

• 6caf6e54...dfd024c9 - 21 commits from branch master
• ad838161 - Add initial support for running test-suites for packages
• b72351cf - Convert reqlib tests to new head.hackage infra
• 06cd260c - Remove flaky tests
• 8ad89517 - comment out some more

Compare with previous version

Well, it no longer seems to be hanging, which is nice. But stranger yet, the actual package builds seem to be skipped over now: https://gitlab.haskell.org/ghc/head.hackage/-/jobs/799636#L5508

I commented that out to try and debug the hang, which no longer seems to happen.

added 1 commit

• 78222a85 - Convert reqlib tests to new head.hackage infra

Compare with previous version

added 2 commits

• abad12fc - Add initial support for running test-suites for packages
• 2c5513da - Convert reqlib tests to new head.hackage infra

Compare with previous version