Many unexpected test timeouts
The overwhelming culprit is zw3rk linux-4, so I have paused that runner and alerted @angerman.
Incidents in the last two weeks:
| json->>'id' | json->>'web_url' | json->>'runner.description' | date(json->>'created_at') |
|---|---|---|---|
| 1758393 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1758393 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-22 |
| 1758303 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1758303 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-22 |
| 1758294 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1758294 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-22 |
| 1758160 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1758160 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-22 |
| 1757990 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1757990 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-22 |
| 1757824 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1757824 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-22 |
| 1757808 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1757808 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-22 |
| 1757741 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1757741 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-21 |
| 1757731 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1757731 | x86_64-linux-6.zw3rk_x86_64-linux-6_db038e4e1623 | 2024-01-21 |
| 1757668 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1757668 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-21 |
| 1757655 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1757655 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-21 |
| 1757477 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1757477 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-21 |
| 1757474 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1757474 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-21 |
| 1757469 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1757469 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-21 |
| 1756592 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1756592 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-20 |
| 1756583 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1756583 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-20 |
| 1756128 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1756128 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-19 |
| 1756117 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1756117 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-19 |
| 1755896 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1755896 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-18 |
| 1755698 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1755698 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-18 |
| 1755343 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1755343 | x86_64-linux-7.zw3rk_x86_64-linux-7_db038e4e1623 | 2024-01-18 |
| 1755328 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1755328 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-18 |
| 1755237 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1755237 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-17 |
| 1754569 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1754569 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-17 |
| 1754212 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1754212 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-17 |
| 1754209 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1754209 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-17 |
| 1754206 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1754206 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-17 |
| 1754033 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1754033 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-17 |
| 1753889 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1753889 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-16 |
| 1753888 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1753888 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-16 |
| 1753875 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1753875 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-16 |
| 1753559 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1753559 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-16 |
| 1753534 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1753534 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-16 |
| 1753483 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1753483 | azure-ghc-ci-linux-2 | 2024-01-16 |
| 1753289 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1753289 | x86_64-linux-7.zw3rk_x86_64-linux-7_db038e4e1623 | 2024-01-16 |
| 1753248 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1753248 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-16 |
| 1753239 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1753239 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-16 |
| 1753234 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1753234 | x86_64-linux-5.zw3rk_x86_64-linux-5_db038e4e1623 | 2024-01-16 |
| 1753228 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1753228 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-16 |
| 1753118 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1753118 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-16 |
| 1753112 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1753112 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-16 |
| 1752820 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1752820 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-15 |
| 1752817 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1752817 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-15 |
| 1752718 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1752718 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-15 |
| 1752420 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1752420 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-15 |
| 1752416 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1752416 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-15 |
| 1751858 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1751858 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-14 |
| 1751852 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1751852 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-14 |
| 1751646 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1751646 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-14 |
| 1751642 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1751642 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-14 |
| 1751181 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1751181 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-13 |
| 1751177 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1751177 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-13 |
| 1750977 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1750977 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-12 |
| 1750644 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1750644 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-12 |
| 1750643 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1750643 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-12 |
| 1750346 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1750346 | x86_64-linux-7.zw3rk_x86_64-linux-7_db038e4e1623 | 2024-01-12 |
| 1750264 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1750264 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-11 |
| 1750238 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1750238 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-11 |
| 1749516 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1749516 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-10 |
| 1749513 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1749513 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-10 |
| 1749001 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1749001 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-10 |
| 1748835 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1748835 | x86_64-linux-6.zw3rk_x86_64-linux-6_db038e4e1623 | 2024-01-10 |
| 1748634 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1748634 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-10 |
| 1748455 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1748455 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-10 |
| 1748087 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1748087 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-09 |
| 1747940 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1747940 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-09 |
| 1747936 | https://gitlab.haskell.org/ghc/ghc/-/jobs/1747936 | x86_64-linux-4.zw3rk_x86_64-linux-4_db038e4e1623 | 2024-01-09 |
Edited by Bryan R