Jobs create too much output
Understanding job logs is difficult because of the amount of output. This is true for every job.
The context for this issue is that I tend to go blind while comparing jobs in pursuit of characterizing spurious failures. There is just so much of it.
In my experience, the right level of verbosity is apparently a matter of taste, so maybe not everyone will agree with what I am going to recommend. That's why I started with a statement of feeling, which is not falsifiable and lets you know what's coming.
I think GHC's jobs lean far too much into "irrelevant verbosity" and make things more difficult for contributors. I would rather err on the side of less output—so I can easily see where, roughly, things went wrong—than have all possible output to debug any possible error at any point of the entire process. The time spent narrowing down a problem, given that you know roughly where it occurred, is saved many times over by the time spent not reading output that is irrelevant in 99% of cases. The size of the logs also has an impact on operations. The big lie is that "storage is cheap", because maintaining stateful data is one of the hardest problems in operations.
If the current amount of output is just the result of random happenstance, then I apologize for reading into it too much and look forward to cleaning up the worst of it.
My recommendation, whether or not the current level of verbosity is intentional, is that you (the anonymous "you") think carefully about what is printed when you modify CI scripts. Many people other than yourself, who don't have your sense of what is relevant and what isn't, will be staring at the output in confusion and frustration down the road.
Sorry this issue is more of a rant than an "issue". Here's how we can nonetheless resolve it:
- Clarify whether or not the current level of verbosity is by design or accidental
- Agree, or agree to disagree, that we should remove some verbiage.
- If possible, call out known sources of irrelevant output that can be recorded in tickets and dealt with in good time.
Some examples.
Can you tell which job this is from?
Click to expand
if ac_fn_c_try_compile "$LINENO"
then :
ac_compiler_gnu=yes
else $as_nop
ac_compiler_gnu=no
fi
rm -f core conftest.err conftest.$ac_objext conftest.beam conftest.$ac_ext
ac_cv_c_compiler_gnu=$ac_compiler_gnu
fi
{ printf "%s\n" "$as_me:${as_lineno-$LINENO}: result: $ac_cv_c_compiler_gnu" >&5
printf "%s\n" "$ac_cv_c_compiler_gnu" >&6; }
ac_compiler_gnu=$ac_cv_c_compiler_gnu
if test $ac_compiler_gnu = yes; then
GCC=yes
else
GCC=
fi
ac_test_CFLAGS=${CFLAGS+y}
ac_save_CFLAGS=$CFLAGS
{ printf "%s\n" "$as_me:${as_lineno-$LINENO}: checking whether $CC accepts -g" >&5
printf %s "checking whether $CC accepts -g... " >&6; }
if test ${ac_cv_prog_cc_g+y}
then :
printf %s "(cached) " >&6
else $as_nop
ac_save_c_werror_flag=$ac_c_werror_flag
ac_c_werror_flag=yes
ac_cv_prog_cc_g=no
CFLAGS="-g"
cat confdefs.h - <<_ACEOF >conftest.$ac_ext
/* end confdefs.h. */
int
main (void)
{
;
return 0;
}
_ACEOF
if ac_fn_c_try_compile "$LINENO"
then :
ac_cv_prog_cc_g=yes
else $as_nop
CFLAGS=""
cat confdefs.h - <<_ACEOF >conftest.$ac_ext
/* end confdefs.h. */
int
main (void)
{
;
return 0;
}
_ACEOF
if ac_fn_c_try_compile "$LINENO"
then :
else $as_nop
ac_c_werror_flag=$ac_save_c_werror_flag
CFLAGS="-g"
cat confdefs.h - <<_ACEOF >conftest.$ac_ext
/* end confdefs.h. */
int
main (void)
{
;
return 0;
}
_ACEOF
if ac_fn_c_try_compile "$LINENO"
then :
ac_cv_prog_cc_g=yes
fi
rm -f core conftest.err conftest.$ac_objext conftest.beam conftest.$ac_ext
fi
rm -f core conftest.err conftest.$ac_objext conftest.beam conftest.$ac_ext
fi
rm -f core conftest.err conftest.$ac_objext conftest.beam conftest.$ac_ext
ac_c_werror_flag=$ac_save_c_werror_flag
fi
Or this?
Click to expand
cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/ghc-compact-0.1.0.0.conf' | sed 's|haddock-interfaces.*|haddock-interfaces: "${pkgroot}/../../../share/doc/ghc-9.4.4/html/libraries/ghc-compact-0.1.0.0/ghc-compact.haddock"|' | sed 's|haddock-html.*|haddock-html: "${pkgroot}/../../../share/doc/ghc-9.4.4/html/libraries/ghc-compact-0.1.0.0"|' | sed 's| ${pkgroot}/../../doc/html/.*||' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/ghc-compact-0.1.0.0.conf.copy'
# The rts package doesn't actually supply haddocks, so we stop advertising them
# altogether.
((echo "ghc-compact" | grep rts) && (cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/ghc-compact-0.1.0.0.conf.copy' | sed 's|haddock-.*||' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/ghc-compact-0.1.0.0.conf.copy.copy')) || (cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/ghc-compact-0.1.0.0.conf.copy' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/ghc-compact-0.1.0.0.conf.copy.copy')
# We finally replace the original file.
mv '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/ghc-compact-0.1.0.0.conf.copy.copy' '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/ghc-compact-0.1.0.0.conf'
# Fix the mode, in case umask is set
chmod 644 '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/ghc-compact-0.1.0.0.conf' # to the doc files.
cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/directory-1.3.7.1.conf' | sed 's|haddock-interfaces.*|haddock-interfaces: "${pkgroot}/../../../share/doc/ghc-9.4.4/html/libraries/directory-1.3.7.1/directory.haddock"|' | sed 's|haddock-html.*|haddock-html: "${pkgroot}/../../../share/doc/ghc-9.4.4/html/libraries/directory-1.3.7.1"|' | sed 's| ${pkgroot}/../../doc/html/.*||' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/directory-1.3.7.1.conf.copy'
# The rts package doesn't actually supply haddocks, so we stop advertising them
# altogether.
((echo "directory" | grep rts) && (cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/directory-1.3.7.1.conf.copy' | sed 's|haddock-.*||' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/directory-1.3.7.1.conf.copy.copy')) || (cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/directory-1.3.7.1.conf.copy' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/directory-1.3.7.1.conf.copy.copy')
# We finally replace the original file.
mv '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/directory-1.3.7.1.conf.copy.copy' '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/directory-1.3.7.1.conf'
# Fix the mode, in case umask is set
chmod 644 '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/directory-1.3.7.1.conf' # to the doc files.
cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/xhtml-3000.2.2.1.conf' | sed 's|haddock-interfaces.*|haddock-interfaces: "${pkgroot}/../../../share/doc/ghc-9.4.4/html/libraries/xhtml-3000.2.2.1/xhtml.haddock"|' | sed 's|haddock-html.*|haddock-html: "${pkgroot}/../../../share/doc/ghc-9.4.4/html/libraries/xhtml-3000.2.2.1"|' | sed 's| ${pkgroot}/../../doc/html/.*||' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/xhtml-3000.2.2.1.conf.copy'
# The rts package doesn't actually supply haddocks, so we stop advertising them
# altogether.
((echo "xhtml" | grep rts) && (cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/xhtml-3000.2.2.1.conf.copy' | sed 's|haddock-.*||' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/xhtml-3000.2.2.1.conf.copy.copy')) || (cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/xhtml-3000.2.2.1.conf.copy' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/xhtml-3000.2.2.1.conf.copy.copy')
# We finally replace the original file.
mv '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/xhtml-3000.2.2.1.conf.copy.copy' '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/xhtml-3000.2.2.1.conf'
# Fix the mode, in case umask is set
chmod 644 '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/xhtml-3000.2.2.1.conf' # to the doc files.
cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/containers-0.6.6.conf' | sed 's|haddock-interfaces.*|haddock-interfaces: "${pkgroot}/../../../share/doc/ghc-9.4.4/html/libraries/containers-0.6.6/containers.haddock"|' | sed 's|haddock-html.*|haddock-html: "${pkgroot}/../../../share/doc/ghc-9.4.4/html/libraries/containers-0.6.6"|' | sed 's| ${pkgroot}/../../doc/html/.*||' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/containers-0.6.6.conf.copy'
# The rts package doesn't actually supply haddocks, so we stop advertising them
# altogether.
((echo "containers" | grep rts) && (cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/containers-0.6.6.conf.copy' | sed 's|haddock-.*||' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/containers-0.6.6.conf.copy.copy')) || (cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/containers-0.6.6.conf.copy' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/containers-0.6.6.conf.copy.copy')
# We finally replace the original file.
mv '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/containers-0.6.6.conf.copy.copy' '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/containers-0.6.6.conf'
# Fix the mode, in case umask is set
chmod 644 '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/containers-0.6.6.conf' # to the doc files.
cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/libiserv-9.4.4.conf' | sed 's|haddock-interfaces.*|haddock-interfaces: "${pkgroot}/../../../share/doc/ghc-9.4.4/html/libraries/libiserv-9.4.4/libiserv.haddock"|' | sed 's|haddock-html.*|haddock-html: "${pkgroot}/../../../share/doc/ghc-9.4.4/html/libraries/libiserv-9.4.4"|' | sed 's| ${pkgroot}/../../doc/html/.*||' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/libiserv-9.4.4.conf.copy'
# The rts package doesn't actually supply haddocks, so we stop advertising them
# altogether.
((echo "libiserv" | grep rts) && (cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/libiserv-9.4.4.conf.copy' | sed 's|haddock-.*||' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/libiserv-9.4.4.conf.copy.copy')) || (cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/libiserv-9.4.4.conf.copy' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/libiserv-9.4.4.conf.copy.copy')
# We finally replace the original file.
mv '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/libiserv-9.4.4.conf.copy.copy' '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/libiserv-9.4.4.conf'
# Fix the mode, in case umask is set
chmod 644 '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/libiserv-9.4.4.conf' # to the doc files.
cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/deepseq-1.4.8.0.conf' | sed 's|haddock-interfaces.*|haddock-interfaces: "${pkgroot}/../../../share/doc/ghc-9.4.4/html/libraries/deepseq-1.4.8.0/deepseq.haddock"|' | sed 's|haddock-html.*|haddock-html: "${pkgroot}/../../../share/doc/ghc-9.4.4/html/libraries/deepseq-1.4.8.0"|' | sed 's| ${pkgroot}/../../doc/html/.*||' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/deepseq-1.4.8.0.conf.copy'
# The rts package doesn't actually supply haddocks, so we stop advertising them
# altogether.
((echo "deepseq" | grep rts) && (cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/deepseq-1.4.8.0.conf.copy' | sed 's|haddock-.*||' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/deepseq-1.4.8.0.conf.copy.copy')) || (cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/deepseq-1.4.8.0.conf.copy' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/deepseq-1.4.8.0.conf.copy.copy')
# We finally replace the original file.
mv '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/deepseq-1.4.8.0.conf.copy.copy' '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/deepseq-1.4.8.0.conf'
# Fix the mode, in case umask is set
chmod 644 '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/deepseq-1.4.8.0.conf' # to the doc files.
cat '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/array-0.5.4.0.conf' | sed 's|haddock-interfaces.*|haddock-interfaces: "${pkgroot}/../../../share/doc/ghc-9.4.4/html/libraries/array-0.5.4.0/array.haddock"|' | sed 's|haddock-html.*|haddock-html: "${pkgroot}/../../../share/doc/ghc-9.4.4/html/libraries/array-0.5.4.0"|' | sed 's| ${pkgroot}/../../doc/html/.*||' > '/nix/store/61z0i6f1h39z7a15b6ghch4d0n5q8gj7-ghc/lib/ghc-9.4.4/lib/package.conf.d/array-0.5.4.0.conf.copy'
# The rts package doesn't actually supply haddocks, so we stop advertising them
# altogether.
What about this one?
Click to expand
/nix/store/29q4igd4hflpna161s745nmyi22wiv32-openssl-3.0.7-dev
/nix/store/2cdxy1digfz3p3lj4rh93v8050x8jf0w-hspec-discover-2.9.7-doc
/nix/store/2dz1081z3wpsyifywjv69sha3gm56k2n-HUnit-1.6.2.0
/nix/store/2jyavbrz2w2il3kxyjffwhsm365sm4f1-python3.10-pygments-2.13.0
/nix/store/2m2jha21jq3f51g0rd42y385v5vfkgih-diffutils-3.8
/nix/store/2nlgdizz8d35szxwdvcfq1yd3bmn091a-gmp-with-cxx-6.2.1-dev
/nix/store/2v0dacfag1rg3qyzcdhqwk5014wmlahj-texlive-core-big.bin-2022-metafont
/nix/store/2wqdrmw3z316890fm2nch5l5wx4ybbbm-libwebp-1.2.4
/nix/store/2xdw70q5rylrs0rlf0p4mdaiqzr8ciri-clock-0.8.3-doc
/nix/store/2z6msfah8h8h0y9pr8snh0796dwr860c-ijs-9.56.1
/nix/store/32a7xrjj0nsnw45s3wa9b03va3x9hbkj-clock-0.8.3
/nix/store/33f2jgr5n7xxhvs76fhvvksgi4cb0ad7-texlive-chktex.bin-2022
/nix/store/3acwvl3acmpnx98k46lw37jlf37fff2n-libtasn1-4.19.0
/nix/store/3d1fr7bh72lr4p38frlq5kpja2yimxif-ansi-terminal-0.11.4-doc
/nix/store/3jhv9jmnbhvppjf13bfhh91nb5y6p89x-texlive-bin-2022-doc
/nix/store/3miy18fa18z9nhp70kbw74hw6g3mr3fb-python3.10-sphinxcontrib-htmlhelp-2.0.0
/nix/store/3sixc33xj6wbjd3zqd5y1m1cbfhj2j2s-python3-3.10.9
/nix/store/3yppdb7zz2m4xb862v8qfcr0fcd0zari-pcre2-10.40
/nix/store/3z3i0kgb92jaf2vqaz88skw6bhxgapcd-nss-cacert-3.86
/nix/store/40mavd26245ph286r81wriv3jqivshy5-brotli-1.0.9-lib
/nix/store/43m32i6zxj2gyvb0mcibr7x8cb9h604d-python3.10-docutils-0.19
/nix/store/46ida37bxwli60i6lpwiwbyfngpzix16-python3.10-sphinxcontrib-devhelp-1.0.2
/nix/store/47690zpac79ryg18c9frxxj129spy1qd-hook
/nix/store/49kamcq4xym53gdram9m0axk03vign84-python3.10-sphinxcontrib-serializinghtml-1.1.5
/nix/store/49pxv8jb374fkdmqyaagr20gi04ls7gl-cups-2.4.2-lib
/nix/store/4apwk5zqs2yb1jmbi0nks2xx1rl7qirz-perl5.36.0-MRO-Compat-0.13
/nix/store/4f5cq1k8rhmnnjn1i4c703vymzdj78js-quickcheck-io-0.2.0
/nix/store/4fjjxf19nmph5qf5r2y546j5nxk4ci6w-openssl-3.0.7
/nix/store/4mzi8mhs83vr80gr0m0x2jg1xnjg3ddk-nghttp2-1.49.0
/nix/store/4pclfkv04cr6k74dkcxqcc6rbc9rca3v-nghttp2-1.49.0-dev
/nix/store/4s25cdaxy35ph0fyrpz1lya62chblgdi-nanospec-0.2.2-doc
/nix/store/4yhnrdbm59ldvpjhv0sf0aa9dycc6zjp-curl-7.86.0
/nix/store/52pdyag262maii7f0bmd81k5vswvk8r8-perl5.36.0-MIME-Charset-1.012.2
/nix/store/560f22hk9xl5dhhasvzpw2ppgcra5vmf-libfaketime-0.9.9
/nix/store/58vksbmmshgpvijavr4a1wy8frl2v9ij-network-3.1.2.7-doc
/nix/store/59w93mafhw59qmzbbv9sb8wxz46n896i-colour-2.3.6-doc
/nix/store/5a8z2xqhcfrhlql7yjyb71m5yxdackjn-perl5.36.0-Class-Data-Inheritable-0.08
/nix/store/5p8sk8c83k7ia5q6a076mwgmcvx1c2l0-signing-utils
/nix/store/5s3bj1ilr7rklli0i6sjgn2rnpkjyqf5-mockery-0.3.5
/nix/store/5z8kzfkc4cmkxldvzq4xz4ldknl94qgn-cabal-install-3.8.1.0
/nix/store/60mn60j38fnl389idlqhhkdfj9lmsfga-bzip2-1.0.8
/nix/store/615hqz4vwi0ww9729h3sm9m947lg7jv1-openssl-3.0.7
/nix/store/6f518p3404gxwc8rkb6lrkprp9rfc97i-groff-1.22.4
/nix/store/6hf1h4b5gf39bp9725bqch23c218bbrw-curl-7.86.0-bin
/nix/store/6ls257pmk2i4b2ay5khw285l92y09rck-hspec-expectations-0.8.2
/nix/store/6qsrrjl8abc36wpq5x049q19yp1pmrm4-libXaw-1.0.14
/nix/store/6rd183paf884my9iqlqvp53rclacyabk-setenv-0.1.1.3-doc
/nix/store/6vr5acfnbzwvpr499k0hlw2gnjzj1ws4-python3.10-pbr-5.11.0
/nix/store/6zcvllkkp6971f81v0227q1fb0pw52n9-python3.10-PyStemmer-2.0.1
/nix/store/7afffsr89jb2mvz11f4kk2vfd7c3lvvm-mailcap-2.1.53
/nix/store/7bssg9isjimkadgs1ldzn9kmv5nr966y-automake-1.16.5
/nix/store/7fs9i9fw2l8d2mmpnkv27dz966dq2w9i-fontconfig-2.14.0-dev
/nix/store/7iyh2g8ljazp135al9f2gahm30z4jxla-libjxl-0.7.0
/nix/store/7jp4d9fxdd0iwq8a9hx54bw1yhvyp9hv-mpfr-4.1.1
/nix/store/7kbaqx2pspdkqz82ky2q984vzg7q4lp7-python3.10-pysocks-1.7.1
/nix/store/7lcwpgskn4r1fjgkfiwkyc315xc89ssl-gnumake-4.4
/nix/store/7nsqzxlm4crnpin6ahknplk7rssh1854-colour-2.3.6
/nix/store/7s0lygb1xv6zz71nw23rbxilnsnbppgh-freetype-2.12.1-dev
/nix/store/7swsyznp2z7njs6zg5rndb2b2qgs4sav-happy-1.20.0-data
/nix/store/806r426pnhjgxmsp64ys73rlwv0lx7rh-freetype-2.12.1
/nix/store/80q2fvxng4020illmh9885x2d1fmahdl-perl-5.36.0
/nix/store/8d5fm5dwm0lbib7b7n16gcf9115dj1lz-clang-11.1.0-lib
/nix/store/8i0r24isrwsd1rxhzb4j434m39kyjkln-texlinks
/nix/store/8mkxwyb3bgrc44x8q8nyawj2zb06zgsa-libXi-1.8
/nix/store/8mnlqdxn0qd93wxhlshh9v8c88w8jgg6-libaom-3.5.0
/nix/store/8p6vmqz2jh3sijsihyf6f32cvrlz4gja-hspec-2.9.7
/nix/store/8w17sv1ibalci18ysz93zyd4k536vbhl-sigtool-0.1.3
/nix/store/8zmb4ilqlm3imhizr0fpgwqqjyki1wmn-python3.10-sphinx-5.1.1
/nix/store/91sc8xzw001y398ry0zpbgyi6aasaxs3-perl5.36.0-Dist-CheckConflicts-0.11
/nix/store/959i6ghhdi3c5gvm333bgcy14jlrhmhn-process-1.6.16.0
/nix/store/9cz1c50y39ajn5hmqz1gyc03g4wjwcdx-perl5.36.0-Sub-Identify-0.14
/nix/store/9frfzkq7n0bdmm3vwfg1r0776x1v02f1-libdeflate-1.8
/nix/store/9i2w6vjf774c0mhni3yajkszvxy1slc6-transformers-compat-0.7.2-doc
/nix/store/9k30m78p8yy67i0nqbb0cnizm140rzbk-giflib-5.2.1
/nix/store/9l4y4jbshl0gdf24lkccagv1fs545f00-dejavu-fonts-2.37
/nix/store/9mwp1drpa3fmcfawpzjz9wmgyprdxkq8-network-uri-2.6.4.2
/nix/store/9n5zp4m1d97n8xim3ckbzcldmf7j21bs-logging-facade-0.3.1-doc
/nix/store/9wpxkkbjrncjlca7vw4g1igvnfxn36bx-python3.10-alabaster-0.7.12
/nix/store/a078wn5b4gbyc2khz5lhrz5ayhzr8v2l-libICE-1.0.10
/nix/store/a0axnmnv11w9ppq4p3zxvl42qf4kjhri-python3.10-idna-3.4
/nix/store/a0dcxwni6mfc9cgk2b64gybzlghaj5ml-patch-2.7.6
/nix/store/a18ddisg2sw6783hcc59ml7zp2zy9r6w-mockery-0.3.5-doc
/nix/store/a2vn8a0174slqbmmll1hiqvrzkbdry6d-python3.10-brotli-1.0.9
/nix/store/a3qdffgdnlgykx65sv3z9hmjz2n2s7mc-gnu-config-2021-01-25
/nix/store/afz161dq9ipzq60kxjc8rxwmg84rw080-pixman-0.42.2
/nix/store/agjbknslw99cxfk6s6bx1mcqrw69h0wx-fontconfig-2.14.0-bin
Trick question, all of them are from https://gitlab.haskell.org/ghc/ghc/-/jobs/1345822, which failed before it could even attempt to validate any GHC code.