Stack smashing occurs when building some packages

It sounds to me like this is due to the runtime linker:

this comment from #16046 (closed) suggests that the crash definitely happens while loading a package
TextShow.Data.Tuple of text-show definitely contains many TH splices, which would require loading of code

Stragely, the backtrace given in this ticket doesn't provide any good hints as to where in the linker the problem occurred.

assigned to @bgamari

added Phighest Tbug linking runtime crash labels and removed needs triage label

I have tried to reproduce this outside of Ubuntu by building GHC master on NixOS 21.05 with :

CFLAGS="-fstack-protector-strong -fcf-protection -fstack-clash-protection"
./configure $CONFIGURE_ARGS CFLAGS="$CFLAGS" CONF_CC_OPTS_STAGE1="$CFLAGS" CONF_CC_OPTS_STAGE2="$CFLAGS"
hadrian/build-cabal -j9 --flavour=perf+debug_info

Unfortunate, this did not reproduce any failures in the testsuite.

I also tried to reproducing under an Ubuntu 20.04 VM with the current state of the ghc-8.10 branch (d08ae6d6). Unfortunately, this compiler can build text-show without any trouble and passes the testsuite.

@recursion-ninja, where are you getting your GHC binary distribution from?

Even with GHC 8.10.5 installed via ghcup on Ubuntu 20.04 I am unable to reproduce this issue while building text-show.

@recursion-ninja, so far it seems no one has been able to reproduce this issue, including myself in quite a few attempted configurations. Is their any way we could briefly chat regarding your setup? I'm growing suspicious that there is something else at play here.

Is their any way we could briefly chat regarding your setup

@bgamari absolutely! What communication medium do you think would be best? Discord, Email, IRC, Slack, other?

IRC is my preferred real-time communications medium but I am willing to use Discord or Slack in a pinch. I can be essentially always be found in #ghc on irc.libera.chat.

Unfortunately I'm heading off for vacation shortly so we will have to arrange something in a few weeks.

@recursion-ninja I'm now back from vacation. Perhaps we could chat at some point in the next few weeks?

GNU gdb (Ubuntu 9.2-0ubuntu1~20.04) 9.2
Copyright (C) 2020 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
    <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/ghc...
(No debugging symbols found in /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/ghc)
[New LWP 889110]
[New LWP 889112]
[New LWP 889111]
[New LWP 889114]
[New LWP 889113]
^CQuit
(gdb) thread apply all bt

Thread 5 (LWP 889113):
#0  0x00007f1e82b5faff in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x0000004200105c30 in ?? ()
#2  0x00000042001067b0 in ?? ()
#3  0x0000000000000002 in ?? ()
#4  0xffffffff843f16b0 in ?? ()
#5  0x0000000000000090 in ?? ()
#6  0x00007f1e83e12a34 in ?? () from /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../base-4.15.0.0/libHSbase-4.15.0.0-ghc9.0.1.so
#7  0x0000000000000000 in ?? ()

Thread 4 (LWP 889114):
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x1ebbbd8) at ../sysdeps/nptl/futex-internal.h:183
#1  __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x1ebbbe0, cond=0x1ebbbb0) at pthread_cond_wait.c:508
#2  __pthread_cond_wait (cond=cond@entry=0x1ebbbb0, mutex=mutex@entry=0x1ebbbe0) at pthread_cond_wait.c:647
#3  0x00007f1e82fbd979 in waitCondition (pCond=pCond@entry=0x1ebbbb0, pMut=pMut@entry=0x1ebbbe0) at rts/posix/OSThreads.c:117
#4  0x00007f1e82f9372b in waitForWorkerCapability (task=<optimized out>) at rts/Capability.c:706
#5  yieldCapability (pCap=pCap@entry=0x7f1e80b7fe78, task=task@entry=0x1ebbba0, gcAllowed=gcAllowed@entry=true) at rts/Capability.c:999
#6  0x00007f1e82f9e973 in scheduleYield (task=0x1ebbba0, pcap=0x7f1e80b7fe70) at rts/Schedule.c:721
#7  schedule (initialCapability=initialCapability@entry=0x7f1e82feedc0 <MainCapability>, task=task@entry=0x1ebbba0) at rts/Schedule.c:317
#8  0x00007f1e82f9fcbc in scheduleWorker (cap=cap@entry=0x7f1e82feedc0 <MainCapability>, task=task@entry=0x1ebbba0) at rts/Schedule.c:2670
#9  0x00007f1e82f9b3f8 in workerStart (task=0x1ebbba0) at rts/Task.c:446
#10 0x00007f1e82cc9609 in start_thread (arg=<optimized out>) at pthread_create.c:477
#11 0x00007f1e82b6c293 in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#12 0x0000000000000000 in ?? ()

Thread 3 (LWP 889111):
#0  __libc_read (nbytes=8, buf=0x7f1e82382ea8, fd=3) at ../sysdeps/unix/sysv/linux/read.c:26
#1  __libc_read (fd=fd@entry=3, buf=buf@entry=0x7f1e82382ea8, nbytes=nbytes@entry=8) at ../sysdeps/unix/sysv/linux/read.c:24
#2  0x00007f1e82fbdd6e in itimer_thread_func (_handle_tick=0x7f1e82fa5300 <handle_tick>) at rts/posix/itimer/Pthread.c:127
#3  0x00007f1e82cc9609 in start_thread (arg=<optimized out>) at pthread_create.c:477
#4  0x00007f1e82b6c293 in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 2 (LWP 889112):
#0  0x00007f1e82b6c5ce in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x0000004200528298 in ?? ()
#2  0x000000040102b678 in ?? ()
#3  0x0000004200106010 in ?? ()
#4  0xffffffff00000040 in ?? ()
#5  0x00000042005280c0 in ?? ()
#6  0x00007f1e83dfee65 in base_GHCziEventziEPoll_new10_info () from /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../base-4.15.0.0/libHSbase-4.15.0.0-ghc9.0.1.so
#7  0x0000000000000000 in ?? ()

--Type <RET> for more, q to quit, c to continue without paging--
Thread 1 (LWP 889110):
#0  0x00007f1e82a9018b in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x0000000000000000 in ?? ()

Invoking the ghc build command directly with gdb:

(gdb) thread apply all bt

Thread 5 (Thread 0x7fffeebd2700 (LWP 892452)):
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x5b5bdc) at ../sysdeps/nptl/futex-internal.h:183
#1  __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x5b5be0, cond=0x5b5bb0) at pthread_cond_wait.c:508
#2  __pthread_cond_wait (cond=cond@entry=0x5b5bb0, mutex=mutex@entry=0x5b5be0) at pthread_cond_wait.c:647
#3  0x00007ffff100f979 in waitCondition (pCond=pCond@entry=0x5b5bb0, pMut=pMut@entry=0x5b5be0) at rts/posix/OSThreads.c:117
#4  0x00007ffff0fe572b in waitForWorkerCapability (task=<optimized out>) at rts/Capability.c:706
#5  yieldCapability (pCap=pCap@entry=0x7fffeebd1e78, task=task@entry=0x5b5ba0, gcAllowed=gcAllowed@entry=true) at rts/Capability.c:999
#6  0x00007ffff0ff0973 in scheduleYield (task=0x5b5ba0, pcap=0x7fffeebd1e70) at rts/Schedule.c:721
#7  schedule (initialCapability=initialCapability@entry=0x7ffff1040dc0 <MainCapability>, task=task@entry=0x5b5ba0) at rts/Schedule.c:317
#8  0x00007ffff0ff1cbc in scheduleWorker (cap=cap@entry=0x7ffff1040dc0 <MainCapability>, task=task@entry=0x5b5ba0) at rts/Schedule.c:2670
#9  0x00007ffff0fed3f8 in workerStart (task=0x5b5ba0) at rts/Task.c:446
#10 0x00007ffff0d1b609 in start_thread (arg=<optimized out>) at pthread_create.c:477
#11 0x00007ffff0bbe293 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95

Thread 4 (Thread 0x7fffef3d3700 (LWP 892451)):
#0  0x00007ffff0bb1aff in __GI___poll (fds=0x42001067b0, nfds=2, timeout=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
#1  0x00007ffff1e64a34 in ?? () from /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../base-4.15.0.0/libHSbase-4.15.0.0-ghc9.0.1.so
#2  0x0000000000000000 in ?? ()

Thread 3 (Thread 0x7fffefbd4700 (LWP 892450)):
#0  0x00007ffff0bbe5ce in epoll_wait (epfd=4, events=0x4200106010, maxevents=64, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30
#1  0x00007ffff1e50e65 in base_GHCziEventziEPoll_new10_info () from /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../base-4.15.0.0/libHSbase-4.15.0.0-ghc9.0.1.so
#2  0x0000000000000000 in ?? ()

Thread 2 (Thread 0x7ffff03d5700 (LWP 892449)):
#0  __libc_read (nbytes=8, buf=0x7ffff03d4ea8, fd=3) at ../sysdeps/unix/sysv/linux/read.c:26
#1  __libc_read (fd=fd@entry=3, buf=buf@entry=0x7ffff03d4ea8, nbytes=nbytes@entry=8) at ../sysdeps/unix/sysv/linux/read.c:24
#2  0x00007ffff100fd6e in itimer_thread_func (_handle_tick=0x7ffff0ff7300 <handle_tick>) at rts/posix/itimer/Pthread.c:127
#3  0x00007ffff0d1b609 in start_thread (arg=<optimized out>) at pthread_create.c:477
#4  0x00007ffff0bbe293 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95

Thread 1 (Thread 0x7ffff0946740 (LWP 892445)):
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
#1  0x00007ffff0ac1859 in __GI_abort () at abort.c:79
#2  0x00007ffff0b2c3ee in __libc_message (action=action@entry=do_abort, fmt=fmt@entry=0x7ffff0c5607c "*** %s ***: terminated\n") at ../sysdeps/posix/libc_fatal.c:155
#3  0x00007ffff0bceb4a in __GI___fortify_fail (msg=msg@entry=0x7ffff0c56064 "stack smashing detected") at fortify_fail.c:26
#4  0x00007ffff0bceb16 in __stack_chk_fail () at stack_chk_fail.c:24
#5  0x00007fffed7270e8 in __pthread_tunables_init () from /usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/../lib/libpthread.so
#6  0x00007fffed7180d4 in __pthread_initialize_minimal () from /usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/../lib/libpthread.so
#7  0x00007fffed71700d in _init () from /usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/../lib/libpthread.so
#8  0x00007ffff0aaee58 in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#9  0x00007ffff7fe0c0c in ?? () from /lib64/ld-linux-x86-64.so.2
#10 0x00007ffff7fe0dc6 in ?? () from /lib64/ld-linux-x86-64.so.2
#11 0x00007ffff0bff915 in __GI__dl_catch_exception (exception=<optimized out>, operate=<optimized out>, args=<optimized out>) at dl-error-skeleton.c:182
#12 0x00007ffff7fe520f in ?? () from /lib64/ld-linux-x86-64.so.2
#13 0x00007ffff0bff8b8 in __GI__dl_catch_exception (exception=<optimized out>, operate=<optimized out>, args=<optimized out>) at dl-error-skeleton.c:208
#14 0x00007ffff7fe474a in ?? () from /lib64/ld-linux-x86-64.so.2
#15 0x00007ffff0d3634c in dlopen_doit (a=a@entry=0x7fffffff80b0) at dlopen.c:66
#16 0x00007ffff0bff8b8 in __GI__dl_catch_exception (exception=exception@entry=0x7fffffff8050, operate=<optimized out>, args=<optimized out>) at dl-error-skeleton.c:208
#17 0x00007ffff0bff983 in __GI__dl_catch_error (objname=0x5d78d0, errstring=0x5d78d8, mallocedp=0x5d78c8, operate=<optimized out>, args=<optimized out>) at dl-error-skeleton.c:227
#18 0x00007ffff0d36b59 in _dlerror_run (operate=operate@entry=0x7ffff0d362f0 <dlopen_doit>, args=args@entry=0x7fffffff80b0) at dlerror.c:170
#19 0x00007ffff0d363da in __dlopen (file=file@entry=0x42030f6b60 "/usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/../lib/libpthread.so", mode=mode@entry=1) at dlopen.c:87
--Type <RET> for more, q to quit, c to continue without paging--
#20 0x00007ffff0fe1cdb in internal_dlopen (dll_name=0x42030f6b60 "/usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/../lib/libpthread.so") at rts/Linker.c:579
#21 0x00007ffff0fe2404 in addDLL (dll_name=<optimized out>) at rts/Linker.c:691
#22 0x00007ffff318bdd7 in ghcizm9zi0zi1_GHCiziObjLink_czuaddDLL_info () from /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../ghci-9.0.1/libHSghci-9.0.1-ghc9.0.1.so
#23 0x0000000000000000 in ?? ()

(gdb) info sharedlibrary 
From                To                  Syms Read   Shared Object Library
0x00007ffff7fd0100  0x00007ffff7ff27c4  Yes (*)     /lib64/ld-linux-x86-64.so.2
0x00007ffff7ebd6f0  0x00007ffff7faab44  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../haskeline-0.8.1.0/libHShaskeline-0.8.1.0-ghc9.0.1.so
0x00007ffff47cda00  0x00007ffff77aa7d0  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../ghc-9.0.1/libHSghc-9.0.1-ghc9.0.1.so
0x00007ffff3255370  0x00007ffff326a742  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../terminfo-0.4.1.4/libHSterminfo-0.4.1.4-ghc9.0.1.so
0x00007ffff320aca0  0x00007ffff322bd57  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../process-1.6.11.0/libHSprocess-1.6.11.0-ghc9.0.1.so
0x00007ffff31d54d0  0x00007ffff31eadf0  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../hpc-0.6.1.0/libHShpc-0.6.1.0-ghc9.0.1.so
0x00007ffff3034020  0x00007ffff319672e  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../ghci-9.0.1/libHSghci-9.0.1-ghc9.0.1.so
0x00007ffff2f12d70  0x00007ffff2f494ec  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../ghc-heap-9.0.1/libHSghc-heap-9.0.1-ghc9.0.1.so
0x00007ffff2e69920  0x00007ffff2ec5f94  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../ghc-boot-9.0.1/libHSghc-boot-9.0.1-ghc9.0.1.so
0x00007ffff2d783d0  0x00007ffff2e01696  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../binary-0.8.8.0/libHSbinary-0.8.8.0-ghc9.0.1.so
0x00007ffff2d1df20  0x00007ffff2d388b5  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../exceptions-0.10.4/libHSexceptions-0.10.4-ghc9.0.1.so
0x00007ffff2ae0570  0x00007ffff2cbccef  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../template-haskell-2.17.0.0/libHStemplate-haskell-2.17.0.0-ghc9.0.1.so
0x00007ffff291cfd0  0x00007ffff294d426  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../pretty-1.1.3.6/libHSpretty-1.1.3.6-ghc9.0.1.so
0x00007ffff28c9240  0x00007ffff28d543b  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../ghc-boot-th-9.0.1/libHSghc-boot-th-9.0.1-ghc9.0.1.so
0x00007ffff2891e50  0x00007ffff289ae9b  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../stm-2.5.0.0/libHSstm-2.5.0.0-ghc9.0.1.so
0x00007ffff2865cb0  0x00007ffff287b46e  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../mtl-2.2.2/libHSmtl-2.2.2-ghc9.0.1.so
0x00007ffff27a6010  0x00007ffff283a816  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../transformers-0.5.6.2/libHStransformers-0.5.6.2-ghc9.0.1.so
0x00007ffff26d6bd0  0x00007ffff2704348  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../directory-1.3.6.1/libHSdirectory-1.3.6.1-ghc9.0.1.so
0x00007ffff26470f0  0x00007ffff268c0b5  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../unix-2.7.2.2/libHSunix-2.7.2.2-ghc9.0.1.so
0x00007ffff250c5d0  0x00007ffff25a850a  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../time-1.9.3/libHStime-1.9.3-ghc9.0.1.so
0x00007ffff2452640  0x00007ffff2462eb8  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../filepath-1.4.2.1/libHSfilepath-1.4.2.1-ghc9.0.1.so
0x00007ffff21a7d40  0x00007ffff24219a5  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../containers-0.6.4.1/libHScontainers-0.6.4.1-ghc9.0.1.so
0x00007ffff2040280  0x00007ffff20c4994  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../bytestring-0.10.12.1/libHSbytestring-0.10.12.1-ghc9.0.1.so
0x00007ffff1fd6bf0  0x00007ffff1fddb8f  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../deepseq-1.4.5.0/libHSdeepseq-1.4.5.0-ghc9.0.1.so
0x00007ffff1f6e690  0x00007ffff1fbeaae  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../array-0.5.4.0/libHSarray-0.5.4.0-ghc9.0.1.so
0x00007ffff1982a60  0x00007ffff1e7aa45  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../base-4.15.0.0/libHSbase-4.15.0.0-ghc9.0.1.so
0x00007ffff14ff8c0  0x00007ffff1529d25  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../ghc-bignum-1.0/libHSghc-bignum-1.0-ghc9.0.1.so
0x00007ffff13912d0  0x00007ffff1403cfa  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../ghc-prim-0.7.0/libHSghc-prim-0.7.0-ghc9.0.1.so
0x00007ffff0fd51e0  0x00007ffff101e9af  Yes         /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../rts/libHSrts_thr-ghc9.0.1.so
0x00007ffff0dacad0  0x00007ffff0db695e  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/bin/../rts/libffi.so.7
0x00007ffff0d5b6a0  0x00007ffff0d6917c  Yes (*)     /lib/x86_64-linux-gnu/libtinfo.so.6
0x00007ffff0d45720  0x00007ffff0d48d70  Yes         /lib/x86_64-linux-gnu/librt.so.1
0x00007ffff0d3c3e0  0x00007ffff0d3cd90  Yes         /lib/x86_64-linux-gnu/libutil.so.1
0x00007ffff0d36220  0x00007ffff0d37179  Yes         /lib/x86_64-linux-gnu/libdl.so.2
0x00007ffff0d19ae0  0x00007ffff0d29535  Yes         /lib/x86_64-linux-gnu/libpthread.so.0
0x00007ffff0c98240  0x00007ffff0cf7ea4  Yes (*)     /lib/x86_64-linux-gnu/libgmp.so.10
0x00007ffff0ac1630  0x00007ffff0c3620d  Yes         /lib/x86_64-linux-gnu/libc.so.6
0x00007ffff095c3c0  0x00007ffff0a02f18  Yes         /lib/x86_64-linux-gnu/libm.so.6
0x00007fffee205630  0x00007fffee37a21d  Yes (*)     /usr/x86_64-linux-gnu/lib/libc.so.6
0x00007fffee0a03c0  0x00007fffee146c18  Yes (*)     /usr/x86_64-linux-gnu/lib/libm.so.6
0x00007fffee03d1f0  0x00007fffee085254  Yes (*)     /home/washburn/.cabal/store/ghc-9.0.1/th-abstraction-0.4.2.0-97bfd77d8a680b19c286c078730c0f3ae84c5d9a6ac20db1acc36cdd9250e6d4/lib/libHSth-abstraction-0.4.2.0-97bfd77d8a680b19c286c078730c0f3ae84c5d9a6ac20db1acc36cdd9250e6d4-ghc9.0.1.so
0x00007ffff0d8dea0  0x00007ffff0d9f355  Yes (*)     /home/washburn/.cabal/store/ghc-9.0.1/th-lift-0.8.2-0fa84c263173fc179670fe14cfd1a7e9068a8c3619afca23dfafbdaecc45d44b/lib/libHSth-lift-0.8.2-0fa84c263173fc179670fe14cfd1a7e9068a8c3619afca23dfafbdaecc45d44b-ghc9.0.1.so
0x00007fffede44b60  0x00007fffedfd6042  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/text-1.2.4.1/libHStext-1.2.4.1-ghc9.0.1.so
0x00007fffeddbb210  0x00007fffeddbe843  Yes (*)     /home/washburn/.ghcup/ghc/9.0.1/lib/ghc-9.0.1/integer-gmp-1.1/libHSinteger-gmp-1.1-ghc9.0.1.so
0x00007fffedc99640  0x00007fffedd97926  Yes (*)     /home/washburn/.cabal/store/ghc-9.0.1/generic-deriving-1.14-60cf634e0d5e72a427899f654aec208994b91f68d01fb801568599238e6072e6/lib/libHSgeneric-deriving-1.14-60cf634e0d5e72a427899f654aec208994b91f68d01fb801568599238e6072e6-ghc9.0.1.so
0x00007fffedb2feb0  0x00007fffedb2ff69  Yes (*)     /home/washburn/.cabal/store/ghc-9.0.1/base-orphans-0.8.4-00945cc0f9895767f8fd9a48a68d740e1a1088160079b755366716e600485256/lib/libHSbase-orphans-0.8.4-00945cc0f9895767f8fd9a48a68d740e1a1088160079b755366716e600485256-ghc9.0.1.so
0x00007fffedb1bc80  0x00007fffedb2aab7  Yes (*)     /home/washburn/.cabal/store/ghc-9.0.1/tagged-0.8.6.1-f280ae38a699b5c2ec482ff18146bacc531c4624663244196dec426227de4dae/lib/libHStagged-0.8.6.1-f280ae38a699b5c2ec482ff18146bacc531c4624663244196dec426227de4dae-ghc9.0.1.so
0x00007fffedaf33a0  0x00007fffedafe2f9  Yes (*)     /home/washburn/.cabal/store/ghc-9.0.1/distributive-0.6.2.1-7d20135957dde5bf09d6d7e7030e23e92c4d7e87307becb2048e674f1505ac5d/lib/libHSdistributive-0.6.2.1-7d20135957dde5bf09d6d7e7030e23e92c4d7e87307becb2048e674f1505ac5d-ghc9.0.1.so
0x00007fffedab32d0  0x00007fffedadbe1e  Yes (*)     /home/washburn/.cabal/store/ghc-9.0.1/indexed-traversable-0.1.1-0b2d18636f864c0ee384dcaea4c371ccee81e17dbbe468747dc6fbafe2f6753b/lib/libHSindexed-traversable-0.1.1-0b2d18636f864c0ee384dcaea4c371ccee81e17dbbe468747dc6fbafe2f6753b-ghc9.0.1.so
0x00007fffeda66ec0  0x00007fffeda79862  Yes (*)     /home/washburn/.cabal/store/ghc-9.0.1/transformers-compat-0.7-19cc986b935dc400f3423c70e0b547772fa2100e9cbf61f0ec2e38cf6da95c8d/lib/libHStransformers-compat-0.7-19cc986b935dc400f3423c70e0b547772fa2100e9cbf61f0ec2e38cf6da95c8d-ghc9.0.1.so
0x00007fffeda146f0  0x00007fffeda30296  Yes (*)     /home/washburn/.cabal/store/ghc-9.0.1/comonad-5.0.8-e4f0d1210fae0f023ce197c714f24240bdc9fb44a461b35a86c0e31def775e32/lib/libHScomonad-5.0.8-e4f0d1210fae0f023ce197c714f24240bdc9fb44a461b35a86c0e31def775e32-ghc9.0.1.so
0x00007fffed9412c0  0x00007fffed9d2e4a  Yes (*)     /home/washburn/.cabal/store/ghc-9.0.1/bifunctors-5.5.11-c0bcf278d058388afcdcc136e9388a6d5e8b7a3165db0b1ad6e8d1c901cc150e/lib/libHSbifunctors-5.5.11-c0bcf278d058388afcdcc136e9388a6d5e8b7a3165db0b1ad6e8d1c901cc150e-ghc9.0.1.so
0x00007fffed8142f0  0x00007fffed865c19  Yes (*)     /home/washburn/.cabal/store/ghc-9.0.1/unix-2.8.0.0-8276f5e709556e7c8d723731fa61d5b2aa6e8eec36238b2069b2feb47d1ad590/lib/libHSunix-2.8.0.0-8276f5e709556e7c8d723731fa61d5b2aa6e8eec36238b2069b2feb47d1ad590-ghc9.0.1.so
0x00007fffed741720  0x00007fffed744d70  Yes (*)     /usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/../lib/librt.so
0x00007fffed73a3e0  0x00007fffed73ad90  Yes (*)     /usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/../lib/libutil.so
0x00007fffed734220  0x00007fffed735179  Yes (*)     /usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/../lib/libdl.so
0x00007fffed717ae0  0x00007fffed7274a5  Yes (*)     /usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/../lib/libpthread.so

The problem appears to be that the user's system has two versions of libthread.so available:

/usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/../lib/libpthread.so, and
/lib/x86_64-linux-gnu/libpthread.so.0

It's unclear how this came to be although the former appears to be an orphan file which dpkg knows nothing about. It's also unclear why we are trying to load the former and not the latter.

$ ldconfig -p | grep pthread
	libpthread.so.0 (libc6,x32   , OS ABI: Linux 3.4.0) => /libx32/libpthread.so.0
	libpthread.so.0 (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib/x86_64-linux-gnu/libpthread.so.0
	libpthread.so.0 (libc6       , OS ABI: Linux 3.2.0) => /lib/i386-linux-gnu/libpthread.so.0
	libpthread.so.0 (libc6       , OS ABI: Linux 3.2.0) => /lib32/libpthread.so.0
	libpthread.so   (libc6,x32   , OS ABI: Linux 3.4.0) => /libx32/libpthread.so
	libpthread.so   (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib/x86_64-linux-gnu/libpthread.so
	libpthread.so   (libc6       , OS ABI: Linux 3.2.0) => /lib32/libpthread.so
	libevent_pthreads-2.1.so.7 (libc6,x86-64) => /lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7

$ gcc --print-search-dirs
install: /usr/lib/gcc/x86_64-linux-gnu/9/
programs: =/usr/lib/gcc/x86_64-linux-gnu/9/:/usr/lib/gcc/x86_64-linux-gnu/9/:/usr/lib/gcc/x86_64-linux-gnu/:/usr/lib/gcc/x86_64-linux-gnu/9/:/usr/lib/gcc/x86_64-linux-gnu/:/usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/bin/x86_64-linux-gnu/9/:/usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/bin/x86_64-linux-gnu/:/usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/bin/
libraries: =/usr/lib/gcc/x86_64-linux-gnu/9/:/usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/x86_64-linux-gnu/9/:/usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/x86_64-linux-gnu/:/usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/../lib/:/usr/lib/gcc/x86_64-linux-gnu/9/../../../x86_64-linux-gnu/9/:/usr/lib/gcc/x86_64-linux-gnu/9/../../../x86_64-linux-gnu/:/usr/lib/gcc/x86_64-linux-gnu/9/../../../../lib/:/lib/x86_64-linux-gnu/9/:/lib/x86_64-linux-gnu/:/lib/../lib/:/usr/lib/x86_64-linux-gnu/9/:/usr/lib/x86_64-linux-gnu/:/usr/lib/../lib/:/usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/:/usr/lib/gcc/x86_64-linux-gnu/9/../../../:/lib/:/usr/lib/

$ ls -l /usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/../lib/libpthread*
-rwxr-xr-x 1 root root  154000 Dec 16  2020 /usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/../lib/libpthread-2.31.so
-rw-r--r-- 1 root root 6594596 Dec 16  2020 /usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/../lib/libpthread.a
lrwxrwxrwx 1 root root      15 Dec 16  2020 /usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/../lib/libpthread.so -> libpthread.so.0
lrwxrwxrwx 1 root root      18 Dec 16  2020 /usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/lib/../lib/libpthread.so.0 -> libpthread-2.31.so

libpthread.tar.gz

The root cause of the problem was a set of errant libpthread shared objects which GHC somehow located and tried to load. The fact that these objects weren't loaded by the system linker and yet were loaded by GHC is arguably a bug. I asked @recursion-ninja to tar up the errant libpthread objects such that I can try to reproduce this situation locally and test a fix.

Downgrading to Plow due to the very low number of impacted users.

added Plow label and removed Phighest label

Stack smashing occurs when building some packages

Summary

Steps to reproduce

Expected behavior

Environment

Child items 0

Activity