-fPIC produces un-share-able X86_64 relocations
Summary
x86_64 (cross)compiler with -fPIC produces R_X86_64_PC32 relocations that don't work for ld -shared.
That's required on the Haiku platform: executables must be linked with -shared. I know nothing about this, but ...
- only some
R_X86_64_PC32relocations fail, while others that appear in objdump -r output seem to be normal. - some of the offending symbols appear in assembler output:
leaq base_DataziTuple_swap_closure(%rip),%rbx
- the working native C compiler writes this to load a function address, producing an acceptable
R_X86_64_REX_GOTPCRELXrelocation:movq testfunction@GOTPCREL(%rip), %raxmovq %rax, %rdi
Steps to reproduce
link compiled files with features like base_DataziTuple_swap_closure, on ELF platform, with collect2/ld -shared option.
Expected behavior
ld: Tuple.o: relocation R_X86_64_PC32 against symbol `base_DataziTuple_swap_closure' can not be used when making a shared object; recompile with -fPIC
ld: final link failed: bad value8.6.3 stage1 cross compiler, built and running on i386; as far as I'm able to get 8.8.1, it generates the same code, so I expect it to have the same problem if I can compile it.
Environment
- GHC version used: 8.6.3
Optional:
- Operating System: Haiku
- System Architecture: i386 / x86_64
Activity
added needs triage label
added Pnormal Tbug cross-compilation linking labels and removed needs triage label
added info needed label
GCC 7.3.0
I checked "as", many options, but nothing about PIC, pic, position, etc.
This is what I could make out of what I read in online discussions of this matter. If you produce that assembly language, on X86_64 ELF, it won't be share-able - not because you forgot to ask the assembler to do it, it's the code that does it. Compilers produce different code for -fPIC. If they do it right, it works, and the assembled output is share-able. That is about as much as I know, and "know" is of course stretching it. I did go so far as to write some simple C and change the @GOTPCREL part to more like what GHC does, with same result - ld fails. If you contrive to load with ld -shared, I expect you will find the same, on X86_64 ELF.
I do wonder whether this is due to our assumption of a small memory model on x86-64, even when compiling with
-fPIC(at least I believe this is the assumption; @simonmar, is this your understanding as well?)-
For the record, the following is sufficient to reproduce this:
$ cat hi.hs import Data.Tuple main = print $ swap (4,5) $ _build/stage1/bin/ghc -O0 hi.hs -optl-shared -dynamic -fPIC Linking hi ... /nix/store/zizh5qzhcn4wzm06z99297ckalwrrpfk-binutils-2.31.1/bin/ld: hi.o: relocation R_X86_64_PC32 against symbol `Main_main_closure' can not be used when making a shared object; recompile with -fPIC /nix/store/zizh5qzhcn4wzm06z99297ckalwrrpfk-binutils-2.31.1/bin/ld: final link failed: bad value collect2: error: ld returned 1 exit status `cc' failed in phase `Linker'. (Exit code: 1)Edited by Ben Gamari -
Oh, but perhaps this is a red-herring: that error complains about
Main_main_closure, notswap. Moreover, using GHC's-sharedflag works as expected:$ _build/stage1/bin/ghc -fforce-recomp -O0 hi.hs -shared -dynamic(where I used
-dynamichere to ensure we link against libraries (e.g.base) which was built with-fPIC. -
@trac-donn, can you write down precisely how to reproduce this? e.g., how are you building your cross-compiler? What test program are you compiling?
Here's how the ghc-stage1 compiler build was configured.
-- -- number of usual patches, among which only this one might be relevant, in compiler.main.DriverPipeline.hs: joinObjectFiles ld_r, I add SysTools.Option "-r" to the SysTools.runLink options list. Have always needed this on Haiku. -- build.mk (where different from build.mk.sample): BUILD_PROF_LIBS = NO HADDOCK_DOCS = NO BUILD_SPHINX_HTML = NO BUILD_SPHINX_PDF = NO BUILD_MAN = NO WITH_TERMINFO = NO INTEGER_LIBRARY = integer-simple -- config.mk: DYNAMIC_GHC_PROGRAMS = NO DYNAMIC_TOO=NO [ deconfigure GhcLibWays p ] SRC_HC_OPTS_STAGE1 = -fPIC -> configure --target=x86_64.unknown.haiku -- project.mk excerpts: HOSTPLATFORM = i386-unknown-haiku TARGETPLATFORM = x86_64-unknown-haiku BUILDPLATFORM = i386-unknown-haiku HostPlatform_CPP = i386_unknown_haiku HostArch_CPP = i386 HostOS_CPP = haiku HostVendor_CPP = unknown TargetPlatform_CPP = x86_64_unknown_haiku TargetArch_CPP = x86_64 TargetOS_CPP = haiku TargetVendor_CPP = unknown LLVMTarget_CPP = x86_64-unknown-haiku BuildPlatform_CPP = i386_unknown_haiku BuildArch_CPP = i386 BuildOS_CPP = haiku BuildVendor_CPP = unknown ... CC_LLVM_BACKEND = 0 CC_CLANG_BACKEND = 0 ----The build fails when ghc-stage1 tries to link hsc2hs, with this error:
/boot/home/haiku64/boot/system/develop/tools/bin/../lib/gcc/x86_64-unknown-haiku/8.3.0/../../../../x86_64-unknown-haiku/bin/ld.bfd: utils/hsc2hs/dist-install/build/Main.o: relocation R_X86_64_PC32 against symbol `ghczmprim_GHCziTypes_False_closure' can not be used when making a shared object; recompile with -fPICThe apparently relevant assembly, from objdump:
2f: R_X86_64_REX_GOTPCRELX ghczmprim_GHCziTypes_False_closure-0x3 33: 48 89 c7 mov %rax,%rdi 36: 4c 89 f6 mov %r14,%rsi 39: 48 8b 05 00 00 00 00 mov 0x0(%rip),%rax # 40 <r94U_info+0x2 ... and 2f: R_X86_64_REX_GOTPCRELX ghczmprim_GHCziTypes_False_closure-0x4 33: 48 89 c7 mov %rax,%rdi 36: 48 8d 35 00 00 00 00 lea 0x0(%rip),%rsi # 3d <r952_info+0x25>I make no pretense of understanding what I see here. After that, I went to the x86_64 host and made some experiments on simple native compiled C, which I have presented above as evidence that this is the outcome of the instructions produced by the compiler, - mov vs. lea, the symbol@GOTPCREL notation etc.; here presumably the mov %rax,%rdi / lea 0x0(%rip),%rsi that appears in the objdump assembly.
Edited by Ben Gamari-
in compiler.main.DriverPipeline.hs: joinObjectFiles ld_r, I add SysTools.Option "-r" to the SysTools.runLink options list.
I'm confused by this. Is this to say that the
-Wl,-ralready in this list is not sufficient?I'm surprised that adding
-reven works since this would be passed togccwhich, as far as I can tell, does not support this flag.
It has been going on here for several years, going back at least to GHC 7.4.2, and the other occasional Haiku effort for GHC does this also. But naturally I don't remember the details. If it seems like this might be an obstacle, I can try to build GHC without this edit and report what happens. I think it's clear enough though that it would have no effect on code generation?
mentioned in issue #20196
Well, coming back to this again. I managed to compile an unregisterised GHC for Haiku x86_64, but building GHC on Haiku itself, the same as when cross-compiling, is generating the same issue.
Looking in detail, the problem appears to be with the data tables GHC seems to generate, as described in
cmm/CLabel.hs, e.g. the "Static closure" and "Dynamic Constructor info table", probably a few others.I am currently using 8.6.5, as building a cross-compiled GHC still worked reliably then, but the error has remained in newer versions of GHC when cross-compiling.
Interestingly, the stage1 compiler runs fine, but building the stage2 compiler fails.
This is basically the commands being run that fail: https://gist.github.com/jessicah/b53437990c19dabfd7d97fefd7e3fec1
My unregisterised cross-compiler for x86_64 is available at https://github.com/jessicah/haiku-ghc.
Well, I should be more correct, GHC builds the stage1 compiler, but it can't produce correct code for Haiku.
Simple example file:
main :: IO () main = putStrLn "Hello, World!"Invocation
$ inplace/bin/ghc-stage1 -keep-tmp-files -v ../hello.hs Glasgow Haskell Compiler, Version 8.6.5, stage 1 booted by GHC version 8.6.5 Using binary package database: /Development/ghc/sources/inplace/lib/package.conf.d/package.cache package flags [] loading package database /Development/ghc/sources/inplace/lib/package.conf.d wired-in package ghc-prim mapped to ghc-prim-0.5.3 wired-in package integer-gmp mapped to integer-gmp-1.0.2.0 wired-in package base mapped to base-4.12.0.0 wired-in package rts mapped to rts wired-in package template-haskell mapped to template-haskell-2.14.0.0 wired-in package ghc mapped to ghc-8.6.5 package flags [] loading package database /Development/ghc/sources/inplace/lib/package.conf.d wired-in package ghc-prim mapped to ghc-prim-0.5.3 wired-in package integer-gmp mapped to integer-gmp-1.0.2.0 wired-in package base mapped to base-4.12.0.0 wired-in package rts mapped to rts-1.0 wired-in package template-haskell mapped to template-haskell-2.14.0.0 wired-in package ghc mapped to ghc-8.6.5 *** Chasing dependencies: Chasing modules from: *../hello.hs !!! Chasing dependencies: finished in 2.06 milliseconds, allocated 0.242 megabytes Stable obj: [] Stable BCO: [] Ready for upsweep [NONREC ModSummary { ms_hs_date = 2023-05-22 22:39:53.95551488 UTC ms_mod = Main, ms_textual_imps = [(Nothing, Prelude)] ms_srcimps = [] }] compile: input file ../hello.hs *** Checking old interface for Main (use -ddump-hi-diffs for more details): [1 of 1] Compiling Main ( ../hello.hs, ../hello.o ) *** Parser [Main]: !!! Parser [Main]: finished in 0.88 milliseconds, allocated 0.083 megabytes *** Renamer/typechecker [Main]: !!! Renamer/typechecker [Main]: finished in 85.74 milliseconds, allocated 14.940 megabytes *** Desugar [Main]: Result size of Desugar (before optimization) = {terms: 13, types: 6, coercions: 0, joins: 0/0} Result size of Desugar (after optimization) = {terms: 13, types: 6, coercions: 0, joins: 0/0} !!! Desugar [Main]: finished in 3.83 milliseconds, allocated 0.249 megabytes *** Simplifier [Main]: Result size of Simplifier iteration=1 = {terms: 21, types: 10, coercions: 0, joins: 0/0} Result size of Simplifier = {terms: 21, types: 10, coercions: 0, joins: 0/0} !!! Simplifier [Main]: finished in 2.70 milliseconds, allocated 0.214 megabytes *** CoreTidy [Main]: Result size of Tidy Core = {terms: 21, types: 10, coercions: 0, joins: 0/0} !!! CoreTidy [Main]: finished in 6.75 milliseconds, allocated 1.834 megabytes writeBinIface: 2 Names writeBinIface: 18 dict entries Created temporary directory: /tmp/ghc359994_0 *** CorePrep [Main]: Result size of CorePrep = {terms: 23, types: 11, coercions: 0, joins: 0/0} !!! CorePrep [Main]: finished in 1.19 milliseconds, allocated 0.071 megabytes *** Stg2Stg: *** CodeGen [Main]: !!! CodeGen [Main]: finished in 11.59 milliseconds, allocated 1.365 megabytes *** Assembler: gcc -fno-stack-protector -iquote.. -no-pie -fPIC -U__PIC__ -D__PIC__ -x assembler -c /tmp/ghc359994_0/ghc_2.s -o ../hello.o Upsweep completely successful. link: linkables are ... LinkableM (2023-05-22 22:45:28.243531776 UTC) Main [DotO ../hello.o] Linking ../hello ... *** C Compiler: gcc -fno-stack-protector -c /tmp/ghc359994_0/ghc_4.c -o /tmp/ghc359994_0/ghc_5.o -no-pie -fPIC -U__PIC__ -D__PIC__ -I/Development/ghc/sources/rts/dist/build -I/Development/ghc/sources/includes -I/Development/ghc/sources/includes/dist-derivedconstants/header *** C Compiler: gcc -fno-stack-protector -c /tmp/ghc359994_0/ghc_7.s -o /tmp/ghc359994_0/ghc_8.o *** Linker: gcc -fno-stack-protector '-fuse-ld=bfd' '-Wl,--hash-size=31' -Wl,--reduce-memory-overheads -Wl,--no-as-needed -o ../hello -lm -no-pie -fPIC -U__PIC__ -D__PIC__ -Wl,--gc-sections ../hello.o -L/Development/ghc/sources/libraries/base/dist-install/build -L/Development/ghc/sources/libraries/integer-gmp/dist-install/build -L/Development/ghc/sources/libraries/ghc-prim/dist-install/build -L/Development/ghc/sources/rts/dist/build /tmp/ghc359994_0/ghc_5.o /tmp/ghc359994_0/ghc_8.o -Wl,-u,base_GHCziTopHandler_runIO_closure -Wl,-u,base_GHCziTopHandler_runNonIO_closure -Wl,-u,ghczmprim_GHCziTuple_Z0T_closure -Wl,-u,ghczmprim_GHCziTypes_True_closure -Wl,-u,ghczmprim_GHCziTypes_False_closure -Wl,-u,base_GHCziPack_unpackCString_closure -Wl,-u,base_GHCziWeak_runFinalizzerBatch_closure -Wl,-u,base_GHCziIOziException_stackOverflow_closure -Wl,-u,base_GHCziIOziException_heapOverflow_closure -Wl,-u,base_GHCziIOziException_allocationLimitExceeded_closure -Wl,-u,base_GHCziIOziException_blockedIndefinitelyOnMVar_closure -Wl,-u,base_GHCziIOziException_blockedIndefinitelyOnSTM_closure -Wl,-u,base_GHCziIOziException_cannotCompactFunction_closure -Wl,-u,base_GHCziIOziException_cannotCompactPinned_closure -Wl,-u,base_GHCziIOziException_cannotCompactMutable_closure -Wl,-u,base_ControlziExceptionziBase_absentSumFieldError_closure -Wl,-u,base_ControlziExceptionziBase_nonTermination_closure -Wl,-u,base_ControlziExceptionziBase_nestedAtomically_closure -Wl,-u,base_GHCziEventziThread_blockedOnBadFD_closure -Wl,-u,base_GHCziConcziSync_runSparks_closure -Wl,-u,base_GHCziConcziIO_ensureIOManagerIsRunning_closure -Wl,-u,base_GHCziConcziIO_ioManagerCapabilitiesChanged_closure -Wl,-u,base_GHCziConcziSignal_runHandlersPtr_closure -Wl,-u,base_GHCziTopHandler_flushStdHandles_closure -Wl,-u,base_GHCziTopHandler_runMainIO_closure -Wl,-u,ghczmprim_GHCziTypes_Czh_con_info -Wl,-u,ghczmprim_GHCziTypes_Izh_con_info -Wl,-u,ghczmprim_GHCziTypes_Fzh_con_info -Wl,-u,ghczmprim_GHCziTypes_Dzh_con_info -Wl,-u,ghczmprim_GHCziTypes_Wzh_con_info -Wl,-u,base_GHCziPtr_Ptr_con_info -Wl,-u,base_GHCziPtr_FunPtr_con_info -Wl,-u,base_GHCziInt_I8zh_con_info -Wl,-u,base_GHCziInt_I16zh_con_info -Wl,-u,base_GHCziInt_I32zh_con_info -Wl,-u,base_GHCziInt_I64zh_con_info -Wl,-u,base_GHCziWord_W8zh_con_info -Wl,-u,base_GHCziWord_W16zh_con_info -Wl,-u,base_GHCziWord_W32zh_con_info -Wl,-u,base_GHCziWord_W64zh_con_info -Wl,-u,base_GHCziStable_StablePtr_con_info -Wl,-u,hs_atomic_add8 -Wl,-u,hs_atomic_add16 -Wl,-u,hs_atomic_add32 -Wl,-u,hs_atomic_add64 -Wl,-u,hs_atomic_sub8 -Wl,-u,hs_atomic_sub16 -Wl,-u,hs_atomic_sub32 -Wl,-u,hs_atomic_sub64 -Wl,-u,hs_atomic_and8 -Wl,-u,hs_atomic_and16 -Wl,-u,hs_atomic_and32 -Wl,-u,hs_atomic_and64 -Wl,-u,hs_atomic_nand8 -Wl,-u,hs_atomic_nand16 -Wl,-u,hs_atomic_nand32 -Wl,-u,hs_atomic_nand64 -Wl,-u,hs_atomic_or8 -Wl,-u,hs_atomic_or16 -Wl,-u,hs_atomic_or32 -Wl,-u,hs_atomic_or64 -Wl,-u,hs_atomic_xor8 -Wl,-u,hs_atomic_xor16 -Wl,-u,hs_atomic_xor32 -Wl,-u,hs_atomic_xor64 -Wl,-u,hs_cmpxchg8 -Wl,-u,hs_cmpxchg16 -Wl,-u,hs_cmpxchg32 -Wl,-u,hs_cmpxchg64 -Wl,-u,hs_atomicread8 -Wl,-u,hs_atomicread16 -Wl,-u,hs_atomicread32 -Wl,-u,hs_atomicread64 -Wl,-u,hs_atomicwrite8 -Wl,-u,hs_atomicwrite16 -Wl,-u,hs_atomicwrite32 -Wl,-u,hs_atomicwrite64 -lHSbase-4.12.0.0 -lHSinteger-gmp-1.0.2.0 -lHSghc-prim-0.5.3 -lHSrts -lCffi -liconv -lgmp -lm /boot/system/develop/tools/bin/../lib/gcc/x86_64-unknown-haiku/11.2.0/../../../../x86_64-unknown-haiku/bin/ld.bfd: ../hello.o: relocation R_X86_64_PC32 against symbol stg_bh_upd_frame_info' can not be used when making a shared object; recompile with -fPIC /boot/system/develop/tools/bin/../lib/gcc/x86_64-unknown-haiku/11.2.0/../../../../x86_64-unknown-haiku/bin/ld.bfd: final link failed: bad value collect2: error: ld returned 1 exit status gcc' failed in phase `Linker'. (Exit code: 1)Temporary files:
1.s
.section .rodata.str,"aMS",@progbits,1 .align 1 .align 1 c1tV_str: .asciz "Hello, World!" .section .text .align 8 s1tO_entry: .Lc1tW: leaq -16(%rbp),%rax cmpq %r15,%rax jb .Lc1tX .Lc1tY: subq $8,%rsp movq %r13,%rax movq %rbx,%rsi movq %rax,%rdi xorl %eax,%eax call newCAF@plt addq $8,%rsp testq %rax,%rax je .Lc1tU .Lc1tT: leaq stg_bh_upd_frame_info(%rip),%rbx movq %rbx,-16(%rbp) movq %rax,-8(%rbp) leaq c1tV_str(%rip),%r14 leaq ghczmprim_GHCziCString_unpackCStringzh_closure(%rip),%rbx addq $-16,%rbp jmp stg_ap_n_fast .Lc1tU: movq (%rbx),%rax jmp *(%rax) .Lc1tX: jmp *-16(%r13) .size s1tO_entry, .-s1tO_entry .section .data.rel.ro .align 8 .align 1 s1tO_info: .quad s1tO_entry .quad 0 .long 21 .long 1 .quad ghczmprim_GHCziCString_unpackCStringzh_closure .section .data .align 8 .align 1 s1tO_closure: .quad s1tO_info .quad 0 .quad 0 .quad 0 .section .data .align 8 .align 1 u1ui_srt: .quad stg_SRT_2_info .quad base_SystemziIO_putStrLn_closure .quad s1tO_closure .quad 0 .section .text .align 8 .globl Main_main_entry .type Main_main_entry, @object Main_main_entry: .Lc1uf: leaq -16(%rbp),%rax cmpq %r15,%rax jb .Lc1ug .Lc1uh: subq $8,%rsp movq %r13,%rax movq %rbx,%rsi movq %rax,%rdi xorl %eax,%eax call newCAF@plt addq $8,%rsp testq %rax,%rax je .Lc1ue .Lc1ud: leaq stg_bh_upd_frame_info(%rip),%rbx movq %rbx,-16(%rbp) movq %rax,-8(%rbp) leaq s1tO_closure(%rip),%r14 leaq base_SystemziIO_putStrLn_closure(%rip),%rbx addq $-16,%rbp jmp stg_ap_p_fast .Lc1ue: movq (%rbx),%rax jmp *(%rax) .Lc1ug: jmp *-16(%r13) .size Main_main_entry, .-Main_main_entry .section .data.rel.ro .align 8 .align 1 .globl Main_main_info .type Main_main_info, @object Main_main_info: .quad Main_main_entry .quad 0 .long 21 .long 1 .quad u1ui_srt .section .data .align 8 .align 1 .globl Main_main_closure .type Main_main_closure, @object Main_main_closure: .quad Main_main_info .quad 0 .quad 0 .quad 0 .section .data .align 8 .align 1 u1uB_srt: .quad stg_SRT_2_info .quad base_GHCziTopHandler_runMainIO_closure .quad Main_main_closure .quad 0 .section .text .align 8 .globl ZCMain_main_entry .type ZCMain_main_entry, @object ZCMain_main_entry: .Lc1uy: leaq -16(%rbp),%rax cmpq %r15,%rax jb .Lc1uz .Lc1uA: subq $8,%rsp movq %r13,%rax movq %rbx,%rsi movq %rax,%rdi xorl %eax,%eax call newCAF@plt addq $8,%rsp testq %rax,%rax je .Lc1ux .Lc1uw: leaq stg_bh_upd_frame_info(%rip),%rbx movq %rbx,-16(%rbp) movq %rax,-8(%rbp) leaq Main_main_closure(%rip),%r14 leaq base_GHCziTopHandler_runMainIO_closure(%rip),%rbx addq $-16,%rbp jmp stg_ap_p_fast .Lc1ux: movq (%rbx),%rax jmp *(%rax) .Lc1uz: jmp *-16(%r13) .size ZCMain_main_entry, .-ZCMain_main_entry .section .data.rel.ro .align 8 .align 1 .globl ZCMain_main_info .type ZCMain_main_info, @object ZCMain_main_info: .quad ZCMain_main_entry .quad 0 .long 21 .long 1 .quad u1uB_srt .section .data .align 8 .align 1 .globl ZCMain_main_closure .type ZCMain_main_closure, @object ZCMain_main_closure: .quad ZCMain_main_info .quad 0 .quad 0 .quad 0 .section .rodata.str,"aMS",@progbits,1 .align 1 .align 1 r1gX_bytes: .asciz "main" .section .data .align 8 .align 1 r1hf_closure: .quad ghczmprim_GHCziTypes_TrNameS_con_info .quad r1gX_bytes .section .rodata.str,"aMS",@progbits,1 .align 1 .align 1 r1hg_bytes: .asciz "Main" .section .data .align 8 .align 1 r1hh_closure: .quad ghczmprim_GHCziTypes_TrNameS_con_info .quad r1hg_bytes .section .data .align 8 .align 1 .globl Main_zdtrModule_closure .type Main_zdtrModule_closure, @object Main_zdtrModule_closure: .quad ghczmprim_GHCziTypes_Module_con_info .quad r1hf_closure+1 .quad r1hh_closure+1 .quad 3 .section .note.GNU-stack,"",@progbits .ident "GHC 8.6.5"2.c
``` #include "Rts.h" extern StgClosure ZCMain_main_closure; int main(int argc, char *argv[]) { RtsConfig __conf = defaultRtsConfig; __conf.rts_opts_enabled = RtsOptsSafeOnly; __conf.rts_opts_suggestions = true; __conf.rts_hs_main = true; return hs_main(argc,argv,&ZCMain_main_closure,__conf); }objdump -D 3.o
Disassembly of section .text: 0000000000000000 : 0: 55 push %rbp 1: 48 89 e5 mov %rsp,%rbp 4: 53 push %rbx 5: 48 81 ec 88 00 00 00 sub $0x88,%rsp c: 89 bd 7c ff ff ff mov %edi,-0x84(%rbp) 12: 48 89 b5 70 ff ff ff mov %rsi,-0x90(%rbp) 19: 48 8b 05 00 00 00 00 mov 0x0(%rip),%rax # 20 <main+0x20> 20: 48 8b 08 mov (%rax),%rcx 23: 48 8b 58 08 mov 0x8(%rax),%rbx 27: 48 89 4d 80 mov %rcx,-0x80(%rbp) 2b: 48 89 5d 88 mov %rbx,-0x78(%rbp) 2f: 48 8b 48 10 mov 0x10(%rax),%rcx 33: 48 8b 58 18 mov 0x18(%rax),%rbx 37: 48 89 4d 90 mov %rcx,-0x70(%rbp) 3b: 48 89 5d 98 mov %rbx,-0x68(%rbp) 3f: 48 8b 48 20 mov 0x20(%rax),%rcx 43: 48 8b 58 28 mov 0x28(%rax),%rbx 47: 48 89 4d a0 mov %rcx,-0x60(%rbp) 4b: 48 89 5d a8 mov %rbx,-0x58(%rbp) 4f: 48 8b 48 30 mov 0x30(%rax),%rcx 53: 48 8b 58 38 mov 0x38(%rax),%rbx 57: 48 89 4d b0 mov %rcx,-0x50(%rbp) 5b: 48 89 5d b8 mov %rbx,-0x48(%rbp) 5f: 48 8b 48 40 mov 0x40(%rax),%rcx 63: 48 8b 58 48 mov 0x48(%rax),%rbx 67: 48 89 4d c0 mov %rcx,-0x40(%rbp) 6b: 48 89 5d c8 mov %rbx,-0x38(%rbp) 6f: 48 8b 48 50 mov 0x50(%rax),%rcx 73: 48 8b 58 58 mov 0x58(%rax),%rbx 77: 48 89 4d d0 mov %rcx,-0x30(%rbp) 7b: 48 89 5d d8 mov %rbx,-0x28(%rbp) 7f: 48 8b 50 68 mov 0x68(%rax),%rdx 83: 48 8b 40 60 mov 0x60(%rax),%rax 87: 48 89 45 e0 mov %rax,-0x20(%rbp) 8b: 48 89 55 e8 mov %rdx,-0x18(%rbp) 8f: c7 45 80 03 00 00 00 movl $0x3,-0x80(%rbp) 96: 48 c7 45 88 01 00 00 movq $0x1,-0x78(%rbp) 9d: 00 9e: 48 c7 45 98 01 00 00 movq $0x1,-0x68(%rbp) a5: 00 a6: 48 8b 8d 70 ff ff ff mov -0x90(%rbp),%rcx ad: 8b 85 7c ff ff ff mov -0x84(%rbp),%eax b3: ff 75 e8 push -0x18(%rbp) b6: ff 75 e0 push -0x20(%rbp) b9: ff 75 d8 push -0x28(%rbp) bc: ff 75 d0 push -0x30(%rbp) bf: ff 75 c8 push -0x38(%rbp) c2: ff 75 c0 push -0x40(%rbp) c5: ff 75 b8 push -0x48(%rbp) c8: ff 75 b0 push -0x50(%rbp) cb: ff 75 a8 push -0x58(%rbp) ce: ff 75 a0 push -0x60(%rbp) d1: ff 75 98 push -0x68(%rbp) d4: ff 75 90 push -0x70(%rbp) d7: ff 75 88 push -0x78(%rbp) da: ff 75 80 push -0x80(%rbp) dd: 48 8b 15 00 00 00 00 mov 0x0(%rip),%rdx # e4 <main+0xe4> e4: 48 89 ce mov %rcx,%rsi e7: 89 c7 mov %eax,%edi e9: e8 00 00 00 00 call ee <main+0xee> Disassembly of section .comment: 0000000000000000 <.comment>: 0: 00 47 43 add %al,0x43(%rdi) 3: 43 3a 20 rex.XB cmp (%r8),%spl 6: 28 32 sub %dh,(%rdx) 8: 30 32 xor %dh,(%rdx) a: 31 5f 30 xor %ebx,0x30(%rdi) d: 37 (bad) e: 5f pop %rdi f: 32 38 xor (%rax),%bh 11: 29 20 sub %esp,(%rax) 13: 31 31 xor %esi,(%rcx) 15: 2e 32 2e cs xor (%rsi),%ch 18: 30 00 xor %al,(%rax) Disassembly of section .eh_frame: 0000000000000000 <.eh_frame>: 0: 14 00 adc $0x0,%al 2: 00 00 add %al,(%rax) 4: 00 00 add %al,(%rax) 6: 00 00 add %al,(%rax) 8: 01 7a 52 add %edi,0x52(%rdx) b: 00 01 add %al,(%rcx) d: 78 10 js 1f <.eh_frame+0x1f> f: 01 1b add %ebx,(%rbx) 11: 0c 07 or $0x7,%al 13: 08 90 01 00 00 1c or %dl,0x1c000001(%rax) 19: 00 00 add %al,(%rax) 1b: 00 1c 00 add %bl,(%rax,%rax,1) 1e: 00 00 add %al,(%rax) 20: 00 00 add %al,(%rax) 22: 00 00 add %al,(%rax) 24: ee out %al,(%dx) 25: 00 00 add %al,(%rax) 27: 00 00 add %al,(%rax) 29: 41 0e rex.B (bad) 2b: 10 86 02 43 0d 06 adc %al,0x60d4302(%rsi) 31: 48 83 03 00 addq $0x0,(%rbx) 35: 00 00 add %al,(%rax) ...4.rsp
"-fno-stack-protector" "-c" "/tmp/ghc359994_0/ghc_4.c" "-o" "/tmp/ghc359994_0/ghc_5.o" "-no-pie" "-fPIC" "-U__PIC__" "-D__PIC__" "-I/Development/ghc/sources/rts/dist/build" "-I/Development/ghc/sources/includes" "-I/Development/ghc/sources/includes/dist-derivedconstants/header"5.2
.section .debug-ghc-link-info,"",@note .int 14 .int 3072 .int 0 .asciz "GHC link info" .align 4 .ascii "(([\"-lHSbase-4.12.0.0\",\"-lHSinteger-gmp-1.0.2.0\",\"-lHSghc-prim-0.5.3\",\"-lHSrts\",\"-lCffi\"],[\"-liconv\",\"-lgmp\",\"-lm\"],[\"-Wl,-u,base_GHCziTopHandler_runIO_closure\",\"-Wl,-u,base_GHCziTopHandler_runNonIO_closure\",\"-Wl,-u,ghczmprim_GHCziTuple_Z0T_closure\",\"-Wl,-u,ghczmprim_GHCziTypes_True_closure\",\"-Wl,-u,ghczmprim_GHCziTypes_False_closure\",\"-Wl,-u,base_GHCziPack_unpackCString_closure\",\"-Wl,-u,base_GHCziWeak_runFinalizzerBatch_closure\",\"-Wl,-u,base_GHCziIOziException_stackOverflow_closure\",\"-Wl,-u,base_GHCziIOziException_heapOverflow_closure\",\"-Wl,-u,base_GHCziIOziException_allocationLimitExceeded_closure\",\"-Wl,-u,base_GHCziIOziException_blockedIndefinitelyOnMVar_closure\",\"-Wl,-u,base_GHCziIOziException_blockedIndefinitelyOnSTM_closure\",\"-Wl,-u,base_GHCziIOziException_cannotCompactFunction_closure\",\"-Wl,-u,base_GHCziIOziException_cannotCompactPinned_closure\",\"-Wl,-u,base_GHCziIOziException_cannotCompactMutable_closure\",\"-Wl,-u,base_ControlziExceptionziBase_absentSumFieldError_closure\",\"-Wl,-u,base_ControlziExceptionziBase_nonTermination_closure\",\"-Wl,-u,base_ControlziExceptionziBase_nestedAtomically_closure\",\"-Wl,-u,base_GHCziEventziThread_blockedOnBadFD_closure\",\"-Wl,-u,base_GHCziConcziSync_runSparks_closure\",\"-Wl,-u,base_GHCziConcziIO_ensureIOManagerIsRunning_closure\",\"-Wl,-u,base_GHCziConcziIO_ioManagerCapabilitiesChanged_closure\",\"-Wl,-u,base_GHCziConcziSignal_runHandlersPtr_closure\",\"-Wl,-u,base_GHCziTopHandler_flushStdHandles_closure\",\"-Wl,-u,base_GHCziTopHandler_runMainIO_closure\",\"-Wl,-u,ghczmprim_GHCziTypes_Czh_con_info\",\"-Wl,-u,ghczmprim_GHCziTypes_Izh_con_info\",\"-Wl,-u,ghczmprim_GHCziTypes_Fzh_con_info\",\"-Wl,-u,ghczmprim_GHCziTypes_Dzh_con_info\",\"-Wl,-u,ghczmprim_GHCziTypes_Wzh_con_info\",\"-Wl,-u,base_GHCziPtr_Ptr_con_info\",\"-Wl,-u,base_GHCziPtr_FunPtr_con_info\",\"-Wl,-u,base_GHCziInt_I8zh_con_info\",\"-Wl,-u,base_GHCziInt_I16zh_con_info\",\"-Wl,-u,base_GHCziInt_I32zh_con_info\",\"-Wl,-u,base_GHCziInt_I64zh_con_info\",\"-Wl,-u,base_GHCziWord_W8zh_con_info\",\"-Wl,-u,base_GHCziWord_W16zh_con_info\",\"-Wl,-u,base_GHCziWord_W32zh_con_info\",\"-Wl,-u,base_GHCziWord_W64zh_con_info\",\"-Wl,-u,base_GHCziStable_StablePtr_con_info\",\"-Wl,-u,hs_atomic_add8\",\"-Wl,-u,hs_atomic_add16\",\"-Wl,-u,hs_atomic_add32\",\"-Wl,-u,hs_atomic_add64\",\"-Wl,-u,hs_atomic_sub8\",\"-Wl,-u,hs_atomic_sub16\",\"-Wl,-u,hs_atomic_sub32\",\"-Wl,-u,hs_atomic_sub64\",\"-Wl,-u,hs_atomic_and8\",\"-Wl,-u,hs_atomic_and16\",\"-Wl,-u,hs_atomic_and32\",\"-Wl,-u,hs_atomic_and64\",\"-Wl,-u,hs_atomic_nand8\",\"-Wl,-u,hs_atomic_nand16\",\"-Wl,-u,hs_atomic_nand32\",\"-Wl,-u,hs_atomic_nand64\",\"-Wl,-u,hs_atomic_or8\",\"-Wl,-u,hs_atomic_or16\",\"-Wl,-u,hs_atomic_or32\",\"-Wl,-u,hs_atomic_or64\",\"-Wl,-u,hs_atomic_xor8\",\"-Wl,-u,hs_atomic_xor16\",\"-Wl,-u,hs_atomic_xor32\",\"-Wl,-u,hs_atomic_xor64\",\"-Wl,-u,hs_cmpxchg8\",\"-Wl,-u,hs_cmpxchg16\",\"-Wl,-u,hs_cmpxchg32\",\"-Wl,-u,hs_cmpxchg64\",\"-Wl,-u,hs_atomicread8\",\"-Wl,-u,hs_atomicread16\",\"-Wl,-u,hs_atomicread32\",\"-Wl,-u,hs_atomicread64\",\"-Wl,-u,hs_atomicwrite8\",\"-Wl,-u,hs_atomicwrite16\",\"-Wl,-u,hs_atomicwrite32\",\"-Wl,-u,hs_atomicwrite64\"]),[],Nothing,RtsOptsSafeOnly,False,[],[])" .align 4 .section .note.GNU-stack,"",@progbits6.o (skipped, just .debug-ghc-link-info)...
7.rsp
"-fno-stack-protector" "-c" "/tmp/ghc359994_0/ghc_7.s" "-o" "/tmp/ghc359994_0/ghc_8.o"Edited by Ben Gamari-
@jessicah, thanks for the clear reproducer. Just to be clear that we are on the same page, do you suppose you could update your comment to point out precisely where you see the problems here.
From the error I suspect the problem is the use of
%rip-relative references (e.g. tostg_bh_upd_frame_infoand many others). However, I also wonder whether the absolute inter-object references (e.g. tobase_GHCziTopHandler_runMainIO_closure) inu1ui_srtandr1hf_closureare similarly problematic. Perhaps we are saved by the fact that these are located in.datasectionsIn the case of the
%rip-relative references, I suspect these should rather be GOT-indirected%rip-relative references (e.g.R_X86_64_REX_GOTPCRELX). The assembler syntax for this isfoo@GOTPCREL(%rip).Edited by Ben Gamari -
@jessicah looking more carefully at your invocation, it seems that you didn't pass
-fPICto_build/stage1/bin/ghc; was this an oversight? If your platform requires PIC by default then perhaps it would be useful to add a rule inGHC.Driver.DynFlags.default_PIC.
In the original issue text, in point 3, I tried making edits to the generated temporary files similar to what was described:
the working native C compiler writes this to load a function address, producing an acceptable
R_X86_64_REX_GOTPCRELXrelocation:movq testfunction@GOTPCREL(%rip), %raxmovq %rax, %rdi
It made the compiler errors go away, but there were further instances of a different form also happening, I think in the data sections, I can't recall, I'd have to redo.
E.g. rewriting
leaq ghczmprim_GHCziCString_unpackCStringzh_closure(%rip),%rbxto useGOTPCRELhelped with compile issues.I think the data section issues were instances such as
.quad ghczmprim_GHCziCString_unpackCStringzh_closure?In terms of
-fPIC, this should be enabled by default with patches. , E.g. this is 8.8: https://github.com/jessicah/ghc/commit/55b32597b562ca0dbe9f542962aac69e514f2cb3.For 8.6.5, the original patch: https://github.com/jessicah/haiku-ghc/blob/master/patches/0001-haiku-add-support-for-8.6.patch.
Unregisterised builds are available at https://github.com/jessicah/haiku-ghc/releases, but the issue also happens when cross-compiling (of which only 8.6.5 works as stated earlier). I have natively built newer versions of unregisterised GHC on Haiku, up to 9.4.
And my current trees for GHC:
I noticed today there's a whole bunch of PIC logic in https://gitlab.haskell.org/ghc/ghc/-/blob/master/compiler/GHC/CmmToAsm/PIC.hs, particularly for
OSDarwin. So perhaps it just needsOSHaikucases here too?It would be interesting to see the generated temporary assembly file for a basic hello world example compiled for
OSDarwin, to see how the relocations may differ, if someone can provide that.-
See $5726.
Hmm, no, that's still producing a load incompatible with Haiku: $5726#LC106
