1. 17 Mar, 2020 11 commits
    • Richard Eisenberg's avatar
      Fix #17021 by checking more return kinds · 53ff2cd0
      Richard Eisenberg authored
      All the details are in new Note [Datatype return kinds] in
      Test case: typecheck/should_fail/T17021{,b}
      Updates haddock submodule
    • Paavo Parkkinen's avatar
      Make example collapsible · 75168d07
      Paavo Parkkinen authored
    • Paavo Parkkinen's avatar
      Clean up · 4d85d68b
      Paavo Parkkinen authored
    • Paavo Parkkinen's avatar
      Add example for Data.Semigroup.diff · 5b632dad
      Paavo Parkkinen authored
    • Ömer Sinan Ağacan's avatar
      Don't update ModDetails with CafInfos when opts are disabled · 5800ebfe
      Ömer Sinan Ağacan authored
      This is consistent with the interface file behavior where we omit
      HsNoCafRefs annotations with -fomit-interface-pragmas (implied by -O0).
      ModDetails and ModIface are just different representations of the same
      thing, so they really need to be in sync. This patch does the right
      thing and does not need too much explanation, but here's an example of a
      problem not doing this causes in !2842:
          -- MyInteger.hs
          module MyInteger
            ( MyInteger (MyInteger)
            , ToMyInteger (toMyInteger)
            ) where
          newtype MyInteger = MyInteger Integer
          class ToMyInteger a where
            toMyInteger :: a -> MyInteger
          instance ToMyInteger Integer where
            toMyInteger = MyInteger {- . succ -}
          -- Main.hs
          module Main
            ( main
            ) where
          import MyInteger (MyInteger (MyInteger), toMyInteger)
          main :: IO ()
          main = do
            let (MyInteger i) = (id . toMyInteger) (41 :: Integer)
            print i
      If I build this with -O0, without this fix, we generate a ModDetails with
      accurate LFInfo for toMyInteger (MyInteger.$fToMyIntegerInteger) which says that
      it's a LFReEntrant with arity 1. This means in the use site (Main) we tag the
          R3 = MyInteger.$fToMyIntegerInteger_closure + 1;
          R2 = GHC.Base.id_closure;
          R1 = GHC.Base.._closure;
          Sp = Sp - 16;
          call stg_ap_ppp_fast(R4, R3, R2, R1) args: 24, res: 0, upd: 24;
      Now we change the definition by uncommenting the `succ` part and it becomes a thunk:
          MyInteger.$fToMyIntegerInteger [InlPrag=INLINE (sat-args=0)]
            :: MyInteger.ToMyInteger GHC.Integer.Type.Integer
          [GblId[DFunId(nt)]] =
              {} \u [] $ctoMyInteger_rEA;
      and its LFInfo is now LFThunk. This change in LFInfo makes a difference in the
      use site: we can no longer tag it.
      But becuase the interface fingerprint does not change (because ModIface does not
      change) we don't rebuild Main and tag the thunk.
      (1.2% increase in allocations when building T12545 on armv7 because we
      generate more code without CafInfos)
      Metric Increase:
    • Simon Peyton Jones's avatar
      Implement mapTyCo like foldTyCo · beffa147
      Simon Peyton Jones authored
      This patch makes mapType use the successful idiom described
      in TyCoRep
         Note [Specialising foldType]
      I have not yet changed any functions to use mapType, though there
      may be some suitable candidates.
      This patch should be a no-op in terms of functionality but,
      because it inlines the mapper itself, I'm hoping that there may
      be some modest perf improvements.
      Metric Decrease:
    • MaxGabriel's avatar
      Document the units of -ddump-timings · 89f034dd
      MaxGabriel authored
      Right now, in the output of -ddump-timings to a file, you can't tell what the units are:
      CodeGen [TemplateTestImports]: alloc=22454880 time=14.597
      I believe bytes/milliseconds are the correct units, but confirmation would be appreciated. I'm basing it off of this snippet from `withTiming'`:
      when (verbosity dflags >= 2 && prtimings == PrintTimings)
        $ liftIO $ logInfo dflags (defaultUserStyle dflags)
            (text "!!!" <+> what <> colon <+> text "finished in"
             <+> doublePrec 2 time
             <+> text "milliseconds"
             <> comma
             <+> text "allocated"
             <+> doublePrec 3 (realToFrac alloc / 1024 / 1024)
             <+> text "megabytes")
      which implies time is in milliseconds, and allocations in bytes (which divided by 1024 would be KB, and again would be MB)
    • PHO's avatar
      Don't use non-portable operator "==" in configure.ac · e1aa4052
      PHO authored
      The test operator "==" is a Bash extension and produces a wrong result
      if /bin/sh is not Bash.
    • Ömer Sinan Ağacan's avatar
      Update sanity checking for TSOs: · 92327e3a
      Ömer Sinan Ağacan authored
      - Remove an invalid assumption about GC checking what_next field. The GC
        doesn't care about what_next at all, if a TSO is reachable then all
        its pointers are followed (other than global_tso, which is only
        followed by compacting GC).
      - Remove checkSTACK in checkTSO: TSO stacks will be visited in
        checkHeapChain, or checkLargeObjects etc.
      - Add an assertion in checkTSO to check that the global_link field is
      - Did some refactor to remove forward decls in checkGlobalTSOList and
        added braces around single-statement if statements.
    • Sylvain Henry's avatar
      Modules: Core (#13009) · 18a346a4
      Sylvain Henry authored
      Update submodule: haddock
    • Xia Li-yao's avatar
  2. 15 Mar, 2020 6 commits
    • Ömer Sinan Ağacan's avatar
      Fix global_link of TSOs for threads reachable via dead weaks · cfcc3c9a
      Ömer Sinan Ağacan authored
      Fixes #17785
      Here's how the problem occurs:
      - In generation 0 we have a TSO that is finished (i.e. it has no more
        work to do or it is killed).
      - The TSO only becomes reachable after collectDeadWeakPtrs().
      - After collectDeadWeakPtrs() we switch to WeakDone phase where we don't
        move TSOs to different lists anymore (like the next gen's thread list
        or the resurrected_threads list).
      - So the TSO will never be moved to a generation's thread list, but it
        will be promoted to generation 1.
      - Generation 1 collected via mark-compact, and because the TSO is
        reachable it is marked, and its `global_link` field, which is bogus at
        this point (because the TSO is not in a list), will be threaded.
      - Chaos ensues.
      In other words, when these conditions hold:
      - A TSO is reachable only after collectDeadWeakPtrs()
      - It's finished (what_next is ThreadComplete or ThreadKilled)
      - It's retained by mark-compact collector (moving collector doesn't
        evacuate the global_list field)
      We end up doing random mutations on the heap because the TSO's
      global_list field is not valid, but it still looks like a heap pointer
      so we thread it during compacting GC.
      The fix is simple: when we traverse old_threads lists to resurrect
      unreachable threads the threads that won't be resurrected currently
      stays on the old_threads lists. Those threads will never be visited
      again by MarkWeak so we now reset the global_list fields. This way
      compacting GC does not thread pointers to nowhere.
      The reproducer in #17785 is quite large and hard to build, because of
      the dependencies, so I'm not adding a regression test.
      In my testing the reproducer would take a less than 5 seconds to run,
      and once in every ~5 runs would fail with a segfault or an assertion
      error. In other cases it also fails with a test failure. Because the
      tests never fail with the bug fix, assuming the code is correct, this
      also means that this bug can sometimes lead to incorrect runtime
      After the fix I was able to run the reproducer repeatedly for about an
      hour, with no runtime crashes or test failures.
      To run the reproducer clone the git repo:
          $ git clone https://github.com/osa1/streamly --branch ghc-segfault
      Then clone primitive and atomic-primops from their git repos and point
      to the clones in cabal.project.local. The project should then be
      buildable using GHC HEAD. Run the executable `properties` with `+RTS -c
      In addition to the reproducer above I run the test suite using:
          $ make slowtest EXTRA_HC_OPTS="-debug -with-rtsopts=-DS \
              -with-rtsopts=-c +RTS -c -RTS" SKIPWAY='nonmoving nonmoving_thr'
      This enables compacting GC always in both GHC when building the test
      programs and when running the test programs, and also enables sanity
      checking when running the test programs. These set of flags are not
      compatible for all tests so there are some failures, but I got the same
      set of failures with this patch compared to GHC HEAD.
    • Judah Jacobson's avatar
      Add a -no-haddock flag. · c35c545d
      Judah Jacobson authored
      This flag undoes the effect of a previous "-haddock" flag.  Having both flags makes it easier
      for build systems to enable Haddock parsing in a set of global flags, but then disable it locally for
      specific targets (e.g., third-party packages whose comments don't pass the validation in the latest GHC).
      I added the flag to expected-undocumented-flags.txt since `-haddock` was alreadyin that list.
    • Sylvain Henry's avatar
      Refactor CmmToAsm (disentangle DynFlags) · 2e82465f
      Sylvain Henry authored
      This patch disentangles a bit more DynFlags from the native code
      generator (CmmToAsm).
      In more details:
      - add a new NCGConfig datatype in GHC.CmmToAsm.Config which contains the
        configuration of a native code generation session
      - explicitly pass NCGConfig/Platform arguments when necessary
      - as a consequence `sdocWithPlatform` is gone and there are only a few
        `sdocWithDynFlags` left
      - remove the use of `unsafeGlobalDynFlags` from GHC.CmmToAsm.CFG
      - remove `sdocDebugLevel` (now we pass the debug level via NCGConfig)
      There are still some places where DynFlags is used, especially because
      of pretty-printing (CLabel), because of Cmm helpers (such as
      `cmmExprType`) and because of `Outputable` instance for the
      instructions. These are left for future refactoring as this patch is
      already big.
    • vdukhovni's avatar
      Note platform-specific Foreign.C.Types in context · dd6ffe6b
      vdukhovni authored
      Also fix the markup in the general note at the top of the module.  Haddock
      (usability trade-off), does not support multi-line emphasised text.
    • Brian Foley's avatar
      Remove some dead code · b4774598
      Brian Foley authored
      From the notes.ghc.drop list found using weeder in #17713
    • Krzysztof Gogolewski's avatar
      Document restriction on SCC pragma syntax · d30aeb4b
      Krzysztof Gogolewski authored
      Currently, the names of cost centres must be quoted or
      be lowercase identifiers.
      Fixes #17916.
  3. 14 Mar, 2020 18 commits
    • Krzysztof Gogolewski's avatar
    • Ömer Sinan Ağacan's avatar
    • cgibbard's avatar
      Enable stage1 build of haddock · 3f116d35
      cgibbard authored
      The submodule has already been bumped to contain the fix.
    • Vladislav Zavialov's avatar
      Remove second tcLookupTcTyCon in tcDataDefn · bee4cdad
      Vladislav Zavialov authored
      Before this patch, tcDataDefn used to call tcLookupTcTyCon twice in a row:
      	1. in bindTyClTyVars itself
      	2. in the continuation passed to it
      Now bindTyClTyVars passes the TcTyCon to the continuation, making
      the second lookup unnecessary.
    • Ben Gamari's avatar
      base: Make `open` calls interruptible · 93c88c26
      Ben Gamari authored
      As noted in #17912, `open` system calls were `safe` rather than
      `interruptible`. Consequently, the program could not be interrupted with
      SIGINT if stuck in a slow open operation. Fix this by marking
      `c_safe_open` as interruptible.
    • Simon Peyton Jones's avatar
      Refactoring in TcSMonad · 73133a3b
      Simon Peyton Jones authored
      This patch is just refactoring: no change in
      I removed the rather complicated
      in favour of simpler functions
      The last of these is a little strange, but overall
      it's much better I think.
    • Simon Peyton Jones's avatar
      Wrap an implication around class-sig kind errors · e3c374cc
      Simon Peyton Jones authored
      Ticket #17841 showed that we can get a kind error
      in a class signature, but lack an enclosing implication
      that binds its skolems.
      This patch
      * Adds the wrapping implication: the new call to
        checkTvConstraints in tcClassDecl1
      * Simplifies the API to checkTvConstraints, which
        was not otherwise called at all.
      * Simplifies TcErrors.report_unsolved by *not*
        initialising the TidyEnv from the typechecker lexical
        envt.  It's enough to do so from the free vars of the
        unsolved constraints; and we get silly renamings if
        we add variables twice: once from the lexical scope
        and once from the implication constraint.
    • Ben Gamari's avatar
    • Simon Peyton Jones's avatar
      Improve CSE.combineAlts · 88f7a762
      Simon Peyton Jones authored
      This patch improves the way that CSE combines identical
      alternatives.  See #17901.
      I'm still not happy about the duplication between CSE.combineAlts
      and GHC.Core.Utils.combineIdenticalAlts; see the Notes with those
      functions.  But this patch is a step forward.
      Metric Decrease:
    • Simon Peyton Jones's avatar
      Simple refactor of cheapEqExpr · 2f8c7767
      Simon Peyton Jones authored
      No change in functionality.  Just seems tidier (and signficantly more
      efficient) to deal with ticks directly than to call stripTicksTopE.
    • Ben Gamari's avatar
      nonmoving: Remove redundant bitmap clearing · fdfa2d01
      Ben Gamari authored
      nonmovingSweep already clears the bitmap in the sweep loop. There is no
      reason to do so a second time.
    • Ben Gamari's avatar
      nonmoving: Don't traverse filled segment list in pause · 20d4d676
      Ben Gamari authored
      The non-moving collector would previously walk the entire filled segment
      list during the preparatory pause. However, this is far more work than
      is strictly necessary. We can rather get away with merely collecting the
      allocators' filled segment list heads and process the lists themselves
      during the concurrent phase. This can significantly reduce the maximum
      gen1 GC pause time in programs with high rates of long-lived allocations.
    • Judah Jacobson's avatar
    • Judah Jacobson's avatar
      Allow overriding LD_STAGE0 and AR_STAGE0 in the configure script. · 8f7dd571
      Judah Jacobson authored
      Previously it was possible to override the stage0 C compiler via `CC_STAGE0`,
      but you couldn't override `ld` or `ar` in stage0.  This change allows overriding them
      by setting `LD_STAGE0` or `AR_STAGE0`, respectively.
      Our team uses this feature internally to take more control of our GHC build
      and make it run more hermetically.
    • Sylvain Henry's avatar
      Use correct option name (-opti) (fix #17314) · 7432b327
      Sylvain Henry authored
    • Sylvain Henry's avatar
      Make: refactor GMP rules · 4f117135
      Sylvain Henry authored
      Document and use simpler rules for the ghc-gmp.h header.
    • Sylvain Henry's avatar
      Hadrian: fix absolute buildroot support (#17822) · b989845e
      Sylvain Henry authored
      Shake's "**" wildcard doesn't match absolute root. We must use "//" instead.
    • Simon Peyton Jones's avatar
      Fix Lint · c12a2ec5
      Simon Peyton Jones authored
      Ticket #17590 pointed out a bug in the way the linter dealt with
      type lets, exposed by the new uniqAway story.
      The fix is described in Note [Linting type lets]. I ended up
      putting the in-scope Ids in a different env field, le_ids,
      rather than (as before) sneaking them into the TCvSubst.
      Surprisingly tiresome, but done.
      Metric Decrease:
  4. 13 Mar, 2020 5 commits
    • Ben Gamari's avatar
      gitlab-ci: Distinguish integer-simple test envs · 7f25557a
      Ben Gamari authored
      Previously two integer-simple jobs declared the same test environment. One (the nightly job) was built in the perf way, the other in the validate way. Consequently they had appreciably different performance characteristics, causing in the nightly job to spuriously fail with performance changes.
    • Ben Gamari's avatar
      gitlab-ci: Rework triggering of release builds · f124ff0d
      Ben Gamari authored
      Use a push option instead of tagging.
    • Paavo Parkkinen's avatar
      Update documentation for closureSize · 2f292db8
      Paavo Parkkinen authored
    • Sylvain Henry's avatar
      Rename isDllName · 44fad4a9
      Sylvain Henry authored
      I wanted to fix the dangling comment in `isDllName` ("This is the cause
      of #", #8696 is already mentioned earlier). I took the opportunity to
      change the function name to better reflect what it does.
    • Alp Mestanogullari's avatar
      hadrian: improve dependency tracking for the check-* programs · 6a65b8c2
      Alp Mestanogullari authored
      The code in Rules.Register responsible for finding all the build artifacts
      that Cabal installs when registering a library (static/shared libs, .hi files,
      ...) was looking in the wrong place. This patch fixes that logic and makes sure
      we gather all those artifacts in a list to declare that the rule for a given
      `.conf` file, our proxy for "Hadrian, please install this package in the package
      db for this stage", also produces those artifacts under the said package
      We also were completely missing some logic to declare that the check-* programs
      have dependencies besides their source code, at least when testing an in-tree
      Finally, this patch also removes redundant packages from 'testsuitePackages',
      since they should already be covered by the stage<N>Packages lists from
      With this patch, after a complete build and freezing stage 1, a change to
      `compiler/parser/Parser.y` results in rebuilding the ghc lib, reinstalling it,
      and rebuilding the few programs that depend on it, _including_ `check-ppr` and
      `check-api-annotations` (therefore fixing #17273).