Skip to content

Increase default virtual memory

Summary

GHC's virtual memory limit is capped at 1TiB. This has caused some significant and critical breakages when running scientific computations on a highly parallel,share memory computing environment. The issue was briefly discussed here:

https://discourse.haskell.org/t/application-memory-limit-1tb/8449/9

It would be greatly appreciated if the virtual memory limit for GHC-9.10.1 was increased to a larger value.

If I might make some suggestions,

  1. 16TiB limit would defer the problem for a couple of years.
  2. 512TiB limit would defer this problem for a couple of decades.

Either would be more than suitable to remedy our immediate needs, I leave the risk assessment of breakage versus the benefit of longer deferment in your capable hands.

Steps to reproduce

Compile and execute a program which requires more than 1TiB of resident memory while running.

Expected behavior

The program should not abort if the computing environment actually has more than 1TiB of memory.

Environment

  • GHC version used: GHC-9.8.1, GHC-9.6.4
  • Operating System: Linux
  • System Architecture: x86_64
To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information