Revert "rts: Drop redundant flags for libffi"

This seems to have regressed builds using --with-system-libffi (#17520 (closed)).