After the fix to #2500, we could get "Failing due to -Werror." but no
warnings printed. Now we don't fail in that case.