This handles the case where we redirect stdout/stderr to a file, but
the command fails quickly and the file is not actually created.