Test leaves behind files

On Windows runners, this is a problem because the files persist after CI.

They accounted for ~25% of disk usage on the two Windows runners right now.