It seems like currently the runner doesn't delete the working tree after
finishing a job. At least we can delete the binary artifacts for now.