Improve stub socket accept usage

Without this I was getting an "Invalid argument" error, but only some of the time.

I'm not sure why this hasn't come up before, maybe accept used to be more permissive?