Don't open with O_NONBLOCK, instead open in blocking mode and set
O_NONBLOCK subsequently with fcntl().  This appears to fix the
problems with FIFOs.

Pick one of the following:

	- the semantics as implemented by Linux & Solaris is broken
	- the POSIX semantics is broken
	- our expectation that things should behave sensibly is unreasonable