Use fix-sized bit-fiddling primops for fixed size boxed types

Like !5572 (closed), this is switching over a portion of the primops which seems safe to use.

Progress towards #19026 (closed).