Rule matching: Don't compute the FVs if we don't look at them.

I took !7797 (closed) for a spin and looked at the resulting GHC profile.

It seemed like rule matching spent far too much work computing fvs. And indeed it seems there is quite a lot of redundant fv computation going on.