This is partial solution to #6807, because we invoke solver.
The follow-up will be to modify Rebuild monad so,
that it can be run without rebuilding (i.e. fail if cache is cold).