the theory is probably along the lines of all conference games are going to be played hard against opponents who will be familiar with you. The non-conference SoS tells how good the rest of the teams are.

Still -- agree with you that overall SoS is probably a better metric.