even the fans of the good teams will stop showing if they are always playing crap teams.

There is absolutely a reasonable discussion to be had on if uncontrolled movement of players would lead to a further consolidation of talent at a few schools. I believe in the long term it would, especially in the current Sgt Shultz model of rules enforcement, but that is open to debate.