nor are they part of an enormous and massive money generating entertainment system.

The money generated by the sport pays for their scholarships. That exchange is what differentiates them from regular students and IMO creates the contract that restricts their movement. That restriction is, again IMO, necessary to maintain the revenue aspects of the sport(s) across the entire league.