The reason the NCAA gained control over college football TV rights from 1951-1984 is BECAUSE ND and Penn had their own national TV contracts from TV's infancy, the only two programs in the country that had their games televised every week.
ESPN ran a special show about this recently.
Essentially, the NCAA feared that those two schools would dominate college football, especially Notre Dame with its 1946-49 undefeated record and built in national TV audience.
So.the NCAA essentially extorted all schools, including ND and Penn, into signing over all of their football TV rights, basically a Mafia like tactic.
Then, the NCAA mandated its "you can only be on TV so many times per season policy" to keep teams like ND from being televised "too much" until the Supreme Court decision in 1984.
The rights assigned only dealt with live broadcasts, not taped delay, so ND was smart enough to use that loophole for its Sunday morning highlights show with Lindsey Nelson.