ACC used to do that with the random byes and I HATED it.
It puts too much randomness in the tournament outcome. One team could wind up getting too many byes and either missing out on points, or getting too many free points.
Keep it simple. Top seeds earned the bye and should be rewarded for that.