The referee can replace a line judge for good reason, based on what they saw or if all the players ask.