Only a shot that ends the rally can be appealed to the referee. Any player on the court can make the appeal.