I think the rule is fine as it is. While a blocked signal during a rally may be distracting to a player, it is always possible and there is no reason to stop play unless the referee feels the ball was out.

Perhaps players need to be reminded that a blocked signal may be given during the course of the rally. They are, hopefully, already aware that a ball is good signal is possible.