Hold X while waiting for your turn. This should speed up both your opponent hitting it, and the time it takes for the shot, significantly. You can also hold X after you shoot to speed up your shot's time to get there.