You can not send a Saboteur, Diplomat, Spy, or Merchant to a territory if it is not owned. If these options are not available for a territory, then it is neutral.