To instantly remove alert status, walk into an airlock for a City exit (do not leave the city). The music should immediately fade and once you walk back into the city the alerts will be gone.