The U.S. Coast Guard has launched an internal investigation into a hand-drawn swastika found at a training facility in New Jersey, officials said.