The mayor of New York expressed outrage at the shooting which the Department of Homeland Security said happened during the arrest of a "criminal illegal alien".