unmarried woman/unmarried man
use single woman/single man to avoid implying that marriage is the default, the norm (if you need to mention their status at all). "Unmarried households (single people or partners who share an address and a 'close personal relationship') have outnumbered married households in the U.S. since 2005" (Ms.).
