Paramour

a lover, often secret, not allowed by law or custom; an illicit lover