Born Eliza Bowen in Providence, Rhode Island to Phebe Kelley Bowen.
She kept her humble origins a secret when she met and married the wealthy French wine merchant Stephen Jumel in 1804. In 1810, they moved to what became known as the Morris-Jumel Mansion. After her husband's death she married Aaron Burr.