Phelps was an art collector and patron. He resided in the Brandywine Valley between Wilmington, De. and Chadds Ford, Pa. where he and his wife, Mary, became friends with many local artists. He was an early patron of Andrew Wyeth and a close friend of the Wyeth family.
