In 1949, the couple bought a house in Woodmere, New York, on Long Island, living there through 1952. Their daughter Joan Celia "J. C." Lee was born in 1950. Another daughter, Jan Lee, died a few days after her birth in 1953.