David Weeks never even got to see the finished home as he died in August 1834 in New England while seeking medical attention. Mary Weeks remarried lawyer John Moore but kept her children's inherited property - the home and the family's nearly 200 slaves - separate from that of her second husband, as she was allowed to do under state law.
Mary Weeks's great-grandson, William Weeks Hall, lived in the Shadows from 1922 until his death in 1958. He was very interested in preserving the home and his family's history. He donated a very large archive of family papers that he found in the house, maintained an impressive garden, and eventually donated the house and garden to the National Trust.