At twenty-four, Edmund Jennings Lee married Sarah Lee, daughter of Richard Henry Lee of Stratford, his near cousin, and that same year, 1796, settled in Alexandria. Nearly everyone of local prominence dined at Mount Vernon on some occasion or another—and so did Edmund Lee and his wife. Washington's diaries record three dates when the former was present and one when the latter accompanied Attorney General Charles Lee and his wife. Mrs. Edmund Lee as "Miss Lee" had visited General and Mrs. Washington innumerable times with her father. As a matter of statistical interest, the General's diaries enumerate more than one hundred visits of various Virginia Lees to Mount Vernon.
Edmund I. Lee is remembered in his native city for saving the Glebe lands for Christ Church. Glebe lands were property belonging to the Church of England, and used for the support of the rector and the needs of the parish. After the Revolutionary War the Virginia Assembly confiscated these lands for the use of the poor. On behalf of the Alexandria church, now called Christ Church, Edmund I. Lee took this case to the United States Courts in 1814, protesting the unconstitutionality of the act. His eloquence, legal knowledge and labors resulted in the return of the Glebe lands to Christ Church. The case was won on a technicality, i.e., the Virginia Assembly had no jurisdiction over the District of Columbia, and Alexandria lay in the District.
In 1810 Lee was president of the common council of the city, a thankless task which he performed faithfully and cheerfully. The year 1832 saw "his house and half an acre lot at Washington and Oronoco Streets in which he now resides for sale or rent." It was not sold, for in his will, Lee left this dwelling and lot to his two daughters, Sally Lee and Hannah Stewart, jointly. To his son he left the family Bible and a cane-bottom settee, formerly owned by William Lee of Green Spring, and a house and lot at the "bottom of his garden" on Washington Street, and the "arm-chair" from his drawing room. His son, Cassius Lee, fell heir to his father's home and there brought up a large family of handsome children.
Family tradition names Edmund I. Lee as the builder of his home, which would fix the date of the house at 1801 or later. Everything about the house is typical of a late eighteenth century federal building. It is certain that Charles Lee built the mansion around 1796 and that Edmund I. Lee lived there from the time of his marriage. The price of five thousand dollars at the time of purchase is also indicative of a substantial and elegant residence.
This house is a fine federal example and is handsomely fitted out. The Lee family seems to have had a leaning toward brass hardware, and like the hinges in the great hall at Stratford, unusual brass latches and locks are here plentiful. Unquestionably the handsomest brass locks in Alexandria are in this house. A rare latch in addition to the great locks is attached to the Washington Street door. This double doorway, deeply recessed, in a hand-carved Georgian frame, arched and paneled, challenges the attention of every passer-by. The colonnaded rear gallery is hung with festoons of wisteria and is the most picturesque and lovely spot when the great lavender bunches of bloom are scattered and draped around the vine and against the white columns and railings. The woodwork throughout the house is in keeping with the dignified exterior. The rooms are large and inviting; the mantels' trim and stairway are better than pleasing.
Edmund I. Lee's doorway, an inviting entrance
Robert E. Lee was first cousin to Cassius Lee. They grew up together, were of the same age and generation, devoted and sympathetic friends throughout their lives. For advice and counsel they sought each other.
On April 21, 1861, the Sunday following General Lee's resignation from the United States Army, he attended Christ Church in Alexandria, and left his carriage and horses at Cassius Lee's house. Sometime during the morning, commissioners sent by the Virginia convention arrived at Arlington House and found General Lee gone to church in Alexandria. They followed him to the home of Cassius Lee, and there awaited his return from church. When the two Lee gentlemen, who had walked home from church together, entered the house, they found the waiting delegation. Realizing at once that only grave considerations had brought these gentlemen to his home, Cassius Lee left the room, and dispatched his family of children to the house of his sister, Mrs. Lloyd. General Lee had written to General Scott only the day before—on April 20:
Since my interview with you on the 18th inst. I have felt that I ought no longer to retain my commission in the Army. I therefore tender my resignation, which I request you will recommend for acceptance. It would have been presented at once but for the struggle it has cost me to separate myself from a service to which I have devoted the best years of my life, and all the ability I possessed.... Save in the defense of my native State, I never desire again to draw my Sword.[182]