During the latter part of his life Earl spent most of his time painting portraits of Jackson, and came to be known in a jesting way as the “court painter.” It was intimated around political circles in Washington that Earl’s influence on the President was such that his friendship was a good thing to have; and it was hinted that Earl received many commissions to paint Jackson’s picture from practical men who were less interested in having a hand-painted portrait of the President than they were in currying favor with him. Be that as it may, Earl enjoyed painting the picture of his old friend and benefactor and Jackson enjoyed Earl’s companionship; so everybody was happy. Earl is described by his contemporaries as a man of quiet and gentle ways, and he must have been an excellent foil for the fiery old General.

That he was not without a streak of humor is shown by his skylarking when President Jackson left him in Washington when he returned to the Hermitage in the summer of 1836. He was entrusted with the duty, during Jackson’s absence, of opening the President’s mail and distributing the letters to the proper departments. Earl, with dry wit, remarked to Francis P. Blair that this would place on the Cabinet members the unusual responsibility of attending to their own duties; and there was a good deal of chaffing and carrying-on in the official family while the well-liked pseudo-President was occupying the chair in the White House office with mock gravity. Earl would joke the Cabinet members by seriously referring to them all of the incoherent letters of rattle-brained cranks, including an inventor of a perpetual motion machine who wrote him from the Philadelphia lunatic asylum; and when one of them jokingly objected to being so annoyed, Earl remarked that while he was sitting in the President’s chair he was tempted to go ahead and make some needed changes in the government and thus save Mr. Van Buren (the heir apparent) the trouble. Blair thought all of this great sport and wrote to Jackson back at the Hermitage telling him all about it. “He is thus playing the part of Sancho Panzo,” chuckled Blair, “with those whom he ventures to joke with, making some pretty good hits.” Jackson was never much of a hand for horse play and buffoonery; but if he had any objection to all this pranking of Colonel Earl’s he never voiced it.

Upon the expiration of Jackson’s term as President Earl returned to the Hermitage with him, but did not live long. In addition to being an artist he was also a dabbler in the art of landscape gardening. He had designed the concentric flower beds in the middle of the garden; and when Jackson in the summer of 1837 started to build the guitar-shaped driveway from the gate to the front door of the Hermitage it was Earl who drew the plans and helped supervise the work. The sun shines fiercely in Tennessee in early September, and while engaged in this work Earl suffered a heat stroke which passed into a congestive chill from which he never recovered. He died on September 16, 1838, leaving uncompleted a portrait on which he was working of Jackson in his major-general’s uniform. In writing to his former secretary, Nicholas P. Trist, notifying him of Earl’s death Jackson said: “His death is a severe bereavement to me. He was my sincere friend and constant companion, and when I was able to travel always accompanied me. He was an invaluable friend, a most upright and honest man; but he is gone to happier climes than these ‘where the wicked cease to trouble and the weary are at rest.’” Earl was buried in the family plot in the corner of the garden, and Jackson made his little niche in history secure by directing that there be engraved on his headstone the words: “Friend and companion of General Andrew Jackson.”

In the journal of a Nashville citizen of that era, Mr. Matthew Delamere Cooper, the funeral of Colonel Earl is commemorated in a quaint and touching poem which he has entitled “The Burial,” in introducing which he says: “That the following lines may be understood it is necessary to mention that they were written on the occasion of the burial of Colonel Earl, a portrait painter of considerable eminence, for many years the intimate friend of General Jackson and long an inmate of the General’s house. He was followed to the grave by a few friends, amongst them the venerable hero, who did honor to his memory and consecrated the accumulating heap over his remains by a few tears that would not be represt. The man of iron soul, the hero of a hundred battles, wept over his departed friend! He was buried near a weeping willow and within a few feet of the cenotaph destined to receive the mortal remains of Andrew Jackson. (May it long be an empty tomb!!)”

The Burial

There was no gloomy pomp to strike the eye;

There fell no toll of bell upon the ear.

To where a new made grave was opened nigh,

In silence slowly followed we the bier.

And was he little valued, little known,