William Royall, the first member of this family of which there is anything definitely known, emigrated to Salem probably during the year of 1629. He had a grant of land there known as "Royall's side" or "Ryall's Neck." He married, at Boston or Malden, Phoebe Green. He was in Casco Bay as early as 1635. His house was built on the south side of what was afterwards known as Royall's River, near its mouth, in North Yarmouth. Here he lived until the troubles with the neighboring Indians, which induced him to remove to Dorchester in 1675, accompanied by his son William, who was born probably at the Casco settlement in 1640. He was a carpenter by occupation, and died in 1724, in the 85th year of his age, and is buried in the tomb built by his son Isaac in the Dorchester burying ground.

Isaac Royall, son of the aforesaid William, born probably at the settlement in Casco Bay about 1672. He early settled at Boston, and engaged in trade, making frequent voyages to Antigua and other West India islands. He married, according to Boston records, on July 1, 1697, Elizabeth, daughter of Asaph Eliot and grandniece of the apostle to the Indians of that name. His wife was the widow of one Oliver, probably of Dorchester.

For a period of forty years Isaac Royall was a resident of Antigua, although his frequent presence in Boston during that time is evinced by his signature to conveyances. His name first appears on the Suffolk records in a mortgage deed given by himself and wife on the 24th August, 1697, he then being styled a "merchant of Boston." His trading operations between 1704 and 1710 with the West Indies, proved the foundation of his fortune.

On December 26, 1732, he purchased of the heirs of Lieutenant Governor Usher the estate in Charlestown (Medford) containing about five hundred acres. The large Mansion house was built by Usher, but has since become widely known as the Royall Mansion. It was one of the finest and most pretentious residences of the time within the suburbs of Boston. It is described by a visitor at that time as "A fine Country Seat belonging to Mr. Isaac Royall, being one of the grandest in N. America." This mansion was greatly added to, and almost rebuilt by the wealthy West Indian planter. He petitioned the General Court in December, 1737, that he might not be taxed on the twenty-seven slaves which he brought with him from Antigua. "That he removed from Antigua with his family, and brought with him among other things, and chattels, a parcel of negroes, designed for his own use, and not any of them for merchandise."

Isaac Royall, the builder of this mansion, did not live long to enjoy his princely estate, dying in 1739, not long after its completion. His widow, who survived him eight years, died in this house, and was interred from Colonel Oliver's in Dorchester April 25, 1747. The pair share the same tomb in the old Dorchester burying place. His daughter Penelope married Colonel Henry Vassall of Cambridge in 1742. He died in 1769, and she died in Boston in 1800, aged 76.

General Isaac Royall, a son, who was born in Antigua, probably in 1719, married Elizabeth McIntosh in 1738, but lived mostly in Boston. He became an extensive purchaser of lands in various parts of the State, and was one of the original proprietors of the township of Royalston in Worcester County. He was a member of the Artillery Company of Boston in 1750, was made a brigadier general in 1761, the first of that title among Americans. He was elected by the House a Councillor of the Province, and served in that office until 1774, completing twenty-three years of consecutive service.

Much has been written of this man's position at the time of the colonial disturbances in 1774. Possessed of large wealth, and the influence that riches and education carried with them, his course was watched by the people with intense anxiety. He was known to have much in common with the faithful band of Loyalists, who were gathered about Cambridge and Boston, yet he was still faithful to the people's church, and most of his family ties held him to the popular cause. A long letter, written by him to Lord Dartmouth, dated in January of 1774, exists in the archives of the Massachusetts Historical Society's Proceedings, 1873-1875, page 179. Harris says, "there can be no good reason for doubting the sincerity of his sympathy with the people, and although, when the time came to make a choice, he was prevailed upon to adhere to the side of the government, there is abundant evidence of his continued love towards New England and his desire to return and end his days here." How much harder was it then for a man in his position to make the great sacrifices he did, to give up his loved home and his property, all for the cause of his King.

He wrote to Lord Dartmouth, "I am conscious that in all public affairs I have made the honor of my king and the real Interests and Peace of my country the ultimate end of all my transactions. I am so to live in this world as that I may be happy in another, and no man more ardently wishes and earnestly prays to the God of Peace for the Restoration of those happy days, which formerly subsisted between us and our mother country than I do."

Three days before the battle of Lexington, Colonel Royall took his departure from Medford. He drove in his chariot, which was one of the few in this vicinity, to Boston, and never again returned.

The mansion itself was indeed one of the finest of colonial residences, standing, as it did, in the midst of elegant surroundings. In the front, or what is now the west side, was the paved court. Reaching farther west were the extensive gardens, opening from the courtyard, a broad path leading to the summer house. The slave quarters were at the south. The brick slave quarters have remained unchanged, and are the last visible relics of slavery in New England. The deep fireplace where the slaves prepared their food is still in place, and the roll of slaves has certainly been called in sight of Bunker Hill, though never upon its summit.