In the vestibule are windows showing Pilgrim history, and tablets giving the Elders, the Ministers, and the Covenant of the First church. The building is a tribute from the spiritual heirs of this Covenant, to the Pilgrim Congregation of 1620.

One of the hymns sung at the dedication of the new church, was written by Rev. John Pierpont for the dedication of the previous meeting-house, December 14, 1831. It contains these lines:

“What have we Lord to bind us

To this, the Pilgrim shore!—

Their hill of graves behind us,

Their watery way before,

The wintry surge that dashes

Against the rock they trod,

Their memory and their ashes,—

Be Thou their guard, O God!”