The Oliver Street Baptist Church was built on the northwest corner of Oliver and Henry Streets in 1795. It was rebuilt in 1800, and again in 1819. Later it was burned, and finally restored in 1843. The structure is now occupied by the Mariners' Temple, and the record of its burning is to be seen on a marble tablet on the front wall.

Oliver Street—that is, the two blocks from Chatham Square to Madison Street—was called Fayette Street before the name was changed to Oliver in 1825.

James Street was once St. James Street. The change was made prior to 1816.

Mariners' Church, at 46 Catherine Street, was erected in 1854, on the southeast corner of Madison Street. Prior to that, and as far back as 1819, it had been at 76 Roosevelt Street.

Madison Street

Banker Street having become a byword, because of the objectionable character of its inhabitants, the name was changed to Madison Street in 1826.

Between Jefferson and Clinton Streets, and south of Henry, was a pond, the only bit of water which, in early days, emptied into the East River between what afterward became Roosevelt Street and Houston Street. A wet meadow, rather than a distinct stream, extended from this pond to the river as an outlet. This became later the region of shipyards.