In a few years the town's growth gave such promise that William Cooper began to build his own home. It was generally known as "The Manor," but the patent of Cooperstown was not according to law a manor. It was finished in 1788, when a few streets were laid out and the town's first map was made. And October 10, 1790,

he brought his family and servants, some fifteen persons, and their belongings, from Burlington New Jersey, to this early pioneer home. Mr. Keese says that "The Manor" was of wood with outside boarding, unplaned; that it was two stories high, had two wings and a back building added in 1791. It first stood facing Main St. and Otsego Lake and directly in front of the later Otsego Hall, now marked by the Indian Hunter. In 1799 it was moved down the street, and was burned down in 1812. In its time it was the most stately private house for miles around.

The second home, Otsego Hall, built in 1798, was of bricks which were made at the outlet of the lake. It had seventy feet of frontage by fifty-six of depth, and had two stories with attic and basement. The main hall measured twenty-four by forty-eight feet and the rooms on either side were twenty feet wide. Otsego Hall is said to have been of the exact, generous proportions of the Van Rensselaer Manor House at Albany, New York, where Judge Cooper was a frequent visitor. His own Hall home on Otsego's southern shore ever had "the air and capacity of a mansion and a history of hospitality well deserved."