Fort Jay, or Fort Columbus, as it was then called, was generally known as the "garrison." It is situated on the westerly part of the island on raised ground—a square-built, old style fortress with a dry moat, portcullis, draw bridge, and ramparts. Guns are mounted en barbette on three of its sides. An artistic and elaborate piece of sculpture over the portal, representing the various arms of the service, cut in brown stone, is still in a fair state of preservation. Passing through the deep sallyport, the interior is found to be quite roomy, having a sodded parade ground with quarters surrounding it on four sides. The buildings in the south were used as quarters for the unmarried officers. On the east lived recruits, and on the west were the quarters of a company of soldiers, about seventy-five strong, who were officially called the Permanent Party. On the north was the post band on one side of the sallyport and the non-commissioned staff and some buglers on the other. There was a smaller gate on the south leading into the moat and a sunken way leading from there to the entrance to Castle Williams.
All of the buildings which I have described still exist except a few of the officers' cottages on the north side of the island, the sutler's row and the chapel which was destroyed by fire and lately replaced on another site by a much larger and finer building of cut stone, a gift of Trinity Church of New York. The post-garden has disappeared and so has the graveyard with its few monuments and many headstones. The remains were disinterred and reburied elsewhere, and the site is now covered with buildings.
Governor's Island was the principal recruiting depot in the east, and in 1854 Major John T. Sprague of the Eighth U.S. Infantry was in command. He was a West Point graduate, who had joined the army in 1837 and had been breveted as a Major during the Mexican War. Major Sprague was relieved and ordered elsewhere before my departure from the island. He was succeeded by Captain Mansfield Lovell, a dashing artillery officer, who later joined the confederate army and had something to do with the surrender of New Orleans. A captain or two, an ordnance officer and six or eight lieutenants from different branches of the service, were all detailed on detached service away from their regiments to serve here as instructors of recruits.
A very fine military band was connected with this post under the leadership of Bandmaster Bloomfield, who was a celebrated musician. There were two drummers in this band, brothers, named Jack and Pete Vigo, who were considered to be the best in the army. Later on both served in the band of the regiment which I joined, Pete Vigo, in the meantime, having married Bandmaster Bloomfield's daughter, who accompanied him to the frontiers.
The band played at guard mounting and dress parade, musters and general inspections. It also gave concerts on certain summer days in front of the commanding officers' quarters. Bandsmen had permission occasionally to play in New York City, which was lucrative for them. Indeed they were very much petted and pampered and enjoyed many privileges. They received extra pay and had especial fine uniforms and instruments, all of which had to be paid for out of the post fund.
The Permanent Party, also called Company "A," was a company of soldiers selected from the recruits for stature, physique and soldierly bearing. They were mostly tall men and, as I imagine, must have borne some resemblance to the grenadiers of Frederick the Great. They looked well on parade in their striking uniforms—dark blue coats with facings and sky-blue trousers, white cross and waist belts, epaulettes and black shakos with blue pompons and brass chin straps. Occasionally some were sent away to serve with a regiment at their own request or as a punishment. The Permanent Party did all of the guard duty that was required on the island, and guarded the prisoners who did the scavenging.
Other troops on the island were the recruits, generally several hundred of them, who were quartered in the garrison and in the upper casemates of Castle Williams. From time to time they were sent away in detachments of a hundred or more, generally accompanied by some of the drummers and fifers, to vacancies in regiments serving throughout the country. Officers were detailed to accompany these detachments to their destinations. The non-commissioned officers were generally selected from the most worthy and efficient of the recruits and promoted to lance sergeants and lance corporals, a rank with authority but without extra pay. Often a few re-enlisted old soldiers, rejoining regiments on the frontiers, went with these parties and helped to take charge of them.
The recruits were unarmed. Arms were furnished when they joined their regiments, unless it became necessary to march through a part of the Indian country to reach their destination. In that case they were armed and accompanied by an escort of experienced soldiers. These departures from the island were always occasions of considerable military ceremony. The recruits were escorted from the garrison to the wharf by the post band and the Permanent Party. And when they had embarked on the steamboat and the lines were cast off, the band would play, "The Girl I Left Behind Me," amid the parting cheers of the spectators.
The final complement that made up the garrison of Governors Island were the music boys, designated as Company "B," and stationed in the small South Battery. We were under special command of the Post-Adjutant, but never saw him there except on muster days. He troubled himself very little about us, leaving the care and management of the fifty or sixty boys to the two sergeants in charge. Sergeant Hanke, of whom I have spoken before, was a Dane who had been for many years in the United States service. He was of low stature, very corpulent, with a large round florid face, and was bald, except for a fringe of gray hair below the top of his ears. He had sharp twinkling eyes and a strong voice. He was married but had no children and lived in a couple of small rooms on the second floor of the quarters. His Irish wife was his counterpart in stature and corpulency. She generally wore a white cap and a red skirt. That she had a fine brogue we knew from overhearing her disputes with the sergeant. She had a loud voice and was more than a match for the sergeant, whose English failed him when he became excited. Sergeant Hanke, while a strict disciplinarian, was not an unkindly man. He often listened patiently to our complaints and forgave us for many minor transgressions when we were brought before him.
Sergeant Moore was an Irishman and married. He kept house with his wife and several children in some rooms on the lower floor of our quarters. He also had served a long time in the army. He was a tall thin man with iron gray hair, quick tempered and not so well liked by the boys as Sergeant Hanke. Both of these men remained in the service for more than sixty years and were finally retired and pensioned by the government. Sergeant Moore lived to be ninety-seven years old and Hanke nearly as long.