The somberness that permeated the fire enginehouse contrasted sharply with the din outside. Hundreds of militiamen and townspeople jammed the streets, which echoed with whoops and yells. Anxious and hysterical friends and relatives of Brown’s hostages added to the confusion. While the quasi-military operations ended at nightfall, the non-military activities continued with increasing fervor. The bars in the Wager House and Gault House Saloon were enjoying an unprecedented business. Many men were intoxicated, and they fired their guns wildly into the air and occasionally at the enginehouse. All semblance of order was gone and the “wildest excitement” prevailed throughout the night.
Albert Hazlett
Osborn P. Anderson
During this confusion two of Brown’s men made their escape. Of the raiders caught in Harpers Ferry when the Jefferson Guards seized the B & O bridge at midday on October 17, Albert Hazlett and Osborn P. Anderson, occupying the arsenal, went unnoticed during the day. At night they crept out, mingled with the disorderly crowds, crossed the Potomac into Maryland, and fled north.
Into the midst of the chaos created by the drunken and disorderly militia and townspeople marched 90 U.S. Marines led by a 52-year-old Army colonel, Robert E. Lee. Lee had been at his home in Arlington, Va., that afternoon when Lt. J. E. B. Stuart brought him secret orders to report to the War Department at once. There President Buchanan and Secretary of War Floyd told him of Brown’s attack and ordered him to leave immediately for Harpers Ferry with the only Federal troops readily available, a detachment of Marines at the Washington Navy Yard. Upon his arrival at Harpers Ferry, Lee was to take command of all forces in the town. Lieutenant Stuart, scenting excitement, asked for and received permission to accompany Lee, who, in the hurry of departure, had no time to return home and don his uniform.
The Marines, under the immediate command of Lt. Israel Green, left Washington before Lee and arrived at Sandy Hook in late afternoon. Lee and Stuart joined them at 10:30 p.m. Marching into Harpers Ferry, the Marines entered the armory yard about 11 p.m. and replaced the disorganized militia. Lee would have ordered an immediate attack on the enginehouse “But for the fear of sacrificing the lives of some of the gentlemen held ... as prisoners....”
About 2:30 a.m., October 18, Lee wrote a surrender demand and handed it to Stuart for delivery to Brown under a white flag when so directed. He hoped that the raider chieftain could be persuaded to surrender peaceably and avoid further bloodshed, but he expected that he would be taken only by force and laid his plans accordingly. In the early morning hours, Lee, believing the raid to be chiefly aimed against State authority and not the Federal Government, offered the honor of assaulting the enginehouse to Colonel Shriver of the Maryland Volunteers. Shriver declined. “These men of mine have wives and children,” he said. “I will not expose them to such risks. You are paid for doing this kind of work.” Lee then offered the task to Colonel Baylor of the Virginia militia. Baylor promptly declined it for the same reasons. Lieutenant Green was then asked if he wished “the honor of taking those men out.” Green lifted his cap, thanked Lee, and picked a storming party of 12 men. He instructed them to use only their bayonets, as bullets might injure some of the hostages.