The Twentieth Massachusetts Regiment was attached to General Stone's Corps of Observation, and was encamped near Edward's Ferry on the Potomac River, some three miles from Ball's Bluff. General Stone was an accomplished soldier and we all respected him as such.
We were part of the Brigade of General F. W. Lander. I had known him well in Salem, where our families resided. He had had a most adventurous life as an explorer, having once crossed the continent from San Francisco to the East, alone, his companion having died on the journey. His courage was unquestioned, and he had military ability.
General Evans, who was the Confederate Commander of the enemy's forces near Leesburg, expected General Stone to attack him from Edward's Ferry, and was slow in moving troops to the vicinity of Ball's Bluff in consequence. On October 20th, General McClellan received information that the enemy had withdrawn from their advanced post at Leesburg, and so advised General Stone, suggesting a demonstration to confirm this fact, or to accomplish it.
General Stone ordered a reconnaissance by a few men from the force on Harrison's Island, which was opposite the high bluff of Ball's Bluff. They crossed in the moonlight, advanced a short distance, and retired, reporting to General Stone that they had discovered a Rebel camp, which afterwards proved to be merely openings in an orchard, which looked to their excited eyes like tents. However, the camp was taken for granted, and five Companies of the 15th, with two companies of the 20th Massachusetts—about 450 men—were sent to capture it. They formed at the top of the Bluff, afterwards moving forward on the right, where they encountered the picket reserve of the enemy, who retreated after a hot skirmish, and the Union force fell back to the Bluff. The companies mentioned had crossed the swiftly moving river in three small boats, whose carrying capacity was 28 persons per trip or 100 or more per hour, from Harrison's Island. The transportation proved utterly insufficient for moving the troops with any reasonable degree of rapidity. There were no pontoons or bridge material, or engineers capable of using them, provided or even thought of, and had not the quick intelligence and resourcefulness of Major Paul Revere discovered a scow, which was afterwards taken out of the canal and into the river, the movement could not have proceeded, especially as there were two howitzers to be taken across.
Colonel Baker, who commanded a Brigade in Landers Command (71st Pennsylvania or so-called California Regiment, and the 42nd New York, or Tammany Regiment), brought battalions of these regiments to reinforce our line, and under direct orders from General Stone, assumed command of the movement. Colonel Baker had some political reputation, and was a brave man, but he had no military experience or knowledge. He was shortly killed by a sharp-shooter from a tree between the combatants. The sharp-shooter immediately met with an accident and fell from the tree. A rush was made forward to bring back General Baker's body, in which I joined, having for the moment no duties to prevent me.
By this time there were many dead and wounded, and we used the boats to send them over to the Island. The cannons were useless,—since the ammunition was exhausted, and the cannoneers killed or wounded. We had seen but little of the enemy during the day, as they were in the woods while our line was in the open, but they had, nevertheless, very seriously made known their presence to us. We were too ignorant to attempt any sort of cover. Later in the war the men learned to cover themselves, while prone on the ground, by piling knapsacks, fence rails, or any handy thing, throwing soil, or stones dug up with the hands or in tin dippers, against the barrier. The strength of the forces engaged was about 1600 Federals, against 3200 Confederates. Had there been proper transportation, this difference could have been remedied, but as it was, we felt our deficiency more particularly when it was decided by Colonel Cogswell of the 42nd New York, who assumed command by seniority after the death of General Baker, to try to force our way through on the left.
He concluded to move to the left of Edward's Ferry, some three miles down the river, where there was a chance of reinforcement, and gave orders to that effect. He formed a column with the 42nd New York and the 71st. Pennsylvania at its head, and moved in that direction, but they were unable to make much progress, owing to the overwhelming fire of the enemy, who threw their whole force against us, and we were forced to fall back.
At this time I could not help observing the courage and gallant bearing of Captain (afterwards Colonel) John Markoe, of the 71st Pennsylvania, and when I met him that night, a fellow prisoner at the Headquarters of Colonel Evans, I claimed his acquaintance. Captain Markoe formed one of our mess at Libby Prison, and thus originated the friendship which lasted through his life.
Meanwhile the wounded men were being slowly carried across the river. Later the enemy threw forward their line, and ours gave way, falling back at the Bluff at about 6 P.M., where we managed to hold on a while longer with our line still intact, and finally under orders continued the movement to the river bank. The men were permitted to save themselves by swimming, if they could, and many attempted this feat. It was not so very difficult for a strong man to cross in this way.
The Confederates could not come down to the Bluff without breaking up their organization, being unable to see, owing to the trees and darkness, what was in their front, and the firing by our men retarded them for some hours. They kept up, however, a continued firing, especially on the boats and the many swimmers. The scow, which had already carried over many wounded, now started on her last trip, but when starting, a number of uninjured men rushed forward, disturbing the trim of the boat, so that half way across the river she rolled over, and all were thrown out. Only one man is known to have escaped drowning. The scow floated down the stream and was lost. The small boats were riddled by bullets and disappeared, and all those who had not escaped were taken prisoners during the night.