All that remained for Sedgwick to do was to keep straight on the Plank Road toward Chancellorsville. Had he done so at once he would have anticipated the enemy in taking possession of the strong position of Salem Church, and perhaps have captured Wilcox's and Hays' brigades. But it was not intended by Providence that we should win this battle, which had been commenced by a boasting proclamation of what was to be accomplished; and obstacles were constantly occurring of the most unexpected character. After directing Gibbon to hold the town and cover the bridges there, Sedgwick, instead of pushing on, halted to reform his men, and sent back for Brooks' division, which was still at its old position three miles below Fredericksburg, to come up and take the advance. It was full 3 P.M. before the final start was made. This delay gave Hays time to rejoin Early by making a detour around the head of Sedgwick's column, and Wilcox took advantage of it to select a strong position at Guest's House, open fire with his artillery, and detain Sedgwick still longer. Wilcox then retreated toward the river road, but finding he was not pursued, and that Sedgwick was advancing with great caution, he turned back and occupied for a short time the Toll Gate, half a mile from Salem Church, where McLaws' division was formed with one of Anderson's brigades on his left. When Sedgwick advanced Wilcox fell back and joined the main body at the church.
The other brigades of Anderson's were sent to hold the junction of the Mine road and the River road.
When the pursuit ceased, Early reassembled his command near Cox's house and made immediate arrangements to retake the Fredericksburg heights, and demonstrate against Sedgwick's rear.
McLaws formed his line about 2 P.M. in the strip of woods which runs along the low ridge at Salem Church; two brigades being posted on each side of the road about three hundred yards back. Wilcox's brigade, when driven in, was directed to take post in the church and an adjacent school-house, which were used as citadels. This was a strong position, for the rebels were sheltered by the woods, while our troops were forced to advance over an open country, cut up by ravines parallel to McLaws' front, which broke up their organization to some extent, and destroyed the elan of the attack. After a brief artillery contest, which soon ended, as the enemy were out of ammunition, Brooks' division went forward about 4 P.M., and made a gallant charge, in which Bartlett's brigade, aided by Willston's battery, captured the buildings and drove in part of Wilcox's line. The New Jersey brigade charged at the same time on his right, and Russell's brigade on his left. Wilcox placed himself at the head of his reserve regiments, and aided by Semmes' brigade, made a fierce counter-charge. The combat for the school-house raged with great fury, each party breaking the other's line and being broken in turn. Finally, after much desperate fighting, Bartlett was obliged to yield the portion of the crest he had held which was a key to the position; for as he was not strongly and promptly reinforced, as he should have been, his withdrawal from the church and school-house made a gap which forced the other portions of the line to retreat to avoid being taken in flank. Brooks was therefore driven back to the shelter of the guns at the Toll House. Then Newton's division came up and formed on his right and part of Howe's division on the left.
The Union artillery was well served and destructive, and as Newton had arrived, McLaws found his farther progress checked and was glad to get back to the ridge. Bartlett's attack should have been deferred until Newton's division was near enough to support it. In that case it would undoubtedly have succeeded.
Sedgwick's left now rested on a point nearly a mile from Salem
Church, while his right under Wheaton was somewhat advanced.
Up to this time the fight had been between Brooks' division and McLaws' mixed command. It was now decided that a second attempt should be made by Newton's division, but Newton states that the design was abandoned because Howe's division, which was to support him, had gone into camp without orders, and was not immediately available. Before new arrangements could be made darkness came on, and both armies bivouacked on the ground they occupied. Brooks' division in the assault just made had lost 1,500 men, and Sedgwick no longer felt confident of forcing his way alone through the obstacle that beset him. Nevertheless, trusting to the speedy and hearty co-operation of Hooker, he stood ready to renew the attempt on the morrow, although he foresaw the enemy would fortify their line during the night and make it truly formidable.
When Wilcox left Banks' Ford to aid in the defence of Salem Church, General H. W. Benham of the United States Engineer Corps, who commanded an engineer brigade there, threw over a bridge at Scott's dam, about a mile below Banks' Ford, to communicate with Sedgwick, enable him to retreat in case of disaster, and connect his headquarters with those of Hooker by telegraph.
Hooker disapproved the laying of the bridges, which he thought superfluous, as Sedgwick's orders were to keep on to Chancellorsville. Warren took advantage of this new and short route to return to the main army, in order to give Hooker information as to Sedgwick's position. He promised to send back full instructions for the guidance of the latter.
As soon as the bridge was laid, General J. T. Owens with his brigade of the Second Corps, which had been guarding the ford, crossed over and reported to Sedgwick.