There was a colored regiment in process of formation at Baltimore, and another was supposed to be organizing at Fortress Monroe.
Both were nominally under Mr. Stearns's supervision, and he inspected the former on his return trip to Philadelphia, and sent his son to investigate and report on the latter. Not the trace of a colored regiment could be discovered at Fortress Monroe, but there were scores of Union officers lounging and smoking on the piazza of the Hygeia Hotel. Mr. Stearns thought that business economy had better begin by reducing the number of officers rather than the pay of the soldiers. On July 28 Major Stearns wrote from Baltimore:
"I am still perplexed as to the mode in which I can best carry out the work intrusted to me. It is so difficult to adjust my mode of rapid working to the slow routine of the Department that I sometimes almost despair of the task and want to abandon it."
No private business could succeed if carried on after the manner of the National Government at that time, and this was not the fault of Lincoln's administration at all, but of the whole course of Jackson democracy from 1829 to 1861. The clerks in the various departments did not hold their positions from the heads of those departments, but from outside politicians who had no connection with the Government business, and as a consequence they were saucy and insubordinate. They found it to their interest to delay and obstruct the procedure of business in order to give the impression that they were overworked, and in that way make their positions more secure and if possible of greater importance.
Major Stearns had found himself continually embarrassed in his Government service from lack of sufficient funds, and the continual delay in having his accounts audited. The auditors of the War Department repeatedly took exception to expenditures that were absolutely necessary, and he was obliged to advance large sums from his own capital in order to provide the current expenses of his agents. In this emergency he returned to Boston and held a conference with Mr. John M. Forbes and other friends; and they all agreed that he ought to be better supported in the work of recruiting than he had been. A subscription was immediately set on foot, and in a few days a recruiting fund of about thirty thousand dollars was raised and placed in charge of Mr. R. P. Hallowell.
On September 1, Secretary Stanton transferred Major Stearns to Nashville, where he could obtain recruits in large numbers, not only from Tennessee but from the adjoining States. Fugitives flocked to his standard from Alabama, Mississippi, and Kentucky. For the succeeding five months he organized colored regiments so rapidly that it was with difficulty the General commanding at Nashville could supply the necessary quota of officers for them. His letter-writing alone rarely came to less than twenty pages a day, and besides this he was obliged to attend personally to innumerable details which were constantly interfering with more important affairs. Serious questions concerning the rights and legal position of the freedmen were continually arising, and these required a cool head and a clear understanding for their solution.
Edward J. Bartlett, of Concord, who was one of his staff in Nashville, stated afterwards that he never saw a man who could despatch so much business in a day as George L. Stearns. He says:
"I shall never forget the fine appearance of the first regiment we sent off. They were all picked men, and felt a just pride in wearing the blue. As fast as we obtained enough recruits they were formed into regiments, officered and sent to the front. When men became scarce in the city we made trips into the country, often going beyond the Union picket line, and generally reaping a harvest of slaves. These expeditions brought an element of danger into our lives, for our forage parties were fired into by the enemy more than once, but we always succeeded in bringing back our men with us. The black regiments did valuable service for the Union, leaving their dead on many a southern battle-field. Mr. Stearns was a noble man, courteous, with great executive ability, and grandly fitted for the work he was engaged in."
At this time Major Stearns's friend, General Wilde, was recruiting a colored brigade in North Carolina, and General Ullman was organizing colored regiments in Louisiana.
Major Stearns's labors were brought to a close in February, 1864, by the eccentric conduct of Secretary Stanton,—the reason for which has never been explained. He obtained leave of absence to return to Boston at Christmas time, and after a brief visit to his family went to Washington and called upon the Secretary of War, who declined to see him three days in succession. On the evening of the fourth day he met Mr. Stanton at an evening party and Stanton said to him in his roughest manner: "Major Stearns, why are you not in Tennessee?" This was a breach of official etiquette on the part of the Secretary of War and Major Stearns sent in his resignation at once. His reason for doing so, however, was not so much on account of this personal slight as from the conclusion that he had accomplished all that was essential to be done in this line. His chief assistant at Nashville, Capt. R. D. Muzzey, was an able man and perfectly competent to run the machine which Mr. Stearns had constructed.