The news of his death having reached the Secretary of War—the Hon. Simon Cameron—he was, of course, very anxious to have the remains sent back into the Union line for proper burial in his own State.
At that time there was a serious question about the recognition in any official form of the Confederate States of America. It was necessary that the Secretary of War should address a request in some form to an officer in the Confederate Army, requesting the "courtesy" of burying the remains of his brother at home. With Extra Billy Smith it was a question of "curtesy" to the Confederates, and he related with great gusto the amusement the Secretary of War's request for his dead brother's body caused in the Confederate officers' quarters, because it was addressed—"To whom it may concern." Mr. Cameron probably had nothing to do with the formation of the note or request, and it is likely that whoever did it for him was obliged to adopt this, simply because they were ignorant of the names of the proper persons in the Confederate Army to whom it should have been addressed. At any rate, it was a very contemptible piece of work to reply to the Secretary of War that: "The officers of the Confederate States of America did not know that his note, addressed 'To whom it may concern,' concerned anybody but himself."
I made a mental note of Extra Billy's share in this business, determined that old Simon should have him marked.
I presume that about the same general condition of things existed in Washington as in Richmond at the time I was there. There were undoubtedly Rebel spies, and plenty of them, running around loose in Washington, not only at that particular time, but constantly during the years of war which immediately followed.
The Confederates had a very great advantage over us in this regard. Washington City and the Departments were literally full of their sympathizers, who were able to carry on their work of assisting to destroy the Government, which was at the same time feeding them, as they were able to keep up an easy and safe communication through the country about.
Some of these Department Rebel spies remained in the Union Government service not only throughout the war, but even now, after twenty-five years of Republican Administration, are yet in the government service.
In Richmond and the country adjacent it was entirely different. If there were any sympathizers with the Union cause they were known and closely watched, and this was not a troublesome task for the Confederates, as there was not enough of it to occupy much of their attention. As a rule, the colored people were friendly to us, but they were at that time all poor, frightened, ignorant slaves, who dare not, under penalty of the most severe whipping, indicate by the slightest sign that they had any interest in a Union man.
The colored people in Richmond were forbidden to assemble in any number together. If a half-dozen slaves would accidentally get together to talk over the matters of life and liberty, that were so dear to them, it was the duty of any white citizen to order them to disperse. It is not generally known, and may be even doubted by the present generation of Virginians, that there was such a law, but it is a fact. Colored men were not permitted into the Capitol Square at certain times, being excluded by the same municipal law that applied to stray dogs.
It is but just to say that this rule did not apply to Richmond alone, but to Washington as well. In 1861, and previous to the war, the colored boys and girls, as they were all called, even though they were grandfather and mother, were not allowed to enter the Capitol or President's grounds at Washington. They were only permitted to peer through the bars of the great iron fence that then surrounded the grounds.
Every day, as regular as my meal-time occurred, I walked over into the Capitol Square and took my accustomed seat on the bench which gave me such good opportunities to see every person who entered President Jeff Davis' office, as well as a chance to observe the crowd that attended the proceedings in the Capitol building.