He was just four days out when Captain James Tildwell of the British sloop of war, Abrina, took the Traveller back to Sierra Leone. Captain Tildwell did not understand the arrangement by which Captain Cuffe had four indentured servants on board. The matter was immediately brought to the attention of the Governor and Cuffe was permitted to renew his homeward voyage. Cuffe sailed according to the old rhyme—
If the wind comes before the rain,
Clear the top sails and hoist them again.
If the rain comes before the wind,
Lower the top sails, and take them in.
All went well on sea. But when on April 19, 1812, he reached American waters a grave difficulty beset him. The Traveller was bringing to the United States a British cargo. This was contrary to the existing trade laws. What could be done? A pilot boat, the Daggett, offered to take him to New Bedford where he could interview the authorities. Moreover, it was an opportunity speedily to reach Westport and see his family. So he left the Traveller at sea and took passage on the Daggett.
When he returned, Captain John Cahoone in a revenue cutter had condemned the Traveller for bringing in a British cargo. There was nothing left for Captain Cuffe to do except to carry his cause to Washington and this he decided to do. Accordingly letters of recommendation were prepared to present the case to the Federal authorities. He engaged the services of John Vase, Amasa Robbins, and others to prepare a petition to the Secretary of War. The Collector of Customs approved the petition. Governor Simeon Martin, Judge Constant Taber, former Congressman, G. C. Champlin, as well as John Coggeshall, I. Vernon, Thomas G. Pitman, and Walter Channing, endorsed his papers.
Armed with these letters of recommendation, he started for Washington. On his way he stopped at Providence where his good friend, William Rotch, Jr., gave him counsel and aid. He put Cuffe in touch with Moses Brown, who brought in the services of Thomas Arnold. They called on the Judge and Attorney-General. All favored Captain Cuffe, and Brown and Arnold signed his general letters of recommendation. While in Providence he made his home with Obadiah Brown and attended fore and afternoon meetings. He stopped off at Philadelphia on the 29th of April, to tell John James his troubles. "In travelling through the country," he wrote, "I perceived that the people seemed to have great knowledge of me."
Arriving in Washington on the first of May, he sought Samuel Hutchinson, who accompanied him to call on President Madison, the Secretary of War, and others to whom he had letters of recommendation. "The Secretary observed to me," wrote the Captain, "that French brandy could not be imported from a British port but observed whether it would be inconvenient to me to have it entered for exportation. I then told him my funds were small, and it would lock up my funds. All people appeared very kindly indeed." The authorities at Washington thought his voyage was innocent and laudable. The Traveller and all his property was restored to him without reservation and the government offered its services to him in carrying out his African plans.
On the day following this decision, the Captain started home. "When I took my seat," he wrote, "being the first in, I took the after seat. When the passengers came, in came a blustering powder headed man with stern countenance. 'Come away from that seat.' I was no starter and sat still. He then bustled along and said, 'I want to put my umbrella in the box.' I arose, he then put his umbrella in. He then said, 'You must go out of this for there is a lady coming in.' I entered into no discourse with him, but took my seat; he took his seat beside me but showed much evil contempt. At length the woman and a girl made their appearance. I then arose and invited the woman into the after seat saying we always give way to accomodate the women. We set forward on our journey. On our way at the tavern I was overtaken by Wm. Hunter, member of Congress. He was very free and conversant, which this man above mentioned observed. Before we got to Baltimore he became loving and openly accosted me, 'Captain, take the after seat,' but from the common custom I thanked him, and wished him to keep his seat.