In 1854 Dr Burton was appointed Secretary to the Prison Board, at a salary of £700 per annum, and was thus relieved of the necessity, which had pressed on him for more than twenty years, of maintaining himself by his pen. On his appointment to this office he removed from Ann Street to the house then 27 Lauriston Place, the site of which is now occupied by the Simpson Memorial Hospital. In 1854 the situation was half rural. The house stood in a good old-fashioned garden of its own, beyond which lay a field containing some old trees; and the house possessed good offices, stables, &c., which were soon adapted to a workshop for Dr Burton himself, and rabbit and pigeon houses for his children.

The productiveness of the garden was marred by incursions of rabbits,—not the children's pets, but wild rabbits, however incredible that may appear, now that the situation has got so entirely separated from the country by new buildings. At that time there was no building between Lauriston Place and Morningside.

Dr Burton, while a widower, had become a more and more frequent visitor at the house of Cosmo Innes in Inverleith Row. The writer does not recollect ever seeing him there along with other company—he preferred finding the family alone. She has met him occasionally in company in other houses—memorably in that of the late Mrs Cunningham, Lord Cunningham's widow—but never, so far as she can remember, in that of her father. He was at that time considered a good talker—his company was sought for the sake of his conversation. His defect in conversation was that he was a bad listener. His own part was well sustained. His enormous store of varied information poured forth naturally and easily, and was interspersed with a wonderful stock of lively anecdotes and jokes. But he always lacked that greatest power of the conversationalist, that subtle ready sympathy which draws forth the best powers of others.

He was invaluable at a dull dinner-table, furnishing the whole frais de la conversation himself; but he never probably appeared to quite such advantage as in the family party at 15 Inverleith Row. His long walks with Mr Innes, sometimes on a Saturday, often on a Sunday, generally ended by his accepting the proffered invitation to dinner on his return. As he was the only guest, nothing could be more suitable or delightful than his amusing the whole circle during the whole time of his stay; and he has himself stated that his attention was first drawn to a shy and particularly silent girl by her irresistible outbursts of laughter at his stories, which outbursts in their turn encouraged him to pour forth story after story of his vast repertory in that sort.

On the 3d of August 1855 John Hill Burton married Katharine Innes as his second wife. He had by that time become accustomed to combine office with literary work, and, with the extraordinary activity and adaptability of his intellect, found them helpful to each other. About the time of his second marriage he conceived the project of his complete 'History of Scotland,' and directed his studies and investigations towards its execution, continuing, as his manner was, to throw off slight foretastes of his greater work as articles for 'Blackwood,' &c. His mode of life at that time was to repair to the office of the Prison Board, in George Street, about eleven. He remained there till four, and made it matter of conscience neither to do any ex-official writing, nor to receive ex-official visits during these hours. He gave his undivided attention to the duties of his office, but has often said that these made him a better historian than he could have been without them. He conceived it highly useful for every literary man, but especially for a historian, to get acquainted with official forms and business. He has himself expressed this opinion fully in his printed works. Returning from his office to dinner at five, he would, after dinner, and after a little family chat in the drawing-room, retire to the library for twenty minutes or half an hour's perusal of a novel as mental rest. His taste in novels has been already described. Although he would read only those called exciting, they did not apparently excite him, for he read them as slowly as if he was learning them by heart. He would return to the drawing-room to drink a large cup of extremely strong tea, then again retire to the library to commence his day of literary work about eight in the evening. He would read or write without cessation, and without the least appearance of fatigue or excitement, till one or two in the morning.

Always an excellent sleeper, he would go to bed and to sleep till nine or ten of the same morning, seldom joining the family breakfast, but breakfasting by himself immediately before going to his office.

In Lauriston Place three more children were born to Dr Burton, a son and two daughters. When the elder of the two little girls was hardly a year old the whole nursery sickened, first of measles, then of hooping-cough. Little Rose, the baby, being recommended change of air, the family went to South Queensferry, and there the baby died, and was buried in Dalmeny churchyard. Some earlier associations had attached both Dr Burton and his wife to the neighbourhood; and during his latter years Dr Burton frequently alluded to this little baby, the only child he lost, being laid there,—and expressed a wish that when their time came, his wife and he should lie there also. His wish was carried out in his own case.

In July of the following year the first company of volunteers formed in Scotland exercised in the field at 27 Lauriston Place. Dr Burton sympathised strongly in the volunteer movement, and joined the Advocates' corps. Though never seriously apprehensive of an invasion of our coasts, he considered it proper that we should increase our military strength while foreign nations were so enormously augmenting theirs. He drilled regularly with the volunteers while they continued to assemble in his field, and until an accident had temporarily lamed him. He marched past the Queen on the brilliant sunny day of the first great Volunteer Review in the Queen's Park in 1860, his wife looking on in the company of his old friend Sir John Kincaid, then an Inspector of Prisons.

27 Lauriston Place was considered sufficiently rural to obviate the necessity of going to the country, and during the six years of its occupancy the family seldom left it. Dr Burton gave his wife a little pony-carriage, by means of which sea-bathing could be had, when desired, from Lauriston Place.

During the year 1860, the new buildings in the neighbourhood spoiled the situation of the house, so as to render it hardly habitable. The field where the volunteers had drilled was built upon almost up to the windows of the house. To escape these disagreeables, a cottage at Lochgoilhead was taken for August and September, and much enjoyed by the whole family. A complete removal was also determined on for the following Whitsuntide.