The main supporters of gaming at White's at this time were George Selwyn, Lord March, Fox, and Lord Carlisle.

The latter was of a rather more serious disposition than the others, and had a wife and children to whom he was devoted. Though at times a high gambler himself, he wrote several letters to Selwyn, warning him of the dangers of hazard.

On one occasion Lord Carlisle won £13,000 from a peer, which he never seems to have got, and again indulged in some disastrous play in 1776, after which he wrote to George Selwyn to say that he had never lost so much at five different sittings as on this occasion in one night. A note by Selwyn in the letter puts the sum at £10,000. In after-life Lord Carlisle entirely abandoned gaming, and settled down into an exemplary country gentleman.

Another constant player for high stakes at White's was Sir Everard Fawkener, the writer's great-grandfather, who held an important office in connection with the Post Office. He played cards very badly, and George Selwyn used to say that playing with him was as bad as "robbing the mail."

In the hall of White's Club hangs a carved wooden copy of the whimsical old coat of arms of the Club—the original painting of which is at Arthur's. This was painted by Dick Edgecumbe after the design had been concocted one wet day at Strawberry Hill by the painter, George Selwyn, George (known as Gilly) Williams, and their host Horace Walpole, who had the arms engraved.

The original arms were as follows:—

"Vert (for a card-table); between three parolis, proper, on a chevron sable, two rouleaux in saltire between two dice, proper. In a canton sable, a ball (for election), argent. Supporters, an old knave of clubs on the dexter, a young knave on the sinister side; both accoutred proper. Crest, issuing out of an earl's coronet (Lord Darlington's) an arm shaking a dice-box, all proper. Motto alluding to the crest 'Cogit amor nummi'.[5] The arms encircled with a claret bottle ticket by way of order."