The people anciently occupying Le Velay were the Velauni, and they had their capital at Rheusio, so called from rhew, the Celtic for cold; and that was at S. Paulien. There also was the first seat of a bishop, but S. Evodius (351-374), whose name has been corrupted into Vosy, transferred his throne to Le Puy, then called Anisium. It is supposed that a dolmen stood on the platform now occupied by the cathedral, and that a large slab of trachyte laid down in the porch, its blue colour distinguishing it from the rest, was the capstone. This slab is called the Feverstone, and those with fire in their blood were wont to sleep a night upon it. The earliest mention of a cure performed by this means is in the time of S. Vosy. To the dolmen, if it ever existed, succeeded a Gallo-Roman temple dedicated to a local deity, Adido, conjointly with Augustus.

When Scutarius, the second bishop of Le Puy, was buried, a monument was erected over him. To save the trouble of shaping a stone for the purpose, the mason of that day took a slab on which was an inscription, "Adidoni et Augusto Sex. Tolonius musicus D. S. P.," turned this about and carved on the other side a monogram of Christ, and under that "Scutari Papa vive Deo." The form of the letters, the title of Pope applied to the bishop, not yet restricted to the pontiff at Rome, and the expression of hope so like those found in the Catacombs, speak for the antiquity of this inscription. But it was not allowed to remain where placed; when the present cathedral was built, this stone was employed as lintel to one of the north doorways.

The oldest building in Le Puy is the baptistery of S. John, near to the cathedral. It was much altered in the Middle Ages, but is still an interesting relic of the fourth century. From it was removed the white marble sarcophagus of the fifth century, now in the museum of the town, on which are figured the cure of the paralytic, the cursing of the barren fig tree, and other scriptural themes.

This baptistery was in use till 1791, as the exclusive place where children of Le Puy could be christened. In this Le Puy resembled Florence, Pisa, and other North Italian towns, where baptism was a sacrament reserved for administration at the Mother Church.

The fame acquired by Le Puy as the chief seat of the worship of the Virgin dates from an early but unknown period. Charlemagne in 803 founded ten poor canonries la pauperad in connection with the church; but the great prosperity of the church as an attractive point for pilgrims is due to a black image said to have been brought from the East by Louis IX. But as it happens, the Eastern Church does not tolerate carved images, and contents herself with paintings of sacred subjects. Le Puy was, however, an objective of pilgrimage long before that, for in 1062, Bernard, Count of Bigorre, went thither, and in a fit of devotion vowed himself and his county to Our Lady of Le Puy, and undertook to pay to this church annually a considerable sum of money.

High above the altar is now set up what looks like an Aunt Sally at a fair. It has a black head, from which the garments are spread out like the feathers of a shuttlecock. But this is not the original doll, for that was burned at the Revolution. One might have supposed, perhaps expected, that the clergy on returning to the church would have rejoiced to be rid of such an object of degrading superstition. But not so, they had another black virgin made by a joiner, and dressed it in frills and furbelows, and set it up to receive the adoration of the ignorant and the stupid. One thing they did change; the new doll was made a little less grotesque and uncouth than was the first, of which representations remain.

The original image was of cedar wood, swathed about with bands of papyrus glued to it and partly inscribed. Upon this the features of the face, of negro tint, the flesh of hands and feet and the draperies were painted in distemper, in an archaic style. One story relative to it was that it came from Mount Carmel, and had been carved by the prophet Jeremiah in prophetic ecstasy. What seems most probable is that it was an Egyptian idol representing Isis and the infant Horus. S. Louis may have found this on his crusade to Egypt, and have frankly believed that it was a representation of the Virgin and Child, and so have presented it to the church of Le Puy. It certainly had a suspiciously Egyptian appearance.

Devotion to the original image brought kings and nobles to it, and made them open their purses and pour forth gold, and sign charters delivering over to bishop and chapter vast estates and privileges. The church became extremely wealthy, and it was owing to its wealth that the glorious cathedral was built. The basilica is approached from the west by the Rue des Tables, so named on account of the stalls set out there at the time of the great pilgrimages. At the foot of the ascent is a fountain erected in commemoration of a choirboy, supposed to have been murdered by the Jews in 1320 and thrown into a well. He was given up as lost, when on Palm Sunday he reappeared, took his place in the procession, and told how he had been slaughtered, and how, by the intervention of Our Lady, he had been resuscitated. The mob believed the story, burst into the Jew's house, tore him to pieces, and cast his dismembered limbs to be devoured by dogs.

If they had but looked closer into the matter, they would have discovered that the urchin had been playing truant, and disguised his idleness by a lie.

From the Rue des Tables the remarkable west front of the minster may be seen in full. It is Romanesque in style, of the Auvergnat character, the façade is enriched with stones white and red and black, arranged in alternating bands, in lozenges and in lattice work. The zebra-like appearance is not pleasing. The eye desires repose, and is teased with the intricacy of the pattern.