Four villages were laid out: Oleona, named in honor of Ole Bull; New Norway, New Bergen and Walhalla. Sixteen houses were soon under construction at Oleona, all finished within a year.

Ole Bull soon after his arrival selected a site for his castle and garden. Soon as the spot was determined upon, a flag pole of beautiful straight pine was cut, trimmed and placed. By arrangement the name by which the town was to be known was to be pronounced as the flag was unfurled to the mountain breeze; “Oleona” was the name of the home of the Norwegians. Thirty-one cheers, one for each State, were given and three long ones for Ole Bull.

The evening was one of rejoicing and celebration. Bonfires were burning everywhere. Ole Bull made an address and then, taking his violin, played an anthem suitable to the occasion. At the conclusion of the hymn of liberty of old Norway, a gentleman representing the State of Pennsylvania, stepped forward and welcomed Ole Bull and the Norwegians to the United States of America, and to the Commonwealth of Pennsylvania.

Old Bull turned his attention to the erection of his castle, which was built on a high eminence, about 200 feet above the valley below. From this site he could view every part of his colony. A great retaining wall was built at its base, extending one hundred and twenty feet in length and rising to a height of sixteen feet. This wall gave to the place the appearance of a large fortress and resembled some ancient castle of the old world.

A broad road was constructed leading up to the castle, which was broad enough to drive three teams abreast.

Any one familiar with the conditions these colonists had to face, in an almost unbroken wilderness, far from any base of supplies with little money and less business sagacity, can realize that the colony was doomed to failure the very day it started. Bull was compelled to abandon his project with the loss of his wealth, and again play in concert to recoup his fortune.

Ole Bull was a musical genius, but building five cities in the wilds of Potter County was a different thing than playing Beethoven’s Eighth Sonata on a violin. He could move audiences but not mountains.

The title of the lands he bought was defective, and, while it has been charged that he was defrauded by Cowan, there is no evidence to substantiate that. Cowan took back the property and refunded Bull the purchase money.

The castle was never fully completed and never occupied by Bull. The doors and windows were never put in place, and soon after this breaking up of the colony the building began to fall into decay until all that now remains are the cellar and retaining wall.

Ole Bull never again visited the scene of his visionary paradise, but his name is still perpetuated in the town of Oleona.