As early as 1636 several colonists settled on this territory; and around 1640 it was necessary to build a chapel for the needs of the church. Thanks to the fertility of the soil and to the abundance of the hunt and of fishing, the population increased rapidly, so much so, that the chapel made of logs was insufficient for the needs of the population. It was then replaced by a church made of stone. Mr. de Queylus, the vicar-general of New France, blessed the new building during the summer of 1658.
In 1661, Château-Richer possessed all the elements that constituted a true parish, i.e., a church (under the protection of Our Lady of the Visitation), an officiating priest and parochial registers which means that this parish actually has more than 300 years of existence. It was erected by Canan Law in 1678.
Its principal buildings occupy a promontory from which one can see from Cap Tourmente to the City of Québec as well as see the Île d'Orléans where lived the ancestor, Nicolas Paquin, at Sainte-Famille. Nicolas had married at Château-Richer.
One legend tells us that a Richer, having constructed a cabin in a tree trunk, the folks called the spot "The Richer Castle", but the historians like to see in that name that of the old prior of Château-Richer in France that Monsignor Laval often mentioned in his letters. It is plausible that the name of this locality is derived from the latter.
Pasteur Paquin, Petite histoire des familles Paquin en Amérique, 1672-1976 (Ancienne-Lorette, Que: Service généalogique Paquin, 1976):