The Château de Fayet is a castle in the commune of Fayet in the Aveyron département of France.
The first lords of Brusque and Fayet were the viscounts of Albi in the 11th century, the viscounts of Béziers and Carcassonne in the 12th century, the counts of Toulouse in the 13th century, and, finally, the lords of Castelnau-Bretenoux in the 14th century.
In the 16th century, the daughter of Guy de Castelnau, Jacquette de Clermont, married Jean V de Arpajon and her dowry was used for the restoration and enlargement of the castle. The stone balustrade, decorated with two harps (the coat of arms of the powerful family of Rouergue), dates from this time.
Henri de Navarre, the future Henry IV, resided for a period in the Château de Fayet and would have seen the row of living rooms that was, at the time, entirely made of papered hangings. Some of these were framed decorations painted using dyes made by Rougier de Camarès. These paintings formed the basis of many frescoes, particularly the ceilings. Themes of these frescoes included symbols of the Compagnons du Devoir, other icons of esoteric significance, rich decorations with precious stones, and also representations of the arts.
The castle belonged to the scions of Jacquette and Jean V of Arpajon, among them François, count of Roussy, whose daughter married the duke and marshal of Biron. In the French Revolution, the latter, old and deaf, was condemned to the guillotine for conspiring against the Republic. Before the execution, the duchess of Biron had time to sell the castle to André Jean Simon of Nougarède, titled baron of Brusque and Fayet by the emperor Napoleon I.