The Château de Champs, at Champs-sur-Marne was built in its present form for the treasurer Charles Renouard de la Touane in 1699 by Pierre Bullet, architecte du roi. After the first proprietor's bankruptcy, another financier, Paul Poisson de Bourvalais, took up the project. Jean-Baptiste Bullet de Chamblain, the son of Pierre Bullet, finished Champs in 1706.
Ten years later, Paul Poisson was in the Bastille on charges of embezzlement and the château was seized by the Crown. In 1718, it was sold to the princesse de Conti, natural daughter of King Louis XIV of France and his first official mistress, Louise de La Vallière. That same year, however, the princess cancelled a debt by deeding Champs to her first cousin, the duc de la Vallière. When the duke died in 1739, he left the château to his son and heir, the famous bibliophile, Louis César de La Baume Le Blanc. The new duc de La Vallière was later to become a trusted friend of King Louis XV and his mistress, Madame de Pompadour.
Around 1750, the duke added a beautiful rococo salon chinois (Chinese salon) to the château with wall paintings by noted artist Christophe Huet. At the château, Louis César entertained many of the famous writers of the day, including Diderot, Voltaire, d'Alembert and François-Augustin de Paradis de Moncrif, with whom he also corresponded regularly.
After the construction of a magnificent new château at Montrouge around 1750, however, the duke gradually abandoned the Château de Champs-sur-Marne. Eventually, he tried to sell the domain, but he could not find a buyer and was forced to rent it out. Between July 1757 and January 1759, he leased the estate to Madame de Pompadour for 12,000 livres per year. The marquise spent 200,000 livres in less than eighteen months to renovate the château. In November 1757, she received the prince de Soubise there after his defeat at the Battle of Rossbach. As the king did not like the château, the marquise left it at the beginning of 1759. In 1763, the duke finally sold Champs to Gabriel Michel de Tharon (1702–1765), a rich shipowner.