Inhabited since the Roman-Gallic era, Baronville was first a stronghold designed to protect the Voise Valley.

In 1623, the Montescot family built the original chateau. This passed into the hands of the Lattaignant family through marriage; the fiefdom of Baronville was then acquired in 1783 by the Marquis of Aligre, who was the President of the Parisian parliament.

In 1868, the great grandson of the Marquis, the Marquis de Pomereu d’Aligre, destroyed the original chateau, and built the current one, which was required for social occasions during the Second Empire.

During the 20th century, the chateau lived through the trials of war and military occupation, until the present day, when the Count and Countess de Rougé, descendants of the previous owners, are overseeing important restorations to preserve this historic estate for future generations.