In 1566 the palace was set fire by Turks, led by the famed Pialy Pascià; only the outer walls of the building were not destroyed, but that same year, the D'Avalos started its restoration, calling Dominican Valerius De Santis to direct the works.
The rebuilding involved many changes: the courtyard became more regular with the addition of an arcade (today three of the four sides are closed), while on the eastern side a spacious terrace for the apartments of the marquises was added; in the main apartment, facing the sea, it was possible to admire, until a short while ago, the marvelous canopy of the Lords of Vasto.
The sumptuous pallet witnessed, according to a popular legend, the exercise of the " Jus noctis primae ", by the marquis, Innico III, enjoying the favors of the attractive local brides: but deeper historical investigations have discredited this tradition.
And it was actually highly improbable that the inhabitants of Vasto could have accepted such an abuse of power, since for two years, from 1497 to 1499, they had opposed the entrance of the D'Avalos as feudal lords, finally accepting them only after the intercession of Frederic king of Aragona.
The building was also the mansion of Vittoria Colonna, confidant and friend of the celebrated artist Michael Angelo. The fortune of the building was connected to the presence of the D'Avalos. With the death of the magnificent Cesare Michelangelo in 1729, his descendants preferred to take permanent residence in Naples with the court, and consequently the decadence of the palace became inevitable.
Currently the Palace is the center of the archaeological museum and of a picture-gallery. The archaeological section preserves female statues, heads of Aphrodite, Eros, Zeus and Silenus as well as many bronze statues, all represent the figure of Hercules. A section of the Pinacoteque is dedicated to contemporary painting and especially to 19th century art, including works of Filippo Palizzi, Francesco Paolo Michetti and Giulio Aristide Santoro, all artists from Abruzzo.