Hernán Cortes is related to the history of this house, which initially was a lot donated by the conqueror. Years later John Cermak built his house, which was constructed with stones from pre-Hispanic temples, so it was said that the place was cursed.

The present name dates back to the eighteenth century, when Don Miguel Berrio y Zaldivar, known as the Count of San Mateo Valparaiso, lived in it. In the capital he was the owner of the Palacio de Iturbide, which he occupied as his ancestral home.