Breide Rantzau's son Cai inherited Harritslevgård, and after Cai Rantzau's death, his widow Anne Lykke was the owner of the manor. She had a relationship with a prince - the eldest son of King Christian the 4th. The king was not thrilled about that - Anne Lykke was, among other things. accused of being in contact with a witch and imprisoned. However, she escaped, married a new husband and lived here for years. Harritslevgaard had different owners, before Christiane Hoppe in 1740 inherited the castle from her husband and built Denmark's largest stud farm, a dairy, a beautiful garden and a very successful farm. After Christiane's time, however, things went worse for the changing owners, who sold more and more parts of the land. In 1829, the manor was placed under the Gyldensteen Estate. The estate later sold the castle itself, but still owns land and some of the buildings. The castle is owned by the Schimko family today.