Seol mar théacs é seo: Anomalous dynamics in two- and three-dimensional Heisenberg-Mattis spin glasses