Seol mar théacs é seo: Constraining the role of star cluster mergers in nuclear cluster formation: simulations confront integral-field data