Seol mar théacs é seo: Solving CFTs with weakly broken higher spin symmetry