Maybe one needs additional heads of attention?