The right has definitely fragmented in the past five years (older conservatives, Trumpers, the alt-right, etc.). You're again getting this wrong and can only think in a "left vs. right" framework (typical of leftists and alt-righters).
The "silent majority" exists in this case especially around wedge issues like trans sports inclusion [0].
[0] https://19thnews.org/2021/05/gallup-americans-oppose-transge...