That is absolutely not the case. Try HauHauCS's Qwen 3.5 models. They don't refuse anything, and they don't lose a noticeable amount of capability.
That user has produced other interesting models, including aggressively uncensored variants which claim 0 refusals.
I will definitely try it as there can never be too many uncensored AI implementations.