But by god, I truly am struggling to switch the other way around, and it takes me months to adjust to the bulking cycle, even with the help of stuff like weed
You could just have good genetics in which your body is resistant to weight gain or you have a low appetite to begin with. As shown by the worldwide obesity epidemic, this is apparently quite an uncommon problem. 75% of country overweight or obese.