Count your servings of whole vegetables/fruit. Try to MAXIMIZE these. Yes, maximize in order to lose weight.
It's far easier to track just this small subset of food. If you are maximizing these items, you'll naturally start feeling full and eat less sweets. Try to do this slowly over time, changing your diet dramatically overnight will cause you to hate the process and give up.
Change your diet less than 10% per week, keep eating all of your favorite guilty pleasure foods, just incorporate more healthy foods you enjoy as well, ideally before you eat the less healthy items to give yourself time to start feeling full from them. Slowly find more dishes heavy in vegetables that you like. Try to eat them more often. If you're cooking for yourself or serving yourself, try to increase the ratio of vegetable to other items.
Getting pizza? Maybe do a side salad first or a get a veggie pizza. Don't try to cut the pizza entirely until you're further along in your journey.
Don't stress about it. If you're consistently finding ways to make small changes like this you'll start heading in the right direction over the long haul and your pallet will adapt to enjoy the foods you're not used to slowly.