Yes but the point of the phrase "apples to oranges" is that they are hard to compare. But if you comparing something they both have and is easily measurable, such as sugar, then yes you should compare apples to oranges!