I agree, it's just mind boggling to think otherwise. It may or may not be ecologically responsible, but consuming the indirect fruits of bee pollination labor, is distinct from consuming their direct resource of honey, which could be viewed as a "body part" of the larger organism.
By this quiz rationale, your average vegetable wouldn't be vegan because it may rely on animal fertilizer...