It's only a fallacy if there is no basis for the caustivie chain that results in the effect we find objectionable. That is to say, if there is no clear way to get from point A to point B, it's a fallacy. If the chain of causility from point A to point B is quite clear, it's not.