I don't think that's a fallacy fallacy. Fallacy fallacy is when there really is a fallacy in a person's argument, and that fact is used to reason that the argument's conclusion is false.
I think it is a "bike shed" fallacy - where you dive deep into figuring out what kind of a fallacy it actually is and get totally distracted from the original conversation.