If I came to a ludicrous conclusion, like we should eat babies because that would reduce misery, then attack that ludicrous conclusion. But being pro-misery because some people make bad conclusions from being against misery is, well, ludicrous.
Well, it's not obvious that it is, and you haven't made an actual argument here.