Well, a lot to talk about. I don't have the luxury of time, so I'm not sure how often I'll be able to respond. This is all for now:
Are they creating faulty arguments? We can only assume no. It's hard to create a faulty argument in "disciplines" where the discourse isn't even wrong. We can even make the assumption that they were engaging in mimicry, but this just makes it more amusing.
Actually, it does, but not for the reason you think. It's because if their methodology is mimicry then it reinforces a key insight common to both Turing machines and gender performativity: i.e. that all communication is mimicry. The authors of this study don't actually know anything--or if they do, that knowledge doesn't make a difference.
The data is, in my estimation, the only funny part of the whole thing. If they merely recombined a lot of the jargon together and had it accepted that would simply be Sokal all over again. Just showing that these fields aren't any better twenty some years on. Instead, they add in data to fields that, depending on the academic, reject data in general as irrelevant anyway. These are pretend disciplines who were likely paradoxically giddy that through these articles they were "sciencing".
In that case, the exercise sounds not merely flawed but baroque. It contains distractions that actually clutter the central point, which is (presumably) that their arguments are absurd.
If the data is irrelevant--or better, hypothetically speaking, if the data existed--and the arguments are still sound based on the evidence at hand and the discourses in which they occur, then by what do we judge their absurdity? It seems to me that all we have to go by is a kind of...
value judgment (*gasp*).
There is absolutely no comparison between hard sciences and grievance studies. Novel arguments in hard sciences lead to concrete products or to nothing.
I don't know what you mean by concrete objects, but it sounds presumptuous. Evolutionary theory hasn't produced any "concrete products" that I'm aware of; it simply provided a means of describing species development over time. That subsequent discoveries in genetics support evolution doesn't mean that evolutionary theory produced these discoveries; and furthermore, genetics is yet another theory. It's not as though science is working toward some all-explaining mechanism. It's theories all the way down (or up... not sure). Provided evolutionary theory is, in fact, true, it need not yield some yet-secret mechanism that we haven't discovered. It's not an ontology for species development, just like structuralism wasn't an ontology for what texts are; both are simply ways of describing the world based on evidence.
It's also worth pointing out that of the "grievance studies" disciplines these authors target, only one--gender and women's studies--have actual programs in many universities. The others--sexuality studies, fat studies, even feminist studies--don't actually have departments on all (or in some cases any) campuses. For the most part, they only vaguely describe theoretical discourses from which humanities scholars draw. In this respect, the target of the Areo piece is also admittedly vague, and really discernible only to those who already lump a lot of these disciplines together.
Novel arguments in grievance studies are just adding more and more words to the same basic scaffolding provided by Nietzsche and Marx, and substituting out the specific "oppressors" and the "victims" as needed, with no concrete connection required nor indeed available. It's purely conspiracy theorizing, but of the worst sort. This is the reason Mein Kampf was workable into this framework. At least Jews, and particularly Jewish bankers, were a concrete target for Hitler. "The patriarchy" is completely abstract: it's not even attached to men specifically. Just anything a "feminist" doesn't like is "patriarchy". Cite Judith Butler and now we're academicing!
This sounds less rational than antagonistic.
The problem here is that this doesn't boil down to logic and facts, much to some people's chagrin, but to what kind of research and analysis you find valuable. I think there's value in pursuing cultural contextualizing and historicizing, and that means that even things like "big data" warrant attention as potential objects of critique.
That doesn't mean that data is worthless, directionless, or even harmful necessarily. It just means that data is a tool. It's composed and designed with ends in mind. It doesn't just present itself. Data appears to those who look for it. It qualifies a perspective.