Methodology for determining words:
"To construct these dictionaries, we initially brainstormed more than 300 absolutist words and 200 nonabsolutist words (including extreme words). Testing on pilot data (control and test groups) revealed that many of the words on these original lists were too obscure to register with sufficient frequency for analysis. Consequently, the original dictionaries were reduced to the most prevalent 22 absolutist words and 43 nonabsolutist words (including 21 extreme words). Although this was based on a mostly arbitrary cutoff, it was intended that the lists be large enough to produce representative dictionary percentages, but small enough to facilitate independent validation by experts. The 22 absolutist words and 43 nonabsolutist words were combined into a single list of 65 words. Five independent expert judges were asked to categorize them as absolute, nonabsolute, and/or extreme. Two of the judges are clinical psychologists from the University of Reading Charlie Waller Institute and three are linguists from the University of Reading School of Clinical Language Sciences. Judges were permitted to place words into more than one category (i.e., extreme and absolute). The agreement between our original categorization of the words (absolutist/nonabsolutist) and that of the judges ranged between 83% and 94%, whereas the interjudge agreement was 96%. Words were considered absolute, extreme, or nonabsolute on the basis of a majority decision by the judges. Three words, anything, need, and needed, were moved from the absolutist dictionary to the nonabsolutist dictionary as they were not categorized as absolute by the majority of judges. All the words on our nonabsolutist dictionary were judged nonabsolute. Judges showed almost no agreement on extreme words, this category was consequently removed from the analysis (collapsed into the nonabsolutist category)."