There is a well-documented male bias in language comprehension where supposedly gender-neutral words automatically and unconsciously are associated with men and/or masculinity (Hellinger 2002; Stahlberg et al. 2007), which is one of several examples of how men constitute the norm for humanity (Bailey and LaFrance 2017; Bem 1993; Hegarty and Buechel 2006). It has been suggested that gender-fair language reforms, which are linguistic reforms to make language more inclusive, may eliminate this male bias (Douglas and Sutton 2014; Sczesny et al. 2016). However, gender-fair language includes different strategies (Sczesny et al. 2015). To date, few researchers have tested the efficiency of these different strategies in relation to each other regarding the male bias; the few existing studies are also a bit outdated (Gastil 1990; Stahlberg et al. 2001).

In the current experiments, we compare how efficiently different strategies of gender-fair language can eliminate the male bias in language. We specifically test to what extent language reforms using traditional presumed gender-neutral pronouns and nouns, paired pronouns (e.g. he/she), or new actively created pronouns challenging the binary notion of gender can eliminate the male bias. The efficiency of these different forms of gender-fair language is tested in two experiments performed in Swedish and then English. These two languages are similar in having feminine/masculine pronouns (representing she/he) but where the nouns are not conjugated with feminine or masculine gender (Prewitt-Freilino et al. 2012). Moreover, in both languages there have been attempts to add a third, gender-neutral third-person singular pronoun, which complements the traditional gendered pronouns representing she and he. In Swedish, such a pronoun—hen—is well-known to the language’s users. In English, different forms have been suggested, where ze seems to be the most widespread (cf. Fae 2016).

Male Bias in Language

A male bias is best described as an implicit assumption that an undefined person is a man (Merritt and Harrison 2006; Merritt and Kok 1995). This association can occur either by words or inflections with explicit grammatical and/or semantical references to men or masculinity. The association could also occur without any linguistic cues, thereby representing an overall androcentric worldview. The term androcentrism recognizes men as more typically representative for human beings (Bem 1993), and it describes the tendency to treat men and masculinity as the norm (Eagly and Kite 1987).

Examples of wordings that include explicit references to men and masculinity include the use of masculine generics (as discussed by Bailey and LaFrance 2017; Merritt and Harrison 2006), For example, he was previously used as a generic pronoun referring to all individuals regardless of gender identity (see Irmen and Roßberg 2004, for a discussion). Other examples of male bias include when professional roles have suffixes that explicitly refers to a masculine gender, such as chairman (McConnell and Fazio 1996) or the Swedish word ombudsman, which refers to a legal representative. Masculine generics are also found in many plural forms of role nouns. In languages where the form of the nouns are inflected based on the gender of the person holding the role (e.g., teacher in German: die Lehrerin/der Lehrer), the masculine form is most often used as the generic plural form (Stahlberg et al. 2001). In some languages, these feminine/masculine paired forms have been replaced with a neutral form, which most often is the historically masculine form. However, because of its masculine origin, the neutral form still seems to be associated with men and masculinity (e.g., in Norwegian: the word for teacher is now the historically masculine word lærer instead of the paired form lærer/lærerinne; Gabriel and Gygax 2008).

Moreover, words conjugated with the grammatical gender neuter, which is neither grammatically feminine nor masculine, have been found to contain a male bias. Androcentrism might be the explanation to why neutral words without any grammatical cues in terms of feminine/masculine gender still are associated with men and masculinity (Bailey and LaFrance 2017). Because of this trend, neutral words could contain a male bias even though the word is used in a gender-neutral context. A male bias such as this is consequently present even in languages with few linguistic gender markers. For example, the spoken Chinese pronoun tā (meaning she, he or it) most often activates associations of men (Ettner 2002).

The male bias has practical consequences—for example, in recruitment situations. Already in 1973, Bem and Bem showed that women were more motivated to apply for a certain job position when the ad language was actively gender-neutral. Since then, attempts to make language more gender-fair have been proposed. An overall purpose of gender-fair language is to include everybody, regardless of gender and/or sexuality (Douglas and Sutton 2014; Sczesny et al. 2016). Gender-fair language in recruitment situations may result in the idea that the gender balance of the advertised position is relatively equal, making not only men motivated to apply for men-dominated positions, such as being a leader of some kind (Horvath and Sczesny 2015). The major strategies of gender-fair language reforms are feminization, which aims at making women more visible, and neutralization, which aims at removing gender cues (Sczesny et al. 2015).

Gender-Fair Language Strategies

In languages where nouns, verbs, and adjectives are conjugated with feminine/masculine gender, feminization is the most common gender-fair language strategy. An example of this strategy is the use of paired forms, both the grammatically feminine and grammatically masculine (Sczesny et al. 2016). The efficiency of such paired forms in eliminating the male bias has been shown in a study by Stahlberg and colleagues (Stahlberg et al. 2001). German speakers who were asked to name their favorite musician/author displayed a male bias, such that mainly men were mentioned when the question was asked using masculine generics (e.g., Musiker). However, this male bias was reduced when paired forms were used (e.g., Musiker/Musikerinnen), such that the examples also included women. The use of paired forms is also a common strategy in languages with feminine/masculine pronouns but without feminine/masculine nouns, such as English and Swedish (Prewitt-Freilino et al. 2012). In both Swedish and English, paired forms of pronouns (he/she) are common. Even though this strategy increases women’s visibility, and hence creates more diverse mental images to whom individuals referred, previous research is inconclusive regarding whether paired forms can eliminate the male bias. For example, the use of the Swedish paired pronouns he/she (han/hon) has been shown to still contain a male bias (Wojahn 2015).

Neutralization is used to diminish the salience of femininity or masculinity in language— for example, when the paired feminine/masculine forms are replaced with the historically masculine titles, such as when (for example) author versus authoress are replaced in favor of a neutral use of the suffix-less form author (Formanowicz et al. 2013). Neutralization is most common in languages where nouns are not conjugated with feminine or masculine gender, such as English and Swedish (Prewitt-Freilino et al. 2012). Another neutralization strategy is to create new words, such as when firefighter and police officer replace the terms fireman and policeman (Sczesny et al. 2016).

Yet another neutralization strategy is the English use of singular they as a gender-neutral generic third-person singular pronoun, mainly used when the gender of someone is unknown (Bodine 1975; Harris et al. 2017; LaScotte 2016; Madson and Hessling 1999; Richards et al. 2016). Singular they, however, can also be used to transcend the binary gender of he/she and hereby refer to an individual with a non-binary gender identity (McGlashan and Fitzpatrick 2018; Zimmer and Carson 2012). Singular they has in some studies been shown to contain a male bias (Bailey and LaFrance 2017; Switzer 1990) even though the results are inconsistent (Gastil 1990; Hyde 1984).

Instead of using existing words as generic, an additional strategy is to create new words, especially gender-neutral third-person singular pronouns, in order to break with the binary gender system (Wayne 2004). Regarding pronouns, such initiatives are found in languages with binary gendered third-person singular pronouns representing she and‘he, often in LGBTQ+ communities. For example, in English a wide range of possible gender-neutral third-person singular pronouns has been suggested, such as ze, ve and xe (Grant et al. 2011; Harris et al. 2017; Stotko and Troyer 2007). The probably most well-known pronoun of these is ze (cf. Fae 2016). Whereas singular they has been used both as a generic pronoun and/or when gender is unknown, as well as a referring to individuals with non-binary gender identities, ze is more specifically referring to individuals with non-binary gender identities. However, even though ze might be the most wide-spread English alternative, the word does still not seem to be known to the broader population of English language users (cf. Harris et al. 2017; McGlashan and Fitzpatrick 2018; Zimmer and Carson 2012). Pronouns derive their meaning from the context (cf. Chung and Pennebaker 2007), indicating that even though the language user is not familiar with the word, the context reveals that the new word has the function of a pronoun. Hence, even though ze is not well-known, a reader may still infer its meaning from the context and understand it.

Similar attempts have been made in many other languages, largely stemming from LGBTQ+ communities. In Swedish, the gender-neutral third-person singular pronoun hen has been intensively debated during the last decade. Swedish hen can be used as a generic pronoun when gender is unknown, irrelevant, or when the target is anonymous or as a pronoun specifically referring to individuals with a non-binary gender identity. This means that hen actually is used both as singular they and as ze.

The implementation of hen was preceded by a heated and polarized debate which started in the 2010s, and many Swedish language users still dislike the word (Bäck et al. 2017a, b; Gustafsson Sendén et al. 2015; Lindqvist et al. 2016). Nonetheless, this public debate led hen to become well-known to the Swedish-speaking population. In fact, as many as 95–99% were familiar with the word already in 2012–2015 (Gustafsson Sendén et al. 2015). In July 2014, hen was included in The Swedish Academy Glossary (SAOL), constituting the (unofficial) norm of the Swedish language.

Overview of the Present Experiments

The aim of the present research is to compare how different types of gender-fair language reforms may eliminate the male bias. We contextualize the present research in a recruitment situation, partly because we wanted to have a solid cover story to remove the focus from our aim, but also because this is of particular applied relevance in recruitment situations. Previous research has shown that a male bias during recruitment situations can lead to a preconception that men are the most suitable candidates (Lassonde and Brien 2013), which may lead to higher preferences to hire a man. We performed two experiments, one in Swedish and one in English. We tested the overall strategies of feminization and neutralization using three types of conditions as stimuli: (a) paired forms (he/she [han/hon] in English and Swedish), (b) neutral traditional nouns and pronouns (“the applicant” in both English and Swedish; NN in Swedish: nomen nescio, which is Latin for “don’t know the name”; singular they in English), and (c) new actively created gender-neutral pronouns (Swedish hen and English ze).

The first strategy represents feminization whereas the two latter strategies represent different forms of neutralization. Participants in our two experiments read an anonymous summary of a job candidate applying for a gender-neutral position (in terms of the sector being gender-balanced). We varied how the candidate was being referred to according to the three types of stimuli. Participants were then asked to indicate what gender they believed the job candidate had. In both experiments we used photographs ostensibly showing potential candidates to assess the dependent variable. We define a male bias as the situation when a word activates mental representations of a man to higher frequency than would be expected by chance. If a word does not contain a male bias, participants should choose a photo at random, resulting in a 50/50 distribution of photos of women/men. Hence, for methodological reasons we chose to force participants to associate to binary gender categories.

Following existing literature, our hypothesis is that existing words (nouns or pronouns) used in a new gender-neutral way still might contain a male bias and hence be associated with men and masculinity. However, invented new words which lack traditional, androcentric associations to men and masculinity might hence be free from a male bias (cf. Wayne 2004). We proposed three hypotheses: (a) paired forms of he/she contain a male bias (Hypothesis 1), (b) grammatically and thereby supposedly gender-neutral nouns contain a male bias (Hypothesis 2), and (c) actively created gender-neutral pronouns without grammatical cues about gender do not contain a male bias (Prediction 3). Experiment 1 was conducted with Swedish language users whereas Experiment 2 was conducted with U.S. English users.

Experiment 1 – Swedish

Method

Participants

A total of 417 college students (Mage = 28.2, SD = 8.0, range 18–68; self-identified as 303 women, 85 men, 24 with non-binary gender identities, 5 did not indicate gender) completed an online survey. One more person participated in the study, but did not respond to the dependent variable question, and was hence not included in the analyses. The survey was created using the web tool Qualtrics and distributed to a participation pool at the University of Gothenburg in Sweden. This pool mainly consists of current and previous students of different disciplines. The inclusion criterion for participating was being fluent in Swedish.

Design and Procedure

The design included four between-subjects conditions. Participants read a description of a candidate ostensibly written by a professional recruiter, where the candidate was referred to using; (a) the Swedish actively created gender-neutral pronoun hen, (b) the paired pronouns he/she (han/hon in Swedish), (c) the gender-neutral noun NN (nomen nescio; Latin for “don’t know the name”), or (d) the gender-neutral neutral noun “the applicant” (den sökande in Swedish). We included two versions of supposedly/grammatically neutral nouns in order to thoroughly test the male bias.

Participants were informed that the study was about evaluating candidates for a certain job position in a recruitment situation. The questionnaires were introduced with a job advertisement for a gender-neutral position as real-estate agent. This profession has an equal balance between women and men, based on legal gender, according to official Swedish statistics (SCB 2018). Subsequently, participants read the description of a candidate applying for the position, where the candidate was randomly referred to as one of the four conditions. Both the advertisement and the summary were balanced regarding agentic/communal words to avoid any other biases associated with gender. (The stimuli materials can be found in an online supplement.)

The outcome variable in terms of gender-associations of the candidate was measured by asking the participants to select which photo they believed showed the candidate. Four photos (bought from iStock: https://www.istockphoto.com/; the photos can be found in an online supplement) were presented in a randomized order, showing two typically feminine White women and two typically masculine White men. The pictures were chosen based on a pilot study where participants (n = 25) rated 10 photos (5 women and 5 men). The pilot study validated that the two women were perceived as feminine women, whereas the two men were perceived as masculine men. The women were perceived equally feminine as the men were perceived masculine, which means that that the femininity ratings of the two women were as extreme as were the masculinity ratings of the two men. Moreover, the four chosen photos were rated as plausible candidates for a real estate agent position. This made certain the photos were externally valid and perceived to be realistic. They were also matched on relevant factors such as attractiveness, emotional expression, and age. The chosen pictures were collapsed into a binary gender category. Hence, regardless of which one of the women or men the participants chose, they were coded as responses of either woman or man. Because of face validity we also included other questions as fillers; these were, however, not relevant.

Results and Discussion

To test the male bias associated with the different conditions, we used Chi-square tests. Hence, we analyzed if the distribution of chosen pictures significantly differed from 50/50, which would imply no male bias because the photos then would have been selected at random.

The wording used in the description of the candidate (hen, he/she, “the applicant”, NN) significantly impacted participants’ gender associations, χ2(3, n = 418) = 9.88, p = .020, ϕc = .15. Both the neutral nouns “the applicant” (67.9% male), χ2(1, n = 103) = 13.3, p < .001, ϕc = .36, and NN (66.9% male), χ2 (1, n = 103) = 11.9, p = .001, ϕc = .34, contained a male bias. The percentages correspond to the selection of a photo of a man and confirms Hypothesis 2. The paired forms he/she (50% male), χ2he/she(1, n = 106) < 001, p = 1.01, ϕc = .10, and the actively created neutral pronoun hen (56.2% male), χ2hen(1, n = 105) = 1.61, p = .205, ϕc = .12, did not differ from chance levels. In other words, neither hen nor he/she contained a male bias, which confirms Prediction 3 about actively created gender-neutral words but not Hypothesis 1 about paired pronouns.

Experiment 2 – English

To further extend the results from the Swedish language in Experiment 1, we tested whether the two gender-fair language strategies would have the same effect in English.

Method

Participants

A total of 411 participants (Mage = 35.8, SD = 11.6, range = 19–72; self-identified as 145 women, 252 men, 5 transwomen, 4 transmen, 3 with non-binary gender identities, 2 did not indicate gender) completed an online survey experiment. They were recruited through the online participant pool Prolific (Palan and Schitter 2017). Selection criteria for participating were that participants should live in the United States and have English as their first language.

Material and Design

We used the same design as in Experiment 1 where the participants read about a candidate applying for a job as real estate agent, this time with the four between-subjects conditions: (a) actively created, gender-neutral pronoun ze, (b) the paired pronouns he/she, (c) gender-neutral (singular) they, or (d) gender-neutral “the applicant.” The outcome variable of this experiment was the same as in Experiment 1, where the participants selected which one of (the same) four photos they associated with the candidate (see the online supplement). Following the procedure of Experiment 1, the responses were first collapsed across gender of the portrayed person such that that choosing any of the two women was treated as a gender association to a woman, whereas choosing any of the two men was treated as a gender association to a man.

As mentioned, Swedish is the only language so far where an actively created gender-neutral third person pronoun singular is well-known to a broad range of the language users. To examine if English counterparts (like ze) were known to our participants, we also added a question about familiarity of English gender-neutral pronouns. At the end of the questionnaire, after having read about the job candidate and indicated their gender, participants were asked to indicate with which of the following actively invented gender-neutral third-person singular pronouns they were familiar: ze, ve, ne, xe. We also asked about their familiarity with the singular they. For each of the five pronouns, participants could choose any of the alternatives “not familiar”, “familiar, have not used,” and “familiar, have used”. Participants could also indicate any other gender-neutral third-person singular pronouns with which they were familiar.

Results and Discussion

As in Experiment 1, we assessed male bias using Chi-square tests to analyze if the distribution of gender associations differed from chance levels. The wording used in the description of the candidate (ze, he/she, singular they, “the applicant”) significantly impacted participants’ gender associations, χ2(3, n = 411) = 13.23, p = .004, ϕc = .18. The gender-neutral noun “the applicant” was again mainly thought to be a man (62.1% male), χ2(3, n = 103) = 6.07, p = .014, ϕc = .24, which confirms Hypothesis 2. The same result was obtained for the gender-neutral (singular) they, where 68.4% of the participants associated they with a masculine gender, χ2(3, n = 95) = 12.9, p < .001, ϕc = .37, which also confirms Hypothesis 2. However, following the Swedish results, 44.0% associated the paired he/she with a masculine gender, a result which did not significantly differ from the 50/50 distribution, χ2(1, n = 116) = 1.69, p = .194, ϕc = .12, failing to confirm Hypothesis 1. A total of 49.5% of the participants in the actively created, gender-neutral ze condition selected a photo of a man, not differing significantly from a 50/50 distribution, χ2(1, n = 97) = .01, p = .919, ϕc = .01, thus conforming with Prediction 3. The results corroborate those from Experiment 1 in that both the paired form he/she and the new created gender-neutral pronoun ze did not show a male bias.

Among the participants reading about ze, there was no significant difference in gender-association of the candidate, depending on if the participants were familiar with the word ze or not. Those who responded that they were familiar with the word but never used it (n = 31) chose a man 58% of the time whereas those who were not familiar with the word (n = 48) selected the man 62.5% of the time—a significant difference, χ2(1, N = 79) = 3.76, p = .153, ϕc = .22. Moreover, both percentages did not differ significantly from 50/50 chance: χ2familiar(1, N = 48) = 3.00, p = .083, ϕc = .25; χ2unfamiliar(1, N = 31) = .29, p = .590, ϕc = .10. These latter tests suggest that an actively created gender-neutral pronoun can eliminate the male bias, regardless of whether the reader is familiar with the word or not.

Additionally, we tested whether participants were familiar with different gender-neutral third-person singular pronouns. Table 1 shows the familiarity of the pronouns, a total of 326 participants (79.3%) of the participants responded to this question. As can be seen in the table, almost all of the participants who responded to this question were familiar with singular they, however, fewer were familiar with the other pronouns ranging from ze, xe, ve, ne. This pattern supports our contention that the singular they is not in the same category as the newly created gender-neutral alternatives, instead constituting a familiar word with a simple different use (i.e., singular rather than the conventional plural).

Table 1 U.S. participants familiarity with presumably gender-neutral English pronouns
Full size table

Participants also reported the other gender-neutral third-person pronouns with which they were familiar: ey (4), it (4), s/he (3), zhe (2), shim (1), zim (1) and even hen (1). Compared to the process when hen was implemented in the Swedish language, not many Swedes were familiar with the pronoun when the heated debate about the word sparked off in 2010 (see Bäck et al. 2015). Already 3 years later, in 2013, more than 95% of the Swedish participants were familiar with the word (Gustafsson Sendén et al. 2015). This implementation is partly a result of active feminist language planning (cf. Milles 2011) which could be used to make, for example, ze a common and well-known word in the English vocabulary.

General Discussion

The aim of the present research was to evaluate different gender-fair language strategies with regard to eliminating the male bias in language. In two experiments performed in English and Swedish, we showed that both a feminization strategy in terms of the paired pronouns he/she and a neutralization strategy in terms of the newly created gender-neutral English pronoun ze or Swedish pronoun hen seemed to successfully eliminate the male bias. However, the neutralization strategies in terms of existing, presumably gender-neutral nouns such as “the applicant” in Swedish and English or NN in Swedish did not eliminate the male bias; neither did the English singular they, which confirms the suggestion to actively invent new words in order to avoid a male bias (cf. Wayne 2004).

Hence, both of the actively created pronouns ze and hen could eliminate a male bias. However, this was not the case with the gender-neutral pronoun singular they. At this point, we can only speculate about the causes of this difference in male bias of the different neutral pronouns. One hypothesis is that since singular they is a traditional pronoun with a long history—even Shakespeare used they as a generic third-person pronoun singular (Zimmer and Carson 2012) —so it might still elicit heuristics of androcentrism. In other words, one speculation is that traditional words may evoke the implicit view that the undefined person is a man. As a contrast, both actively created gender-neutral pronouns ze and hen challenge the binary gender system, which may be effective when eliminating the male bias. Perhaps new constructions require people to actively think, which might eliminate the gender bias. However, more research is needed to draw such conclusions.

Regarding the neutral nouns used as stimuli in these experiments (“the applicant” in both languages; NN in Swedish), they seem to contain a male bias both in English and Swedish. A common argument against the use of hen in Sweden is that there are other words to use if one wants to express gender-neutrality (Vergoossen et al. 2016). The current research shows that this is not the case; other presumably neutral words contain a male bias and can accordingly not be seen or treated as truly neutral. These findings are in line with previous research which shows that neutral, albeit masculine generic, wordings contain a male bias (Gabriel and Gygax 2008). We extend on these findings and show that even when there is no grammatical reference to gender, neutral nouns can still be associated with men. An interesting venue to pursue would be to investigate if other presumably neutral wordings contain a male bias as well, for instance, wordings such as parents instead of mums and dads and child instead of daughter or son.

Even though the paired pronoun form he/she did not evoke a male bias, it should be noted that this wording still refers to gender as a binary category consisting of women and men (cf. cisgenderism; Ansara and Hegarty 2014). Because there are many other gender identities, between and/or outside the traditional notion of gender as a binary category, other wordings than he/she should be considered (see e.g., Harris et al. 2017).

An interesting finding is that even though most participants were not familiar with the pronoun ze, they still seemed to be able to understand it. Because pronouns derive their meaning from the context (cf. Chung and Pennebaker 2007), it seems that people are able to grasp its meaning without being familiar with it. In comparison, most Swedish language users are familiar with the word hen and its use (Gustafsson Sendén et al. 2015).

Practice Implications

Feminists often argue that language can be used to reduce stereotypes and implicit discrimination (Hellinger 2002), and gender-fair language has already been suggested to have an applied impact in, for example, recruitment situations (Bem and Bem 1973; Horvath and Sczesny 2015). Our research adds to the current research on gender-fair language by establishing how the feminization and neutralization strategies using both traditional and new words may eliminate the male bias in language comprehension. Our results show that some traditional “neutral” words are not perceived as gender-neutral, thereby calling for the implementation of words that do not activate mental representations of an androcentric world view.

Limitations and Future Research Directions

Some limitations are worth noting in relation to the present research. First, we forced participants to make binary gender associations. This was a deliberate choice because we wanted specifically to test the associations to a man—not how gender associations in general were elicited by different wordings. However, future research should include individuals with non-normative gender expressions as response options, especially when it comes to the non-male-biased wordings (he/she, hen and ze). This strategy will reveal how these wordings actually are processed in terms of gender associations and categorizations—as generic pronouns to be used when gender is unknown but still implying one of the common genders of a normative woman/man (i.e., a binary bias) or as describing an individual of any gender including non-normative and/or genderqueer expressions.

A note on our samples is also worth pointing out. In the first experiment with Swedish participants, we used a pool consisting of students (and former students) from a Swedish university located in Sweden’s second largest city. We know from previous research that both higher education and living in larger cities are related to more positive attitudes to gender-fair language (Bäck et al. 2017a, b). Moreover, even though Prolific does have a wider range of individuals in their online panel, it is still biased toward younger, more educated, and more liberal individuals (Bäck et al. 2017a, b). Hence, the results may be different using other samples. Nonetheless, because our research did not investigate attitudes but only gender categorization, which should be unaffected by attitudinal position, we believe that this is less of a problem. Also regarding the gender composition of the samples, there were more women in Experiment 1 and more men in Experiment 2. The results were the same, suggesting that gender of participant did not matter. However, effects of participants’ gender were not explicitly tested.

Conclusion

The already identified male bias in language comprehension was found in our results, where the “neutral” individual continued to be associated with a male/masculine gender, even though genderless neutral words earlier have been suggested as alternatives to masculine generics (Madson and Hessling 1999). Nonetheless, the use of the paired pronouns he/she, as well as the use of an actively invented gender-neutral pronoun both in English (ze) and Swedish (hen) seemed to eliminate the male bias. This finding should be of particular interest to the field. Because earlier research on the neutralization strategy still has identified a male bias, it is of great importance to show that a newly created gender-neutral third-person singular pronoun seems to diminish the male bias. However, because the paired form he/she implies a binary gender, other forms such as actively invented gender-neutral pronouns should be considered.