Understanding attitude measurement: exploring meaning and use of the PATT short questionnaire

The pupils’ attitudes toward technology survey (PATT) has been used for 30 years and is still used by researchers. Since it was ﬁrst developed, the validity of the questionnaire constructs has primarily been discussed from a statistical point of view, while few researchers have discussed the type of attitudes and interest that the questionnaire measures. The purpose of this study is to increase the knowledge about student interpretations and the meaning of their answers in the recently developed PATT short questionnaire (PATT-SQ). To research this, a mixed methods approach was used, where the qualitative data from six interviewees (students aged 14) help to explain and interpret the quantitative data from 173 respondents (students aged 12–15). The interviewed students completed a Swedish version of the PATT-SQ 3 weeks prior a semistructured interview. The results from this study imply that the PATT-SQ survey can be used mostly as it is, but this study also shows that there are some categories that require some caution when being analyzed and discussed. For example, the gender category cannot be used as intended since it does not measure what it is supposed to and it might be gender-biased. The interest category can advantageously be reduced to four items to focus on school technology, which will indicate how deep a student’s well-developed individual interest is. And the career category seems to only detect students’ who urge a career in technology, while the other students lack knowledge about what that career might be and therefore they are not interested in such a career.


Introduction
The study of pupils' attitudes toward technology (PATT) has a long history in technology education research. The PATT questionnaire was developed in the 1980s by Raat and de Vries (1986). The researchers intention was to explore students' interest in and attitudes toward technology. In the PATT questionnaire, students' attitudes toward the technological field are surveyed from a range of perspectives, such as their career aspirations in technology, interest in technology and technology education. It was considered interesting to use the data to strengthen the subject's status and to show that technology as a school subject was important for younger children as well. The first results from studies based on the PATT questionnaire showed, for example, that girls found technology less interesting and less important than boys did (Boser et al. 1998). A PATT survey has been conducted once before in Sweden in 1986 and the results were presented in a report in 1991 (Riis and Augustsson 1991).
Research on attitudes toward technology (and attitudes in general) often aims to find student characteristics that can affect a student's attitude, such as gender, socioeconomic background and parents' occupation etc. (Ardies 2015;Davies and Brember 2001;Lindahl 2003). For example, in the analysis of the first PATT study in Sweden, the main focus was on whether students had an abstract or concrete view on technology and what factors affected this. The concrete view is considered to be demonstrated when students see technology mainly as artifacts. The abstract view is when students see technology as a part of something bigger within a context. The biggest effect was dependent on the schools' demographics, for example, students with well-educated parents, who lived in one-family houses, had a more abstract view on technology (Riis and Augustsson 1991). The PATT survey has often been used to point out gender differences in attitudes toward technology (e.g., Bain and Rice 2006;Hendley et al. 1996;Volk and Ming 1999). This is also the case when adding attitudes toward science (and technology), as reported in a systematic review by Potvin and Hasni (2014) where gender differences were the most common theme. Potvin and Hasni also mention a career in science and technology as a commonly researched area.
Since the first PATT studies, the questionnaire has been used on pupils in a range of different countries across Asia, Africa, and new European countries. Even though the first round of PATT studies in the 1980s went through rigorous validation and reliability tests and further development by Bame and Dugger (1989), the past 15 years have resulted in few discussions concerning the survey's validity and reliability beyond controlling the internal reliability and/or confirming unidimensionality by factor analysis (e.g., Ardies et al. 2013). The survey as updated by Ardies et al. resulted in a shortened questionnaire, with fewer items, and this was named the PATT short questionnaire (PATT-SQ). Over the years there have been some discussions concerning the PATT questionnaires, but there is a lack of criticism or discussion about the survey's meaning in recent studies. Examples of problems that have been observed, in a South African study using the PATT questionnaire, are that researchers experienced language difficulties within their context, especially regarding the understanding of the word 'technology' (Van Rensburg et al. 1999). Similar problems may occur in the Swedish language since the word 'technology' (Swedish teknik) can have the same meaning as the word for skill or technique (cf. Mitcham and Schatzberg 2009). In the South African study by Van Rensburg et al. (1999) the gender items were also pointed out as problematic since they were non-neutrally expressed. Furthermore, several studies have found that students tended to use the middle option on the Likert scale items in the PATT questionnaire, especially girls (Burns 1992;de Klerk Wolters 1989;Rennie 1988). This would affect mean scores and is explained through the fact that girls tend to look at a statement in a more complex way, and more often choose the middle option when statements have to do with something that they have not yet thought about (Rennie 1988).

Swedish context
Technology as a school subject has been mandatory in compulsory school (school year 1-9) in Sweden since 1982 (Hallström et al. 2014). The national curriculum has been changed and revised several times since then. The last major revision was made in 2011 (The Swedish National Agency for Education 2011), where the following aim can be read in the technology syllabus: Teaching should help students to develop their interest in technology and their ability to deal with technical challenges in a conscious and innovative way. (The Swedish National Agency for Education 2011, p. 254) This aim, to develop interest in the school subject of technology, is not unique to technology; actually developing interest is an aim of all compulsory school subjects except for the social science subjects (The Swedish National Agency for Education 2011). There is an extensive use of this attitude construct in the Swedish curricula and the word 'interest' is referred to more than 50 times.
Since the implementation of the 2011 national curriculum, there has been one quality audit of the technology subject performed by the Swedish school inspectorate. The attitudes of Swedish students were surveyed and the results showed that interest, enjoyment and the perceived importance of technology decreased throughout school years five to nine (ages 11-15), among girls an even larger decrease than with boys (Skolinspektionen 2014). That interest decrease with age in these age groups has also been shown in a Belgian longitudinal study (Ardies et al. 2014). Due to the strong emphasis on interest (and attitudes) in Swedish school curricula, more understanding of what the PATT survey can tell us about students' attitudes is needed. To be able to use data in research there is a need to understand the different survey categories and how students interpret the survey. This will allow us to understand what might affect their attitudes and in turn how technology education may be improved in relation to aims related to attitudes.

Purpose of the study
The purpose of this study is to increase the knowledge about student interpretations and the meaning of their answers in the recently developed PATT short questionnaire (PATT-SQ). Thereby, a better understanding of results from studies using the PATT-SQ (by Ardies et al. 2013) can be gained, so that such studies can better inform us about student attitudes and in turn better inform how technology education may be improved in relation to aims related to attitudes. Taking previous research into consideration, the focus of the study will be on gender problems as discussed by Burns (1992), de Klerk Wolters (1989), Rennie (1988) and the non-neutral expressed statements by Van Rensburg et al. (1999) as well as the possible misinterpretation of the term 'technology' (cf. Mitcham and Schatzberg 2009). The fact that gender and career aspirations are two of the most researched areas (see Potvin and Hasni 2014) makes it relevant to focus on these themes. The interest construct will also be analyzed, since it can be seen as both a field by itself and a construct within attitudes. The research questions for this study are; How can student interpretations and the meaning Understanding attitude measurement: exploring meaning and use… of their answers in the PATT-SQ questionnaire be understood? What can the result tell us about students' career aspirations, interest and gender issues in technology?

Attitudes
Both attitudes and interest can be seen as motivational variables (Krapp and Prenzel 2011) and interest can be seen as a construct within a person's attitude (de Klerk Wolters 1989). Attitudes can be seen through three components; affective, behavioral and cognitive (Breckler 1984;Fishbein and Ajzen 1975). Attitudes toward a topic (like technology) are based on a person's beliefs about that topic and those beliefs have an influence on the behavior (Fishbein and Ajzen 1975). A person's beliefs, can, on the other hand, be weakened or strengthened and even replaced, which can lead to a change in attitude. In some cases, attitudes toward technology positively correlate with students' knowledge (Garmire and Pearson 2006), meaning that a clearer concept of technology among pupils, would also improve positive attitudes toward technology (Rohaan et al. 2010).
The early versions of the PATT questionnaire (e.g., Bame and Dugger 1989) include two main parts. One part where the cognitive component is surveyed by 31 statements. And one part, the PATT survey's main part, including 58 statements (same as the part that was shortened and named PATT-SQ) that is suitable for assessing a students' affective component (Ankiewicz et al. 2001;Van Rensburg et al. 1999). This means that the student's emotional engagement in technology and technology education is surveyed. The PATT questionnaire also includes an essay type question about technology and one part surveying student characteristics (Bame and Dugger 1989).

Interest
Interest is one category within the PATT questionnaire that is surveyed, but what kind of interest does the survey measure? A person's knowledge can at any time become an object of interest (Krapp 2002). It can be stated that an interest has to be toward something, for example, technology education (Krapp and Prenzel 2011) and it can be seen as a motivational factor for becoming engaged with the subject (Hidi and Renninger 2006;Krapp 2002). Interest can be divided into Situational Interest and Individual Interest. Situational interest can take place in a specific situation that will trigger an interest, while individual interest is based on the person's own underlying beliefs (Hidi and Renninger 2006). On a more general level, some studies have found that interest in a subject can correlate positively with knowledge in that subject, especially in higher grades (Krapp 1999). Hidi and Renninger (2006) identify four phases of interest that can be used to reach a higher state of interest among students in school. The first phase is triggering situational interest followed by maintaining that interest in the second phase. The next phase is to develop an individual interest which mostly is self-generated, but can be assisted by tasks that will lead to an increased understanding of the specific subject. The fourth phase is a well-developed individual interest, characterized by positive feelings about the subject and an urge to become more deeply engaged in the specific object of interest.
The PATT-SQ surveys' statements regarding interest focus on the will to gain more knowledge, especially through school technology. A high mean score on the interest scale should, therefore, indicate a well-developed individual interest, as presented by Hidi and Renninger (2006).

Method
In order to gather more knowledge about what the PATT questionnaire can tell us about what affects pupils' attitudes toward the technology subject and technology in general, a mixed methods approach was used with a modified PATT-SQ questionnaire and interviews with pupils that had taken the questionnaire. With this Sequential exploratory design, the qualitative data will help to explain and interpret the quantitative data; the students' survey score (Robson 2011).

Quantitative data collection
To measure students' interest in and attitudes toward technology, PATT-SQ was used (see Ardies et al. 2013). The survey consists of 24 items which the student responds to on a 5-point Likert scale. The respondent chooses how well he or she agrees with a statement. To analyze the data the items are grouped into several constructs/categories (Lovelace and Brickman 2013). The used PATT-SQ survey (Ardies et al. 2013) consists of six different categories which are presented below with an item example: 1 Career-Respondents' career aspirations in technology Example item: ''I would like a career in technology later on'' 2 Gender-Gender patterns in technology Example item: ''Boys are able to do practical things better than girls'' 3 Consequences-Consequences and importance of technology Example item: ''Everyone needs technology'' 4 Interest-Interest in technology and technology education Example item: ''There should be more education about technology'' 5 Difficulties-Perceived difficulty in the technology subject Example item: ''To study technology you have to be talented'' 6 Boredom-Perceived boredom with technology Example item: ''I do not understand why anyone would want a job in technology'' To control the categories internal reliability, Cronbach's alpha (a) was measured for each category (Lovelace and Brickman 2013). The aim is an a-value [0.70 as recommended by Lovelace and Brickman (2013). In this specific study, the interest category was reduced, from six to four statements, to enhance focus on interest in school technology and not technology in general. This is because an interest in something can be followed by an engagement in the same (Hidi and Renninger 2006;Krapp 2002): in this case an engagement in the school subject of technology. All six statements were surveyed, but the four statements regarding school technology can be analyzed separately.
The gender items were elaborated into three different survey versions, to test potential problems related to the items. The first survey version included the original three statements ''Boys are able to do practical things better than girls (referred to as Gender M)'' (Ardies et al. 2013;Bame and Dugger 1989). The second survey version included the same three statements, but boys was changed to girls ''Girls are able to… (referred to as Gender F)'', The third survey version included both types of statements ''boys are able to… and girls are able to… (referred to as Gender F ? M)''. This made it possible to study the impact of the non-neutral statements problematized by Van Rensburg et al. (1999). The first (53) respondents were given the survey versions containing either the Gender M or Understanding attitude measurement: exploring meaning and use… Gender F statements randomly, and the later ones (120) were given the third survey version with both types of statements.
In total, four schools were visited to gather data for the study. The schools were selected based on a convenience sample with the intention to get a result from different school types. The sample includes one suburban school, one small town school and two private schools (one urban and one countryside suburban) from different areas and different profiles. In a first round, students in school years 6-8 (aged 12-14) completed the survey, in total 141 students. The survey was distributed in person via one of the researchers, in this way the researcher could easily respond to students' potential questions regarding the survey. To broaden the results, an additional distribution was made, including two more classes in one of the schools (32 students in school years 8-9, aged 14-15), they completed the survey online.

Qualitative data collection
The qualitative data were collected by conducting semi-structured interviews, with the survey as the basis for the questions, to let the respondents speak more freely about the different topics (e.g., the Likert scale, Career, Interest, and Gender). The intention was to extract more information from the respondents than the survey does (Robson 2011). By the sequential exploratory design, the interviews could enable understanding and interpreting, of how the respondent: • Survey scores match the answers given in an interview situation.
• Chose a specific number on the 5-point Likert scale.
• Interpreted the different items.
• Interpreted the word 'technology' in the survey.
The interviewees (six 14-year-olds, three boys, and three girls) were chosen by their teacher with the instructions to choose a variety of students that she experienced had differences in knowledge and interest level in the technology subject. The six interviewed students represent a quarter of their class in school year 8. Since knowledge affects attitudes (Rohaan et al. 2010) an aim of the purposive sample was to get a variety of attitudes (reaching from positive to negative) within the studied survey categories (Career, Interest, and Gender). To prevent bias, these students' level of knowledge and interest was unknown to the researchers. They completed the PATT-SQ survey 3 weeks prior to the interview and their survey results were not included in the quantitative sample. Since all six students belonged to the same school class and had the same technology teacher; the natural variety between schools could be excluded. Therefore, all interviewees had participated in the same technology education class, conducted by the one teacher. They had all participated in technology lessons at age 13, but not during their current semester. The interviews lasted for approximately 15 min. The interviews were audio-recorded and transcribed. Student answers were labeled according to the PATT-SQ survey categories (e.g., Career, Interest, Gender) in the qualitative data analysis software program MAXQDA. This was done to detect underlying thoughts about career, interest and gender issues, where questions had not been specifically directed toward these topics.

Compliance with ethical standards
The ethical research principles for research in the humanities and social sciences put forward by the Swedish Research Council regarding ''information, consent, and confidentiality, and stipulating how research data may be used'' was used (Petersson et al. 2006, p. 83). All participating students were informed about the study, its use and their right to choose to participate or not. All respondents participated anonymously and completed the whole survey. All interviewees agreed to participate in the interview and their legal guardians approved their participation.

Results
The total number of respondents to the survey was 173 (89 girls, 81 boys, 3 N/A). Four of the respondents failed to fill in the paper survey correctly and thus their responses were discarded. In total, there were 169 countable respondents. In addition to this, there were six student interviewees. The results from the qualitative sample can, in a strict sense, only be seen as representative of the six interviewed students, but we argue that the number of students is enough to detect possible problems of interpreting the survey. This since the aim of the qualitative sample collection was to get a variation in attitudes among the interviewees. This variation was clear in both the Career and Interest category (presented in Tables 3, 7). The Gender category was not suitable for mean calculations and therefore variation in mean scores cannot be met (presented in Table 4). The survey and interview results are presented below. The results are presented from how the Likert scale is interpreted, the complete PATT-SQ survey and presentations of the results where the interview and the questionnaire were analyzed jointly in relation to the different categories. The interview questions asked directly toward the topic (e.g., the career category) are presented in the result section for each of the topics.
Researcher's questions, when present, are highlighted by; R The interviewees' responses are only presented by their sex and not by name or numbers since we find no reason to compare the individuals' other category answers.

Likert interpretations
Regarding the problem that girls tend to use the middle option more frequently than boys as revealed in several studies (e.g., Burns 1992;de Klerk Wolters 1989;Rennie 1988) a goal was to understand how the Swedish students in this study interpreted the middle option. To be able to compare the results from Rennie (1988), results in Table 1 are presented in the same way as in that study.
The results presented in Table 1 imply that there might be some differences between the sexes, but very small differences if compared to the studies presented by Rennie (1988, p. 402)  Understanding attitude measurement: exploring meaning and use… All of the six interviewed students agreed quite well on how they filled out the survey and chose the options on the Likert scale. The students were asked when to choose the middle option on the Likert scale.
It's when you don't know if you agree or disagree. They are like, I'm not certain, you might think both sides and don't know what to choose. That you're not sure. That you're not sure if you agree or not.
Their interpretations of the Likert scale were similar and they used the middle option when they did not know if they agreed or disagreed.
Some of the items in the survey were negative statements, which the respondents seemed to understand and chose the Likert option they intended. However, one of the interviewed students misinterpreted one of the negative statements and checked that he was not interested in technology even though he had a strong interest.
Well, then I believe I must have misread it, I am interested.

The survey
Cronbach's a was used to measure the internal reliability within the six different categories. Each category had to have an a [ .70 (Lovelace and Brickman 2013). The Cronbach's a-value is presented with the mean values of each of the categories in Table 2. The different items in each category correlated well with one another except within the Boredom category. With that exception, the results of Cronbach's a showed that the translation and adaption for a Swedish context were reliable. T tests were performed in the areas of focus for this study (Career, Gender, and Interest) and are presented in Table 2. They show that there was mostly a moderate effect [.01 = small, .06 = moderate, .14 = large effect (Cohen 1988)], in the attitudes, depending on the respondent's gender. An exception was the Gender category, which changed from a small effect to a large effect, depending on how the statements were presented.

Career
This category is supposed to tell us if the respondent is, or is not interested in pursuing a technological career. The Cronbach's a value of the career category is acceptable at .91 and therefore reliable. Questions asked to the interviewees were; if they would like a career in technology and what that career might be and their answers are presented in Table 3.
The performed interviews showed that very few of these students seemed to have an idea of what a technological job might be or at least find it difficult to describe. The highmean interviewees ([4.00) in this study all referred to a technological career as an engineer and/or architect. While the low-mean students (\3.00) used the word 'technician' for technology-related work, and in the interviews, these students were urged to explain what they meant in detail. The high-mean students, on the other hand, seemed to be satisfied with just the words 'engineer' or 'architect'. The interviews showed that independently of whether you understand what a job in technology is or is not, a high mean describes an urge to pursue such a career. The low-mean students were not willing to totally cut off that future path, mostly because they were uncertain of what it means. The high-mean students did not give a clearer view of what this career might be.

Gender
The Gender category is supposed to tell us if the respondent experiences technology as an activity for both boys and girls. The Cronbach's a value is acceptable, at .90 for gender M and .87 (see Table 2) for gender F thus the Gender category is reliable either way it is presented. However, the category shows that there are some differences in the answers, depending on how the item is presented. Both boys and girls tended to agree more when the statement started with their own sex, for example, boys agreed more when the statements were phrased as Boys are more capable… (see means of category 2a and 2b in Table 2). Adding the fact that the Cronbach's a value is .86 (see Table 2) when the Gender M and Gender F statements are presented as opposites, shows that there are some issues that might make this category unreliable. The questions asked during the interviews were how the respondents perceived the statements regarding gender and how they would explain their thoughts about those statements (Table 4).
The interviews showed that the mean score does not reflect the students' thoughts on technology as an activity for both boys and girls, therefore the mean score is unreliable.  This since some interviewees said that they either used the middle Likert option or the disagree option within this category consistently, which made the mean values unreliable. The interviewees' answers are supported when calculating the difference in scores  I believe the reason that boys are more commonly found in technological jobs I think is because they have a greater interest than girls. I really think that is the only reason, because I think girls could perform just as well if they were more engaged Understanding attitude measurement: exploring meaning and use… subtracting the means of Gender F from the means of Gender M (Table 5). That result reveals that 41.7% of the respondents chose the same option for every statement (all six statements), even the opposite ones. If the ''gender difference'' is calculated, the mean difference between Gender M and Gender F statements is 0.19, which implies that there is a little more agreement on the statement boys are more capable…, see Tables 5 and 6. All interviewees expressed that differences between boys and girls had to do with individuals, rather than sex. The interviewees explained their own results as they chose the disagree option or not sure option consistently. However, some of the interviewed students indicated that there might be differences, but mostly connected this to either more males being active in a technological career or that males, in general, have a greater interest and therefore performing better in technology.

Consequences
The consequence category carried the highest mean value of all the categories. Students believed that technology is important to us. The Cronbach's a value was acceptable .72 and  Table 2). The interviewed students said that technology ''obviously'' was important since they used it every day.

Interest
The Cronbach's a value was acceptable at .76 for the Interest category and slightly higher when only including the items concerning interest in technology education (.79 in Table 2). This category was, therefore, reliable. In Table 7 the interviewees' responses to questions about interest in general, their interest in technology and where that interest/ noninterest might come from are presented. The interviewees commonly referred to interest by saying a subject was interesting since they found enjoyment within that subject. Only one of the interviewed students noted a difference between those. Interviewees with both high and low interest said that an interest makes you willing to learn more, or the other way around, knowledge is followed by an interest. The interviews revealed that the interest level in the survey matched what was said in the interview quite well, despite their interpretation of interest as enjoyment. On the other hand, there is only one statement in the interest category that actually contains the word interest. The students' descriptions of interest are similar to what would be considered a well-developed individual interest (Hidi and Renninger 2006).

Difficulties
The difficulties category shows how the respondents perceived difficulties in technology and that you need specialist competence to study to become, for example, an engineer. The Cronbach's a value was acceptable .74 (Table 2), and therefore reliable as a category. The interviews confirmed that this category was interpreted as intended.

Boredom
At first glance, the low alpha-value, .63 (Table 2), was considered to depend on the fact that all these statements were presented in a negative way, which might have been harder to interpret. However, this was not the case. There were big differences between boys and girls in category 6 (boys a .748 girls a .494). The Cronbach's a-level was very sensitive when using few items (10 or less), therefore the inter-item correlation and the individual answers were analyzed. The inter-item correlations should range between .2 and .4 (Briggs and Cheek 1986). The inter-item correlation mean in this case was acceptable (.3) and the category is reliable.

Conclusions and implications
Even though the qualitative sample only included six students, they gave us much information on how to use and possibly interpret the PATT survey. To conclude, the interviews with students in this study do not point to any validity problems with the questionnaire, since the students seemed to understand most of the questions in the intended way and how to position their answers on a Likert scale. The usage of the middle option on the Likert scale (Burns 1992;de Klerk Wolters 1989;Rennie 1988) with big differences between boys and girls was not observed in the data for this study, even though there were some differences. One of the interviewed students lacked the ability to distinguish between technology and skills (see Mitcham and Schatzberg 2009) when he discussed football skills and the technique an electrician uses when connecting wires (same respondent in the quotations under both the headlines Career and Interest). This could be problematic since it is difficult to interpret which of these meanings is referred to when completing the survey. This is a problem that several other countries could also encounter and that the researcher needs to be aware of when using the survey (cf. van Rensburg et al. 1999). In these cases, it might be necessary to add some exclusions that explain the distinction between technology and skills/technique in the survey introduction. It is important though that technology is not explained, since you lose the power of letting the students describe technology themselves in open-ended questions as done by for instance Boser et al. (1998) and Raat and de Vries (1986).
Among the interviewed students there seemed to be connections between their expressed lack of knowledge about technology/technological careers and their mean scores. This might have been because these students had a very limited number of technology classes. Most of the answers were reflections considering either their spare time interest or family members' jobs. This out of school experience points to the importance of technology education for offering a more equitable chance of a technological career for all.
The students' descriptions of interest were similar to what would be considered a welldeveloped individual interest in the four-phase model of interest development by Hidi and Renninger (2006) which is characterized by positive feelings about the subject and a deeper engagement. How they placed themselves on the Likert scale (1-5) indicates how deeply the students' well-developed individual interest in technology is perceived. It is clear that all six statements in the interest category had a high a-value (.76, 6 items). If only including the items concerning interest in technology education, though, results in a higher a-value (.79, 4 items). To be able to compare the results regarding interest in technology in general with other PATT studies our recommendation, though, is to continue to survey all six statements. But in order to maintain the existing strong connections between the results in the interest category (PATT-SQ) and the well-developed individual interest as described by Hidi and Renninger (2006), a recommendation is to use the four statements regarding school technology when analyzing the results.
As mentioned, gender is one of the most studied variables when researching attitudes (Potvin and Hasni 2014). This is of course since you often find distinct differences when comparing sexes. This category has to do with how the respondents perceive differences rather than how researchers compare the sexes. The gender category in the PATT-SQ has some obvious problems when it comes to exploring gender differences. The statements in this category seem to trigger gendered reactions to the stated gender differences, and from the interviews, it seems as the students perceive the gender items as invalid statements and therefore do not answer this in a consistent way as a group (individually they do). As a category it is therefore,unreliable, despite an a-value of .90 and .87, and cannot be used only by calculating means as it is intended to do. There are basically two problems with the survey that cause these unreliable means. Firstly, the original statements had a larger difference between the sexes than the opposite statements did. This assumption is enhanced by the t tests (see Table 2). Secondly, many of the students disagreed (1 on the Likert scale) or used the middle option (3 on the Likert scale) for all six statements. Hence an indication of direction is noticeable when comparing the individuals' answers using the opposite stated items as done in this study (Gender M and Gender F). The interviewees also let us know that they tended to agree that boys might be more capable in technologyrelated tasks, meaning that there are more boys than girls that are capable.
From the interviews made in this study, it seems that the PATT-SQ survey does detect the high-interest students and students pursuing a technological career. The low-interest students' responses mainly seem to depend on a lack of knowledge about what a technological career might mean. This can be explained by the review by Rohaan et al. (2010); a clearer concept of technology (or in this case, a technological career) can lead to a more positive attitude. This should be taken into account when using and analyzing results from the survey. Of course, a high interest and a will to pursue a technological career are desirable, but since the low mean scores seem to be dependent on the student understanding and knowledge it might be difficult to use the low mean scores in these categories to draw conclusions. The students' knowledge and out of school experience regarding technology seem to be key factors that affect their attitude score, at least for the students that were interviewed in this study. Therefore knowledge given by school about what a technological career might be could improve students' attitudes toward that career so that students' career choices do not depend on out of school experience.
Finally, the results from this study imply that the PATT-SQ survey can be used mostly as it is, but this study also shows that there are some categories that require some caution when being analyzed and discussed. The interest construct advantageously can be reduced to the four items to focus on school technology, this to use the four-phase model of interest by Hidi and Renninger (2006). A recommendation for future users of the PATT-SQ is to use both Gender M and Gender F (the third survey version), as done in this study and calculate the respondent's difference in scores. To avoid the problems with interpretations of technology as skills/technique, an explanation of what is not meant as technology, for example, ''technology is not good soccer technology [skills]'' should be presented in the survey introduction.