# Opportunity-to-learn context-based tasks provided by mathematics textbooks

## Abstract

Based on the findings of an error analysis revealing that Indonesian ninth- and tenth-graders had difficulties in solving context-based tasks, we investigated the opportunity-to-learn offered by Indonesian textbooks for solving context-based mathematics tasks and the relation of this opportunity-to-learn to students’ difficulties in solving these tasks. An analysis framework was developed to investigate the characteristics of tasks in textbooks from four perspectives: the type of context used in tasks, the purpose of context-based tasks, the type of information provided in tasks, and the type of cognitive demands of tasks. With this framework, three Indonesian mathematics textbooks were analyzed. Our analysis showed that only about 10 % of the tasks in the textbooks are context-based tasks. Moreover, at least 85 % of these tasks provide exactly the information needed to solve them and do not leave room for students to select relevant information by themselves. Furthermore, of the context-based tasks, 45 % are reproduction tasks requiring performing routine mathematical procedures, 53 % are connection tasks requiring linking different mathematical curriculum strands, and only 2 % are reflection tasks, which are considered as tasks with the highest level of cognitive demand. A linkage between the findings of the error analysis and the textbook analysis suggests that the lacking opportunity-to-learn in Indonesian mathematics textbooks may cause Indonesian students’ difficulties in solving context-based tasks. Based on the results of this study, recommendations are given for improving the opportunities-to-learn to solve context-based tasks as well as for doing further research on this topic.

## Keywords

Opportunity-to-learn Textbook analysis Indonesian mathematics textbooks Context-based tasks Students’ difficulties in solving tasks## 1 Introduction

Students’ ability to apply mathematics in various contexts in daily life is seen as a core goal of mathematics education (e.g., Boaler, 1993; De Lange, 2003; Graumann, 2011; Muller & Burkhardt, 2007; Niss, Blum, & Galbraith, 2007). This core goal of mathematics education is also reflected in the Programme for International Student Assessment (PISA) (OECD, 2003b) in which the assessment of students’ mathematics achievement focuses on students’ ability to solve mathematics problems situated in real-world contexts. According to the PISA framework (OECD, 2003b), such ability should be an educational core goal because today and in the future, every country needs mathematically literate citizens to deal with complex everyday surroundings and rapidly changing professional environments.

Contexts from daily life can also be used as a didactical tool to support the learning of mathematics. Students’ experiences with these contexts give a meaningful basis to the mathematical concepts they have to learn (Cooper & Harries, 2002; Van den Heuvel-Panhuizen, 1996). Furthermore, contexts can provide context-connected solution strategies (Van den Heuvel-Panhuizen, 1996, 2005). However, this does not mean that context-based tasks are always easy to solve for students. Several studies revealed that many students have low performance on such tasks (e.g., Clements, 1980; Cummins, Kintsch, Reusser, & Weimer, 1988; Schwarzkopf, 2007; Verschaffel, Greer, & De Corte, 2000). When solving context-based tasks, students have difficulties in (1) understanding what a problem is about (Bernardo, 1999; Cummins et al., 1988), (2) distinguishing between relevant and irrelevant information (Cummins et al., 1988; Verschaffel et al., 2000), and (3) identifying the mathematical procedures required to solve a problem (Clements, 1980; Verschaffel et al., 2000).

As shown by the PISA surveys (OECD, 2003a, 2004, 2007, 2010), one country in which students have low performance on context-based mathematics tasks is Indonesia. For example, in PISA 2009 (OECD, 2010), only one third of Indonesian students could answer mathematics tasks embedded in familiar contexts and fewer than 1 % of the students could work with context-based tasks in complex situations which require well-developed thinking and reasoning skills. Furthermore, in a recent study (Wijaya, Van den Heuvel-Panhuizen, Doorman, & Robitzsch, 2014)—which was the first study of the Context-based Mathematics Tasks Indonesia (CoMTI) project—we found that the errors of Indonesian students when solving context-based tasks were mostly related to comprehending the tasks, particularly to selecting relevant information. Many mistakes were also made in choosing the correct mathematical operation or concept when transforming a context-based task into a mathematical problem.

The present study was set up to find an explanation for the difficulties Indonesian students experience when solving context-based tasks. The approach taken in the study was investigating what opportunity-to-learn Indonesian mathematics textbooks offer Indonesian students to develop the ability to solve context-based tasks. Although the study was situated in Indonesia, we think that it is relevant for an international audience because it contributes to existing knowledge about the relation between textbooks’ content and what students learn. Moreover, this study brings in a new aspect of this relation by focusing on the difficulties students experience when solving context-based tasks.

## 2 Theoretical background and research questions

### 2.1 The concept of opportunity-to-learn

A plausible question when particular educational goals are not achieved by students is whether they have received the education enabling them to reach the competences expressed in these goals. Therefore, it is no wonder that the concept of opportunity-to-learn (OTL) came into being. Fifty years ago, this concept was coined by Carroll (1963) when referring to sufficient time for students to learn (Liu, 2009). OTL was also introduced to ensure the validity of international comparative studies of students’ achievement. Researchers became aware that when comparing the achievement of students from different countries, curricular differences across national systems had to be taken into account (Liu, 2009; McDonnell, 1995). In the report of the First International Mathematics Studies (Husén, 1967), OTL was defined as “whether or not […] students have had the opportunity to study a particular topic or learn how to solve a particular type of problem.” (pp. 162–163).

### 2.2 Assessing opportunity-to-learn

To examine OTL, several approaches are possible for which various aspects of OTL can be assessed. Liu (2009) considered four OTL variables: (a) content coverage, that is, the match between the curriculum taught and the content tested, (b) content exposure, that is, the time spent on the content tested, (c) content emphasis, that is, the emphasis the teachers have placed on the content tested, and (d) quality of instructional delivery, that is, the adequacy of teaching the content. Another approach was offered by Brewer and Stasz (1996) who distinguished three categories of concern when assessing OTL. The first category is the curriculum content, implying the assessment of whether the students have been taught the subjects and topics that are essential to attain the standards. The second category includes the instructional strategies, assessing whether students have experience with particular kinds of tasks and solution processes. The third category refers to the instructional resources. Here are assessed, for example, issues of teacher preparation and quality of instructional materials.

Besides different aspects of OTL that can be assessed, different methods can also reveal the OTL students receive. These methods vary from teacher and student surveys from questionnaires, to carrying out classroom observations, and to analyzing instructional materials. For example, the first measurements of OTL are based on questionnaires in which teachers have to indicate whether particular mathematical topics or kinds of problems have been taught to students. Such questionnaires were used in the international comparative studies FIMS, SIMS, and TIMSS (Floden, 2002). Furthermore, the TIMSS video studies are an example of revealing the OTL based on classroom observations (Hiebert et al., 2003). Another approach applied in TIMSS was to look at what content curricula offer. Schmidt, McKnight, Valverde, Houang, & Wiley (1997) see the curriculum—and in connection with this—textbook series as “a kind of underlying ‘skeleton’ that gives characteristic shape and direction to mathematics instruction in educational systems around the world” and that provides “a basic outline of planned and sequenced educational opportunities” (p. 4).

### 2.3 Opportunity-to-learn and the role of textbooks

Compared to the influence of curricula, textbooks play an even more direct role in what is addressed in instruction. Teachers’ decisions about the selection of content and teaching strategies are often directly set by the textbooks teachers use (Freeman & Porter, 1989; Reys, Reys, & Chavez, 2004). Therefore, textbooks are considered to determine largely the degree of students’ OTL (Schmidt et al., 1997; Tornroos, 2005). This means that if textbooks differ, students will get a different OTL (Haggarty & Pepin, 2002). As a result, different student outcomes will appear, which is confirmed by several studies that found a strong relation between the textbook used and the mathematics performance of the students (see, e.g., Tornroos, 2005; Xin, 2007).

Recognition of the role of textbooks with respect to students’ chances to be taught particular mathematical topics and skills has recently led to a large amount of studies examining OTL offered in textbooks. For example, textbook analysis was applied to the distributive property (Ding & Li, 2010), the equal sign (Li, Ding, Capraro, & Capraro, 2008; McNeil et al., 2006), fractions (Charalambous, Delaney, Hsu, & Mesa, 2010), subtraction up to 100 (Van Zanten & Van den Heuvel-Panhuizen, 2014), non-routine problem solving (Kolovou, Van den Heuvel-Panhuizen, & Bakker, 2009; Xin, 2007), and mathematical modeling (Gatabi, Stacey, & Gooya , 2012).

### 2.4 Textbook analysis to identify the opportunity-to-learn

To disclose what content is intended to be taught to students, textbooks can be analyzed in several ways. In TIMSS, textbook analysis initially focused on investigating the content profiles of textbooks (Schmidt et al., 1997). Later, they were examined based on five measures (Valverde, Bianchi, Wolfe, Schmid, & Houang, 2002). The first measure is the classroom activities proposed by the textbook. The second measure corresponds to the amount of content covered in textbooks and the mode of presentation, whether abstract or concrete. The third measure deals with the sequencing of content. The fourth measure focuses on physical characteristics of textbooks, for example, the size of the book and the number of pages. The fifth measure characterizes the complexity of the demands for student performance.

Another approach to textbook analysis was proposed by Pepin and Haggarty (2001). They distinguished four areas on which a textbook analysis can focus, namely (a) the mathematics topics presented in textbooks and the beliefs about the nature of mathematics that underlie the textbooks’ content, (b) the methods suggested in textbooks to help students understand the textbooks’ content, (c) the sociological contexts of textbooks which examines whether textbooks are adaptive to students with different performance levels, and (d) the cultural traditions in textbooks, focusing on how textbooks reflect the cultural traditions and values.

Charalambous et al. (2010) classified the approaches to textbook analysis in three categories, namely horizontal, vertical, and contextual. The horizontal analysis examines the general characteristics of textbooks, such as physical characteristics and the organization of the textbooks’ content. This analysis gives a first impression of the OTL because it can provide information about the quantity of exposure of textbooks’ content. However, information about the quality and the didactical aspects of the textbooks’ content is not revealed by a horizontal analysis. Therefore, a vertical analysis is needed to address how textbooks present and treat the content. Such an analysis offers an in-depth understanding of the mathematical content. The third category, the contextual analysis, focuses on how textbooks are used in instructional activities. Therefore, Charalambous et al. (2010) argued that, in fact, only the first two categories are appropriate to analyze the characteristics of textbooks.

### 2.5 Opportunity-to-learn required for solving context-based tasks

The primary requirement for students’ learning to solve context-based tasks is that students should be offered experiences to deal with essential characteristics of context-based tasks and should be given the necessary practice in handling these characteristics.

#### 2.5.1 Nature of the context

A critical characteristic of context-based tasks is the nature of the context. Concerning mathematical problems, there are several views on what a context means (De Lange, 1995; OECD, 2003b; Van den Heuvel-Panhuizen, 2005). In the present study, the focus is on real-world contexts, which in PISA are called “extra-mathematical contexts” (OECD, 2003b). In PISA, context-based tasks are defined as problems presented within a “situation” which can refer to a real world or fantasy setting, can be imagined by students, and can include personal, occupational, scientific, and public information. This interpretation of a context matches what De Lange (1995) called a “relevant and essential context”, which he contrasted with a “camouflage context.” Tasks with the latter context are merely dressed-up bare problems, which do not require modeling because the mathematical operations needed to solve the task are obvious.

#### 2.5.2 Mathematization and modeling process

To solve tasks that include relevant and essential contexts, students need to transform the context situation into a mathematical form through the process of mathematization (OECD, 2003b). Therefore, it is important that context-based tasks use settings or situations that give access to and support the process of mathematization. In other words, it is crucial that the tasks provide information that can be organized mathematically and offer opportunities for students to use their knowledge and experiences (Van den Heuvel-Panhuizen, 2005).

The process of solving context-based tasks requires interplay between the real world and mathematics (Schwarzkopf, 2007) and is often described as a modeling process (Blum & Leiss, 2007), which in general contains the following steps: (1) understanding the problem situated in reality, (2) transforming the real-world problem into a mathematical problem, (3) solving the mathematical problem, and (4) interpreting the mathematical solution in terms of the real situation.

#### 2.5.3 Adequate mathematical procedures

A further characteristic of a context-based task is that the task cannot be solved by simply translating it into a mathematical procedure (Verschaffel, Van Dooren, Greer, & Mukhopadhyay., 2010). This means that standard problems that have a straightforward relation between the problem context and the necessary mathematics do not help students build up experience to transform a real-world problem into a mathematical problem. Therefore, students should be set tasks in which the necessary mathematical procedures are more implicit.

#### 2.5.4 Different information types

Solving a context-based task is not just combining all the information given in the task (Verschaffel et al., 2010). A context-based task may contain more information than needed for solving the problem or may even lack necessary information. Providing more or less information than needed for solving a context-based task is a way to encourage students to consider the context used in the task and not just take the numbers out of the context and process them mathematically in an automatic way (Maass, 2007). Therefore, students should be offered opportunities to deal with different types of information such as matching, missing, and superfluous information (Maass, 2010). In this way, they can learn to select relevant information and to add and ignore information.

#### 2.5.5 Cognitive demands

A final requirement to support students’ learning to solve context-based tasks is that students can build experience with tasks covering the full range of levels of cognitive demands, including reproduction, connection, and reflection tasks (OECD, 2009). Reproduction tasks require the recall of mathematical properties and the application of routine procedures or standard algorithms. Such tasks do not require mathematical modeling. Connection tasks require integrating and linking different mathematical curriculum strands or different representations of a problem. These tasks also require interpreting a problem situation and engaging students in simple mathematical reasoning. Reflection tasks include complex problem situations in which it is not obvious in advance what mathematical procedures have to be carried out. In fact, this latter category of tasks is the closest to our definition of context-based tasks. What competences students will eventually master depends on the cognitive demands of mathematics tasks they have been engaged in (Stein & Smith, 1998); therefore, these reflection tasks should not be lacking in instruction.

#### 2.5.6 Crucial aspects of opportunity-to-learn context-based tasks

In sum, three aspects of OTL are crucial to develop the competence of solving context-based tasks. The first aspect is giving students experience to work on tasks with real-world contexts and implicit mathematical procedures. The second aspect is giving students tasks with missing or superfluous information. The last aspect is offering students experience to work on tasks with high cognitive demands.

### 2.6 Difficulties of Indonesian students in solving context-based tasks

The aforementioned aspects of OTL also emerged as relevant in the first study of the CoMTI project (Wijaya et al., 2014) in which we investigated Indonesian students’ difficulties when solving context-based tasks. In the study, which involved a total of 362 Indonesian students (233 ninth graders and 129 tenth graders), four types of students’ errors were identified: comprehension, transformation, mathematical processing, and encoding errors. Comprehension errors correspond to students’ inability to understand a context-based task, including the inability to select relevant information. Transformation errors are related to students’ inability to identify the correct mathematical procedure to solve a problem. The mathematical processing errors refer to mistakes in carrying out mathematical procedures. Encoding errors refer to answers that are unrealistic and do not fit the real-world situation described in the task.

Frequency of students’ errors when solving context-based mathematics tasks (Wijaya et al. 2014)

Type of error | Frequency (total errors = 1718) | Sub-type of error | Frequency |
---|---|---|---|

Comprehension | 38 % | - Misunderstanding the instruction | 35 % |

- Misunderstanding a keyword | 15 % | ||

- Error in selecting relevant information | 50 % | ||

Total comprehension error = 653 | 100 % | ||

Transformation | 42 % | - Using a common mathematical procedure that does not apply to the problem situation | 12 % |

- Taking too much account of the context | 8 % | ||

- Treating a graph as a picture | 12 % | ||

- Otherwise using wrong mathematical procedure | 68 % | ||

Total transformation error = 723 | 100 % | ||

Mathematical processing | 17 % | – | |

Total mathematical processing error = 291 | |||

Encoding | 3 % | – | |

Total encoding error = 51 |

In addition, in agreement with the results of the PISA study 2003 (OECD, 2009), we found in our study that the reproduction tasks were the easiest for the students (67 % of the responses to these tasks gained full credit), whereas the tasks with higher cognitive demand, the connection and the reflection tasks, had lower percentages of correct answers (in both types of tasks 39 % of the responses gained full credit).

### 2.7 Research questions

- 1.
*What are the amount of exposure and the purpose of context-based tasks in Indonesian mathematics textbooks?* - 2.
*To what extent are different types of information provided in tasks in Indonesian mathematics textbooks?* - 3.
*What are the cognitive demands of tasks in Indonesian mathematics textbooks?*The reason for this study was to find an explanation for the difficulties Indonesian students experience when solving context-based tasks. Therefore, we also investigated the connection between students’ difficulties when solving context-based tasks with the OTL in Indonesian mathematics textbooks. This resulted in the next research question:

- 4.
*What is the connection between students’ errors when solving context-based tasks and the characteristics of tasks in Indonesian mathematics textbooks?*

## 3 Method

### 3.1 Mathematics textbooks analyzed

To answer the research questions, we carried out a textbook analysis in which we focused on grade 8. Although, according to the National Curriculum (Pusat Kurikulum, 2003a, b), the topics dealt with in the PISA tasks included in the CoMTI test are taught from grades 7 to 10, the main emphasis on these topics lies in grade 8. Of the topics, almost half are taught in grade 8 and the remaining part is distributed over the three other grades. Moreover, grade 8 can be considered as a relevant grade year to prepare students for being able to solve context-based tasks as assessed in the PISA studies.

Analyzed textbooks and material

Textbook series | Abbreviation | Material involved in analysis | Publisher |
---|---|---|---|

| MKA | “For Junior High School grade VIII” | Indonesian Ministry of National Education |

| MS | “For Junior High School grade VIII: 2A and 2B” | Private publisher |

| MJHS | “Part 2” | Private publisher |

The three textbooks have a similar main structure. All have nine chapters, each dealing with one mathematics topic. These chapters contain several sub-chapters discussing specific aspects of the mathematics topic covered in the chapter. For example, the chapter on “Equations of straight lines” contains the sub-chapters: (a) the general form of equations of straight lines, (b) the gradient, (c) the relation between a gradient and the equation of a straight line, and (d) the application of equations of straight lines.

Although the three textbooks have the same number of chapters, they have different numbers of sub-chapters because they discuss the mathematics topics in different levels of detail. For example, MJHS discusses the topic of Equations of straight lines in three sub-chapters, whereas the other textbooks spend four sub-chapters on this topic.

### 3.2 Procedure of textbook analysis

Following Charalambous et al. (2010), we analyzed the textbooks from two perspectives, namely their physical characteristics and instructional components (horizontal analysis) and the characteristics of the tasks (vertical analysis). The physical characteristics and instructional components of the textbooks were investigated to provide information about the quantity of exposure to textbook content. We collected data about the page size, the number of pages, and the page surface area. Furthermore, we counted the number of explanation sections, the worked example sections, the task sections with regular tasks, the tasks in worked example sections, and the regular tasks in task sections. In this analysis, we considered as a task every question or problem with the answer provided (tasks in the worked example sections) or for which the students have to give an answer (regular tasks in the task sections). For example, although the task section in Fig. 3 contains two task numbers (7 and 8), in our approach, this section has five tasks (7a, 7b, 8a, 8b, and 8c). The tasks in the worked example sections were counted in a similar way; therefore, Fig. 2 contains three tasks (1a, 1b, and 2). The tasks in the worked example sections and in the task sections could be in a bare format (with only symbols) or context-based format.

#### 3.2.1 Framework for textbook analysis focusing on OTL context-based tasks

Analysis framework for textbook analysis

Task characteristic | Sub-category | Explanation |
---|---|---|

Type of context | No context | - Refers only to mathematical objects, symbols, or structures |

Camouflage context | - Experiences from everyday life or common sense reasoning are not needed - The mathematical operations needed to solve the problems are already obvious. - The solution can be found by combining all numbers given in the text. | |

Relevant and essential context | - Common sense reasoning within the context is needed to understand and solve the problem. - The mathematical operation is not explicitly given. - Mathematical modeling is needed. | |

Purpose of context-based task | Application | - The task is given after the explanation section. |

Modelling | - The task is given before the explanation section. | |

Type of information | Matching | - The tasks contain exactly the information needed to find the solution. |

Missing | - The tasks contain less information than needed, so students need to derive additional data. | |

Superfluous | - The tasks contain more information than needed so students need to select information. | |

Type of cognitive demand | Reproduction | - Reproducing representations, definitions or facts - Interpreting simple and familiar representations - Memorization or performing explicit routine computations/procedures |

Connection | - Integrating and connecting across content, situations or representations - Non-routine problem solving - Interpretation of problem situations and mathematical statements - Engaging in simple mathematical reasoning | |

Reflection | - Reflecting on and gaining insight into mathematics - Constructing original mathematical approaches - Communicating complex arguments and complex reasoning - Making generalizations |

For types of information, we used three types described by Maass (2010): “matching information,” “missing information,” and “superfluous information.” The categories for the cognitive demands of the tasks were established based on PISA’s competence clusters (OECD, 2003b), which included reproduction, connection, and reflection tasks. These categories were used to identify the characteristics of the tasks in both the worked example sections and the task sections.

#### 3.2.2 Coding procedure

All tasks in the three textbooks were coded by the first author using the analysis framework as shown in Table 3. Afterwards, the reliability of the coding was checked through an additional coding by an external coder who coded a random selection of about 15 % of the tasks. This extra coding resulted in a Cohen’s kappa of .75 for the type of context, 1.00 for the purpose of the context-based task, .74 for the type of information, and .84 for the type of cognitive demands. These results indicate that the coding was reliable (Landis & Koch, 1977).

## 4 Results

### 4.1 Physical characteristics and instructional components of the textbooks

^{2}.

Physical characteristics and instructional components of Indonesian mathematics textbooks

Textbook | |||
---|---|---|---|

MJHS | MKA | MS | |

Physical characteristic | |||

Page size (in mm) | 205 × 277 | 176 × 250 | 176 × 250 |

Number of pages | 146 | 252 | 336 |

Page surface area | 82,906 | 110,880 | 147,840 |

Instructional components | |||

Number of explanation sections | 25 | 42 | 56 |

Number of worked example sections | 80 | 73 | 90 |

Number of task sections | 79 | 63 | 68 |

Total number of tasks | 437 | 531 | 1187 |

Number of tasks in worked example sections | 119 | 91 | 218 |

Number of tasks in task sections | 318 | 440 | 969 |

Regarding instructional components, MS has the largest number of explanation sections, which is more than double that in MJHS. The largest worked example sections are also in MS, but for this instructional component, the difference between the three textbooks is small. For the task sections, MJHS has slightly more than the two other textbooks. We found a large difference between the textbooks for the number of tasks. MS has a total of 1187 tasks, which is double the number in MKA and triple that in MJHS. A similar ratio was found for the regular tasks in the task sections, with respectively 318, 440, and 969 tasks for MJHS, MKA, and MS.

### 4.2 The amount of exposure and the purpose of context-based tasks

Frequency of types of context

Type of context | Textbook | ||||||
---|---|---|---|---|---|---|---|

MJHS | MKA | MS | |||||

| % | | % | | % | ||

Tasks in worked example sections | Relevant and essential context | 1 | 1 | 2 | 2 | 10 | 5 |

Camouflage context | 4 | 3 | 1 | 1 | 28 | 13 | |

No context | 114 | 96 | 88 | 97 | 180 | 83 | |

Total | 119 | 100 | 91 | 100 | 218 | 101 | |

Regular tasks in task sections | Relevant and essential context | 7 | 2 | 17 | 4 | 29 | 3 |

Camouflage context | 24 | 8 | 26 | 6 | 127 | 13 | |

No context | 287 | 90 | 397 | 90 | 813 | 84 | |

Total | 318 | 100 | 440 | 100 | 813 | 100 | |

All tasks | Relevant and essential context | 8 | 2 | 19 | 4 | 39 | 3 |

Camouflage context | 28 | 6 | 27 | 5 | 155 | 13 | |

No context | 401 | 92 | 485 | 91 | 993 | 84 | |

Total | 437 | 100 | 531 | 100 | 1187 | 100 |

The task in Fig. 5 is set in the context of a ski slope, which is not a daily life situation for Indonesian students. This context is an example of a camouflage context, because it can be neglected in solving the problem. Although the task includes a real-world situation, the photograph of the ski slope is cut and arranged so that it exactly resembles a straight line and the arrows informing the vertical and horizontal differences also resemble a coordinate system. Furthermore, the words “slope” and “gradient” are mentioned explicitly, and the numbers in the picture are given in such a way that students can immediately interpret the problem as a mathematical problem and follow the common procedure for calculating the slope or gradient.

A task with a relevant and essential context is shown in Fig. 6. This task asks to determine the price of four pairs of shoes and five pairs of sandals. To solve this task, students are expected to transform the “price problem” into linear equations with two variables. However, this mathematical procedure is not explicitly mentioned in the task, nor are the numbers presented so that a solution procedure is afforded. The variables for setting up the equations, that is, the number of pairs of shoes and the number of pairs of sandals, are not explicitly indicated in the task. Consequently, students need to identify the relevant information and a solution strategy for solving the task.

### 4.3 Types of information provided in tasks

Frequency of types of information in context-based tasks

Type of information | Textbook | ||||||
---|---|---|---|---|---|---|---|

MJHS | MKA | MS | |||||

| % | | % | | % | ||

Context-based tasks in worked example sections | Matching | 4 | 80 | 2 | 67 | 35 | 92 |

Missing | 1 | 20 | 1 | 33 | 2 | 5 | |

Superfluous | 0 | 0 | 0 | 0 | 1 | 3 | |

Total | 5 | 100 | 3 | 100 | 38 | 100 | |

Context-based tasks in task sections | Matching | 27 | 77 | 37 | 86 | 138 | 88 |

Missing | 4 | 23 | 6 | 14 | 18 | 12 | |

Superfluous | 0 | 0 | 0 | 0 | 0 | 0 | |

Total | 31 | 100 | 43 | 100 | 156 | 100 | |

All context-based tasks | Matching | 31 | 86 | 39 | 85 | 173 | 89 |

Missing | 5 | 14 | 7 | 15 | 20 | 10 | |

Superfluous | 0 | 0 | 0 | 0 | 1 | 1 | |

Total | 36 | 100 | 46 | 100 | 194 | 100 |

### 4.4 Cognitive demands required for solving the tasks

Frequency of types of cognitive demands of bare tasks

Type of cognitive demands | Textbook | ||||||
---|---|---|---|---|---|---|---|

MJHS | MKA | MS | |||||

| % | | % | | % | ||

Bare tasks in worked example sections | Reproduction | 110 | 96 | 83 | 94 | 172 | 96 |

Connection | 4 | 4 | 5 | 6 | 8 | 4 | |

Reflection | 0 | 0 | 0 | 0 | 0 | 0 | |

Total | 114 | 100 | 88 | 100 | 180 | 100 | |

Bare tasks in task sections | Reproduction | 271 | 96 | 370 | 93 | 756 | 93 |

Connection | 16 | 4 | 27 | 7 | 48 | 6 | |

Reflection | 0 | 0 | 0 | 0 | 9 | 1 | |

Total | 287 | 100 | 397 | 100 | 813 | 100 | |

All bare tasks | Reproduction | 381 | 95 | 453 | 93 | 928 | 93 |

Connection | 20 | 5 | 32 | 7 | 56 | 6 | |

Reflection | 0 | 0 | 0 | 0 | 9 | 1 | |

Total | 401 | 100 | 485 | 100 | 993 | 100 |

Frequency of types of cognitive demands of context-based tasks

Type of cognitive demands | Textbook | ||||||
---|---|---|---|---|---|---|---|

MJHS | MKA | MS | |||||

| % | | % | | % | ||

Context-based tasks in worked example sections | Reproduction | 2 | 40 | 1 | 33 | 22 | 58 |

Connection | 3 | 60 | 2 | 67 | 16 | 42 | |

Reflection | 0 | 0 | 0 | 0 | 0 | 0 | |

Total | 5 | 100 | 3 | 100 | 38 | 100 | |

Context-based tasks in task sections | Reproduction | 15 | 48 | 14 | 33 | 87 | 56 |

Connection | 15 | 48 | 29 | 67 | 66 | 42 | |

Reflection | 1 | 3 | 0 | 0 | 3 | 2 | |

Total | 31 | 99 | 43 | 100 | 156 | 100 | |

All context-based tasks | Reproduction | 17 | 47 | 15 | 33 | 109 | 56 |

Connection | 18 | 50 | 31 | 67 | 82 | 42 | |

Reflection | 1 | 3 | 0 | 0 | 3 | 2 | |

Total | 36 | 100 | 46 | 100 | 194 | 100 |

Figures 4 and 5 show examples of reproduction tasks. The word gradient was explicitly mentioned in the tasks, so students could easily identify the required mathematics procedure and apply it by using all the information. Figure 8, the task about the three pipes, is an example of a connection task situated in a camouflage context. The main focus of this task was finding the minimum length of rope to tie up three pipes, which mathematically was related to the concept of common tangent of two circles. To find the minimum length of rope, students need to find not only the length of the three common tangents but also the length of the arcs. Here, a connection to the concept of an equilateral triangle is needed to find the measure of the central angle required to calculate the length of the arcs.

### 4.5 Opportunity-to-learn provided in textbooks and students’ errors

Relation between students’ errors and task characteristics in textbooks

Ninth-graders’ errors found in Wijaya et al. (2014) (934 errors) | Task characteristic | Textbook | |||
---|---|---|---|---|---|

MJHS | MKA | MS | |||

Proportion of tasks (%) | |||||

Comprehension errors: Proportion of errors in selecting relevant information: 21 % of all errors | Type of information in context-based tasks | Matching | 86 | 85 | 89 |

Missing | 14 | 15 | 10 | ||

Superfluous | 0 | 0 | 1 | ||

Transformation errors: Proportion of these errors: 45 % of all errors | Type of context in all tasks | No context | 92 | 91 | 84 |

Camouflage context | 6 | 5 | 13 | ||

Relevant and essential context | 2 | 4 | 3 | ||

Percentage of wrong answers for each type of cognitive demand - Reproduction: 32 % - Connection: 61 % - Reflection: 61 % | Type of cognitive demand in context-based tasks | Reproduction | 47 | 33 | 56 |

Connection | 50 | 67 | 42 | ||

Reflection | 3 | 0 | 2 |

Combining the findings from the textbook analysis and the error analysis, a recognizable similarity between these two findings emerged. In 21 % of the total of 934 errors (made by 233 ninth-graders), students made comprehension errors by not selecting the relevant information for solving the tasks. Correspondingly, the textbook analysis revealed that the textbooks mainly provide context-based tasks with matching information, and only 11 to 15 % of the context-based tasks had missing or superfluous information.

In relation to the high proportion of transformation errors, the textbook analysis disclosed that the proportions of context-based tasks in the three textbooks only range from 8 to 16 %. It was also found that only 2 to 4 % of these tasks use relevant and essential contexts. Furthermore, all context-based tasks are located after the explanation sections in which a particular mathematics topic is discussed. This means that these tasks are just meant to apply what has been demonstrated in the explanation section. Thus, from the textbooks’ content, students can scarcely build up experience in constructing a mathematical model by mathematizing a real-world situation.

Lastly, regarding the percentage of wrong answers for the context-based tasks of the various types of cognitive demand, we also found a match with what is offered in the textbooks. The lowest percentage of wrong answers was obtained for the reproduction tasks that cover 33 to 56 % of the context-based tasks in the three textbooks. For the connections tasks, which form 42 to 67 % of the context-based tasks, about half of the answers were wrong. The largest percentage of wrong answers belonged to the reflection tasks that include only 0 to 3 % of the context-based tasks in the textbooks.

## 5 Discussion

As the PISA studies (OECD, 2003a, 2004, 2007, 2010) have shown and our first CoMTI study (Wijaya et al., 2014) has confirmed, Indonesian students have difficulties in solving context-based tasks. The present study was meant to disclose a possible reason for these difficulties by conducting an analysis of three Indonesian mathematics textbooks. This analysis focused on the OTL to solve context-based tasks offered by the textbooks. For identifying the characteristics of the tasks in the textbooks, we developed an analysis framework including four perspectives: the types of contexts in tasks, the purpose of the context-based tasks, the information used in tasks, and the types of cognitive demands in tasks.

### 5.1 Opportunity-to-learn and students’ difficulties

Our analysis revealed that context-based tasks are seldom available in Indonesian mathematics textbooks. The textbooks mostly provide tasks without a context, which do not require mathematization or modeling activities from the students. Furthermore, the few context-based tasks in the textbooks mostly do not have a relevant and essential context. In addition, the context-based tasks in the Indonesian textbooks are all located after the explanation sections. This means that the mathematics procedure to be applied is more or less given and students do not have to identify an appropriate mathematics procedure to solve the tasks and consequently they are not getting enough experience to develop their ability to transform a context-based task into a mathematical problem. This lack of experience is a plausible explanation for the high number of transformation errors made by Indonesian students. The foregoing conclusion is in agreement with several studies that showed students’ lack of experience in a particular type of task corresponds to their difficulties with the task. For example, Haines and Crouch (2007) mentioned that particular difficulties of students in mathematical modeling are due to unfamiliarity with tasks in which students have to identify what mathematics is appropriate to solve the problem. Similarly, Stein and Smith (1998) reported that students’ lack of prior experience with open-ended tasks leads to difficulties when solving tasks in which the mathematical procedure is implicit. A lack of particular experience is also directly related to a missing OTL in textbooks as shown in the studies by Li et al. (2008) and McNeil et al. (2006), which revealed that students have difficulties in interpreting the equal sign as a relation because the textbooks they use rarely provide equal signs with operations on both sides.

A specific characteristic of context-based tasks that we found missing in the three Indonesian textbooks is the use of incomplete or irrelevant information, which, according to Forman and Steen (2001), and Greer, Verschaffel, and Mukhopadhyay (2007), is crucial for developing students’ ability to apply mathematics in real-world problems. Of the 276 context-based tasks in the three textbooks, only 32 have missing information and just 1 task contains superfluous information. This means that Indonesian students who worked with these textbooks could not really build up experience in selecting relevant information or using knowledge of the context to add missing information. Moreover, taking the freedom to include one’s own knowledge or to neglect given information is something with which the students should be familiar. Chapman (2006) emphasized that when students are encouraged to use their own real-world experiences and to relate school experiences to life outside school, they will consider contextual information in a task as important to comprehend and solve the task. The lack of tasks that give students such experiences could explain why the students made so many comprehension errors.

The substantial number of errors made by Indonesian students in tasks with high cognitive demands can also be traced back to the content of the Indonesian textbooks. Of the context-based tasks, fewer than 3 % were reflection tasks. However, the connection tasks were found in about half the context-based tasks. This proportion is similar to the proportion of connection tasks in the PISA study 2003 (OECD, 2009), which might give an impression that Indonesian students have OTL to solve these tasks. However, we should take into account that the context-based connection tasks in Indonesian textbooks are low in number. Over the three textbooks, only 131 context-based tasks (see Table 8; MJHS: 18; MKA: 31; MS: 82) out of all the 2155 tasks together (see Table 4; MJHS: 437; MKA: 531; MS: 1187) ask for integrating and connecting different mathematical curriculum strands or linking different representations of a problem.

In sum, the results from our analysis of three Indonesian textbooks provide evidence of a relation between the errors Indonesian students make when solving context-based tasks and the content offered by the textbooks they use. This conclusion adds to earlier studies that showed a positive relation between OTL provided in textbooks and student achievement: The students learn what is “taught” by the textbook. For example, Tornroos (2005) found a high correlation between student achievement in a test and the amount of textbook content related to the test items. Also, Xin (2007) revealed that the algorithmic strategy used by Chinese students to solve word problem tasks was the strategy suggested in their textbooks.

### 5.2 Educational implications

Based on our findings, we recommend including more context-based tasks in textbooks. Moreover, these tasks should not only be given after an explanation section, because then the mathematical procedure to be chosen is more or less fixed (see also De Lange, 2003). The quality of the context-based tasks should also be of concern. Textbooks should include context-based tasks that offer students opportunities for mathematization (Freudenthal, 1986; Van den Heuvel-Panhuizen, 2005). This means that instead of camouflage contexts, relevant and essential contexts should be used that demand mathematical organization or ask for mathematization. The context-based tasks to be included in textbooks should also have superfluous or missing information. Giving such tasks will provide students not only OTL to select relevant information (Maass, 2010) but also to identify appropriate mathematics procedures (Greer et al., 2007). Lastly, attention should also be paid to the cognitive demands of context-based tasks. The investigated textbooks contain too few reflection tasks to make it possible for students to develop their ability in complex reasoning. Including more reflection tasks is essential because they stimulate mathematical thinking and reasoning related to authentic settings (OECD, 2003b).

Although this study was situated in Indonesia, the results of the study may also be beneficial for other countries where students have a low performance in context-based tasks. For such countries, our study gives strong indications for examining the OTL to solve context-based tasks as offered in the textbooks in use in these countries.

### 5.3 Limitations of the study and directions for future research

To be able to provide strong indications for the relation of OTL as offered in textbooks and the achievements of students, it is necessary to know at least of every student which textbook was used to teach him or her. Only then it is possible to obtain a direct proof of this relation. However, in our study, we did not have a one-to-one link between students’ errors and the textbook the students worked with because the schools involved in our study used a combination of textbooks. Not knowing which textbook(s) each student used can be seen as a limitation of our study; yet, we found that in the three textbooks, the number of context-based tasks offered and the nature of these tasks were quite similar. However, for getting more robust evidence for our findings, it would be necessary to conduct a further study in which it is known for all students with which textbook(s) they are taught. In addition, including more grades in a textbook analysis would provide a better overview of the OTL in textbooks and the relation with students’ achievements. Moreover, for the purpose of generalizability, our study could be repeated in other countries where students have low performance on, for example, context-based tasks used in the PISA studies.

A final limitation of our study is that the relation between student difficulties and OTL was only investigated from the perspective of OTL in textbooks. Although textbooks might be used as the main teaching and learning resources in the classroom (see, e.g., Reys et al., 2004; Valverde et al., 2002), it is clear that teachers also have an important role. For example, Pepin and Haggarty (2001) found that teachers determine how textbooks are used in classrooms. Teachers determine the textbook sections used for students’ exercises, when the textbooks should be used, and the ways students work with the textbooks. Regarding the use of context-based tasks for modeling, Ikeda (2007) emphasized the important role of teachers by arguing that the obstacle in teaching modeling is not only a lack of modeling tasks in textbooks but also teachers’ perceptions of mathematics and understanding of modeling. As noted by Bishop (1988), teachers have a crucial role in integrating students’ experiences and cultures in mathematics learning. Furthermore, following Lampert (1990) and Boaler (1993), if teachers assume that mathematics is a static body of knowledge and learning is the reproduction of facts, procedures, and truths, teachers will fail to engage students with context-based problems or problems with missing or superfluous information. Considering these facts, we believe that revealing possible reasons for students’ difficulties in solving context-based tasks should also include investigations into teachers’ teaching practice and teachers’ beliefs and knowledge about context-based tasks. Consequently, the OTL offered by teachers will be the next focus of the CoMTI project. Another issue that also needs further attention is the influence of the classroom culture on the OTL offered to students (see Pepin & Haggarty, 2001).

## Notes

### Acknowledgments

This research was supported by the Indonesian Ministry of National Education under the Better Education through Reformed Management and Universal Teacher Upgrading (BERMUTU) Scholarship (No. 7476-IND Grant Ref. TF090784).

## References

- Bernardo, A. B. I. (1999). Overcoming obstacles to understanding and solving word problems in mathematics.
*Educational Psychology, 19*(2), 149–163.CrossRefGoogle Scholar - Bishop, A. J. (1988). Mathematics education in its cultural context.
*Educational Studies in Mathematics, 19*(2), 179–191.CrossRefGoogle Scholar - Blum, W., & Leiss, D. (2007). How do students and teachers deal with mathematical modelling problems? The example “Sugarloaf”. In C. Haines, P. Galbraith, W. Blum, & S. Khan (Eds.),
*Mathematical modelling (ICTMA 12): Education, engineering and economics*(pp. 222–231). Chichester: Horwood Publishing.CrossRefGoogle Scholar - Boaler, J. (1993). Encouraging the transfer of ‘school’ mathematics to the ‘real world’ through the integration of process and content, context and culture.
*Educational Studies in Mathematics, 25*, 341–373.CrossRefGoogle Scholar - Brewer, D. J., & Stasz, C. (1996).
*Enhancing opportunity to learn measures in NCES data*. Santa Monica: RAND.Google Scholar - Carroll, J. (1963). A model of school learning.
*Teachers College Record, 64*, 723–733.Google Scholar - Chapman, O. (2006). Classroom practices for context of mathematics word problems.
*Educational Studies in Mathematics, 62*(2), 211–230.CrossRefGoogle Scholar - Charalambous, C. Y., Delaney, S., Hsu, H.-Y., & Mesa, V. (2010). A comparative analysis of the addition and subtraction of fractions in textbooks from three countries.
*Mathematical Thinking and Learning, 12*(2), 117–151.CrossRefGoogle Scholar - Clements, M. A. (1980). Analyzing children’s errors on written mathematical task.
*Educational Studies in Mathematics, 11*(1), 1–21.CrossRefGoogle Scholar - Cooper, B., & Harries, T. (2002). Children’s responses to contrasting ‘realistic’ mathematics problems: Just how realistic are children ready to be?
*Educational Studies in Mathematics, 49*(1), 1–23.CrossRefGoogle Scholar - Cummins, D. D., Kintsch, W., Reusser, K., & Weimer, R. (1988). The role of understanding in solving word problems.
*Cognitive Psychology, 20*(4), 405–438.CrossRefGoogle Scholar - De Lange, J. (1995). Assessment: No change without problems. In T. A. Romberg (Ed.),
*Reform in school mathematics*(pp. 87–172). Albany: SUNY Press.Google Scholar - De Lange, J. (2003). Mathematics for literacy. In B. L. Madison & L. A. Steen (Eds.),
*Quantitative literacy: Why numeracy matters for schools and colleges*(pp. 75–89). Princeton: National Council on Education and Disciplines.Google Scholar - Ding, M., & Li, X. (2010). A comparative analysis of the distributive property in U.S. and Chinese elementary mathematics textbooks.
*Cognition and Instruction, 28*(2), 146–180.CrossRefGoogle Scholar - Floden, R. E. (2002). The measurement of opportunity to learn. In A. C. Porter & A. Gamoran (Eds.),
*Methodological advances in cross-national surveys of educational achievement*(pp. 231–266). Washington, D.C.: National Academy Press.Google Scholar - Forman, S. L., & Steen, L. A. (2001).
*Why math? Applications in science, engineering, and technological programs*(Research Brief No. AACB-RB-00-2). Washington, D.C: American Association of Community Colleges.Google Scholar - Freeman, D. J., & Porter, A. C. (1989). Do textbooks dictate the content of mathematics instruction in elementary schools?
*American Educational Research Journal, 26*(3), 403–421.CrossRefGoogle Scholar - Freudenthal, H. (1986). Didactical principles in mathematics instruction. In J. A. Barroso (Ed.),
*Aspects of mathematics and its applications*(pp. 351–357). Amsterdam: Elsevier Science Publishers BV.CrossRefGoogle Scholar - Gatabi, A. R., Stacey, K., & Gooya, Z. (2012). Investigating grade nine textbook problems for characteristics related to mathematical literacy.
*Mathematics Education Research Journal, 24*(4), 403–421.CrossRefGoogle Scholar - Graumann, G. (2011). Mathematics for problems in the everyday world. In J. Maasz & J. O'Donoghue (Eds.),
*Real-world problems for secondary school mathematics students: Case studies*(pp. 113–122). Rotterdam: Sense Publishers.Google Scholar - Greer, B., Verschaffel, L., & Mukhopadhyay, S. (2007). Modelling for life: Mathematics and children's experience. In W. Blum, P. L. Galbraith, H.-W. Henn, & M. Niss (Eds.),
*Modelling and applications in mathematics education: The 14th ICMI study*(pp. 89–98). New York: Springer.CrossRefGoogle Scholar - Haggarty, L., & Pepin, B. (2002). An investigation of mathematics textbooks in England, France and Germany: Some challenges for England.
*Research in Mathematics Education, 4*(1), 127–144.CrossRefGoogle Scholar - Haines, C., & Crouch, R. (2007). Mathematical modelling and applications: Ability and competence frameworks. In W. Blum, P. L. Galbraith, H.-W. Henn, & M. Niss (Eds.),
*Modelling and applications in mathematics education: The 14th ICMI study*(pp. 89–98). New York: Springer.Google Scholar - Hiebert, J., Gallimore, R., Garnier, H., Givvin, K. B., Hollingsworth, H., Jacobs, J., et al. (2003).
*Teaching mathematics in seven countries: Results from the TIMSS 1999 Video Study. NCES 2003–013*. Washington, D.C: U.S. Department of Education, National Center for Education Statistics.Google Scholar - Husén, T. (Ed.). (1967).
*International study of achievement in mathematics: A comparison of twelve countries*(Vol. 2). New York: John Wiley & Sons.Google Scholar - Ikeda, T. (2007). Possibilities for, and obstacles to teaching applications and modelling in the lower secondary levels. In W. Blum, P. L. Galbraith, H.-W. Henn, & M. Niss (Eds.),
*Modelling and applications in mathematics education: The 14th ICMI study*(pp. 457–462). New York: Springer.CrossRefGoogle Scholar - Kolovou, A., Van den Heuvel-Panhuizen, M., & Bakker, A. (2009). Non-routine problem solving tasks in primary school mathematics textbooks—a needle in a haystack.
*Mediterranean Journal for Research in Mathematics Education, 8*(2), 31–68.Google Scholar - Lampert, M. (1990). When the problem in not the question and the solution is not the answer: Mathematical knowing and teaching.
*American Educational Research Journal, 27*, 29–63.CrossRefGoogle Scholar - Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data.
*Biometrics, 33*(1), 159–174.CrossRefGoogle Scholar - Li, X., Ding, M., Capraro, M. M., & Capraro, R. M. (2008). Sources of differences in children's understandings of mathematical equality: Comparative analysis of teacher guides and student texts in China and the United States.
*Cognition and Instruction, 26*(2), 195–217.CrossRefGoogle Scholar - Liu, X. (2009).
*Linking competence to opportunities to learn: Models of competence and data mining*. New York: Springer.CrossRefGoogle Scholar - Maass, K. (2007). Modelling tasks for low achieving students—first results of an empirical study. In D. Pitta-Pantazi & G. Philippou (Eds.),
*Proceedings of the Fifth Congress of the European Society for Research in Mathematics Education CERME 5*(pp. 2120–2129). Cyprus: Larnaca.Google Scholar - Maass, K. (2010). Classification scheme for modelling tasks.
*Journal für Mathematik-Didaktik, 31*(2), 285–311.CrossRefGoogle Scholar - McDonnell, L. M. (1995). Opportunity to learn as a research concept and a policy instrument.
*Educational Evaluation and Policy Analysis, 17*(3), 305–322.CrossRefGoogle Scholar - McNeil, N. M., Grandau, L., Knuth, E. J., Alibali, M. W., Stephens, A. C., Hattikudur, S., et al. (2006). Middle-school students’ understanding of the equal sign: The books they read can’t help.
*Cognition and Instruction, 24*(3), 367–385.CrossRefGoogle Scholar - Muller, E., & Burkhardt, H. (2007). Applications and modelling for mathematics—overview. In W. Blum, P. L. Galbraith, H.-W. Henn, & M. Niss (Eds.),
*Modelling and applications in mathematics education: The 14th ICMI study*(pp. 267–274). New York: Springer.CrossRefGoogle Scholar - Niss, M., Blum, W., & Galbraith, P. (2007). Introduction. In W. Blum, P. L. Galbraith, H.-W. Henn, & M. Niss (Eds.),
*Modelling and applications in mathematics education: The 14th ICMI study*(pp. 3–32). New York: Springer.CrossRefGoogle Scholar - OECD. (2003a).
*Literacy skills for the world of tomorrow. Further results from PISA 2000*. Paris: OECD.Google Scholar - OECD. (2003b).
*The PISA 2003 assessment framework—mathematics, reading, science, and problem solving knowledge and skills*. Paris: OECD.Google Scholar - OECD. (2004).
*Learning for tomorrow’s world. First results from PISA 2003*. Paris: OECD.Google Scholar - OECD. (2007).
*PISA 2006: Science competencies for tomorrow's world*. Paris: OECD.Google Scholar - OECD. (2009).
*Learning mathematics for life. A view perspective from PISA*. Paris: OECD.Google Scholar - OECD. (2010).
*PISA 2009 Results: What students know and can do. Student performance in reading, mathematics, and science*(Vol. 1). Paris: OECD.Google Scholar - Pepin, B., & Haggarty, L. (2001). Mathematics textbooks and their use in English, French and German classrooms: A way to understand teaching and learning cultures.
*ZDM – The International Journal on Mathematics Education, 33*(5), 158–175.Google Scholar - Pusat Kurikulum. (2003a).
*Kurikulum 2004. Standar Kompetensi mata pelajaran matematika Sekolah Menengah Pertama dan Madrasah Tsanawiyah [The Curriculum 2004. The competence standards of mathematics for Junior High School and Islamic Junior High School]*. Jakarta: Departemen Pendidikan Nasional.Google Scholar - Pusat Kurikulum. (2003b).
*Kurikulum 2004. Standar Kompetensi mata pelajaran matematika Sekolah Menengah Atas dan Madrasah Aliyah [The Curriculum 2004. The competence standards of mathematics for Senior High School and Islamic Senior High School]*. Jakarta: Departemen Pendidikan Nasional.Google Scholar - Reys, B. J., Reys, R. E., & Chavez, O. (2004). Why mathematics textbooks matter.
*Educational Leadership, 61*(5), 61–66.Google Scholar - Schmidt, W. H., McKnight, C. C., Valverde, G. A., Houang, R. T., & Wiley, D. E. (1997).
*Many visions, many aims: A cross-national investigation of curricular intentions in school mathematics*. Dordrecht: Kluwer Academic Publishers.CrossRefGoogle Scholar - Schwarzkopf, R. (2007). Elementary modeling in mathematics lessons: The interplay between “real-world” knowledge and “mathematics structures”. In W. Blum, P. L. Galbraith, H.-W. Henn, & M. Niss (Eds.),
*Modelling and applications in mathematics education: The 14th ICMI study*(pp. 209–216). New York: Springer.CrossRefGoogle Scholar - Stein, M. K., & Smith, M. S. (1998). Mathematical tasks as a framework for reflection: From research to practice.
*Mathematics Teaching in the Middle School, 3*(4), 268–275.Google Scholar - Tornroos, J. (2005). Mathematics textbooks, opportunity to learn and student achievement.
*Studies in Educational Evaluation, 31*(4), 315–327.CrossRefGoogle Scholar - Valverde, G. A., Bianchi, L. J., Wolfe, R. G., Schmid, W. H., & Houang, R. T. (2002).
*According to the book. Using TIMSS to investigate the translation of policy into practice through the world of textbooks*. Dordrecht: Kluwer Academic Publishers.Google Scholar - Van den Heuvel-Panhuizen, M. (1996).
*Assessment and realistic mathematics education*. Utrecht: CD-β Press, Center for Science and Mathematics Education.Google Scholar - Van den Heuvel-Panhuizen, M. (2005). The role of context in assessment problems in mathematics.
*For the Learning of Mathematics, 25*(2), 2–9 and 23.Google Scholar - Van Zanten, M., & Van den Heuvel-Panhuizen, M. (2014). Freedom of design: The multiple faces of subtraction in Dutch primary school textbooks. In Y. Li & G. Lappan (Eds.),
*Mathematics curriculum in school education*(pp. 231–259). Heidelberg: Springer.CrossRefGoogle Scholar - Verschaffel, L., Greer, B., & De Corte, E. (2000).
*Making sense of word problems*. Lisse: Swets & Zeitlinger.Google Scholar - Verschaffel, L., Van Dooren, W., Greer, B., & Mukhopadhyay, S. (2010). Reconceptualising word problems as exercises in mathematical modelling.
*Journal für Mathematik-Didaktik, 31*(1), 9–29.CrossRefGoogle Scholar - Wijaya, A., Van den Heuvel-Panhuizen, M., Doorman, M., & Robitzsch, A. (2014). Difficulties in solving context-based PISA mathematics tasks: An analysis of students’ errors.
*The Mathematics Enthusiast, 11*(3), 555–584.Google Scholar - Xin, Y. P. (2007). Word problem solving tasks in textbooks and their relation to student performance.
*Journal of Educational Research, 100*(6), 347–359.CrossRefGoogle Scholar

## Copyright information

**Open Access**This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.