Background

An increasing number of older individuals retain dentition throughout life. Many have gone through oral rehabilitation with various dental constructions—often with the purpose of securing relevant chewing and masticatory function that has been shown to be one of the most important oral health factors associated with the quality of life in older individuals [1,2,3].

Many clinical assessment methods were developed to assess masticatory performance, for example, color-changing chewing gums, sieving comminuted food or artificial food, optical scanning of masticated particles, or measuring release of dye when chewing food [4]. Currently, there are many different methods used to clinically assess masticatory performance objectively (here, performance refers to someone’s objective ability to mix or comminute food bolus) [4]. For practitioners and researchers, it would be interesting to find out if these methods could be used to evaluate masticatory ability—before dental treatment. For research studies that develop and test interventions—to enhance masticatory performance—need exists for reliable, valid methods that objectively evaluate clinical masticatory performance.

The most common approach to evaluating masticatory performance has been to sieve comminuted food and determine the degree of food breakdown [4,5,6,7,8,9]. Food or artificial food is chewed with a predetermined number of chewing cycles. Food particles are then sieved, and particle size is analyzed. These comminution tests differ somewhat, although the general methodology is similar. For example, one study indicated that a multiple sieve method was more reliable in determining masticatory performance than a single sieve method [9]. Edlund et al. developed a masticatory efficiency index that could be used in these types of comminution tests, but it also required five separate test sessions to be reliable [10]. Optical scanning of chewed food particles was used in comminution studies—in lieu of sieving [11]. Comminution tests were used to evaluate masticatory performance after implant treatments or to assess masticatory performance in patients with conventional dentures [12, 13].

Another common masticatory performance assessment method involves mixing ability tests. One study indicated that a mixing ability test discriminates better (between groups of individuals with compromised masticatory performance) than comminution tests [14]. In another study, two colored chewing gums were used as test food. Determining the degree of mixing of the two colors assessed mixing ability. Optical/scanning methods or visual inspection enable the assessment [12]. Multicolored paraffin wax, which is mixed during chewing, can be used as test food for determining masticatory performance; this method demonstrated validity and reliability in individuals with normal and compromised dentition [15, 16].

While comminution and mixing tests are common methods when quantifying masticatory performance, others were also developed. Some studies used color-changing chewing gums [17, 18]; here, color change was assessed with a colorimeter [17] or spectrophotometer [18] and was used as a way of quantifying masticatory performance.

While most of these tests were used in laboratory studies, no established method for evaluating a patient’s objective masticatory performance is available within clinical practice, and the clinician must rely on masticatory performance assessments via oral status appraisals, existing dentition, or patients’ subjective experiences. The Eichner index, which is used to classify occluding contacts, was validated as a method in relation to masticatory performance [19].

The term masticatory function was used for objective and subjective measurements [4]. In this study protocol, we use masticatory performance, because this term relates more to the objective aspects of mastication [4], and it has been adopted in clinical studies [20,21,22].

Our scoping reviews identified two reviews that were published in this field. Oliveira et al. presented a review of various methods used for evaluation of masticatory performance in patients with conventional complete dentures [23]. Fifty-two articles were analyzed, and Oliveira et al. concluded that despite the wide variety of methodologies, sieve methods are considered to be the golden standard for evaluating complete dentures wearers’ masticatory ability. A second systematic review synthesized available knowledge of distal-extension removable dental prosthesis in individuals with shortened dental arches and its effects on masticatory performance [24]. Four studies provided data on comminution, three on mixing ability, and one on both tests. The authors concluded that distal-extension removable dental prostheses—in subjects with shortened dental arches—partially compensate for reduced masticatory performance. But note that these reviews did not evaluate methodological quality of the studies of various clinical assessment methods used to determine masticatory function. Our scoping reviews of the literature showed that no systematic evaluation of varying methods used to assess objective clinical masticatory performance was published. So it would be of great value to conduct at systematic review that leads to identifying various methods of measuring objective masticatory performance and evaluating psychometric properties of identified methods so that practitioners can:

  • Monitor masticatory performance objectively before treatment

  • Assess whether treatment is indicated

  • Restore masticatory performance

  • Evaluate objective masticatory performance after treatment

Objectives

Primary objectives are to:

  • – Identify methods for objectively assessing clinical masticatory performance

  • – Evaluate psychometric properties (such as validity and reliability) of the identified methods

Secondary objectives are to:

  • – Compare measurement properties of the identified methods

  • – Identify any types of reported adverse events in development or validation of methods in the selected studies

Methods

Protocol/registration

The Preferred Reporting Items of Systematic Reviews and Meta-Analyses Protocol (PRISMA-P) guidelines are to be used for documenting review results [25]. Additional file 1 displays the PRISMA-P checklist. The protocol was registered in the PROSPERO database (Ref: CRD42016037700).

Inclusion criteria

Studies will be included in this systematic review if they are reported in scientific, full-text articles. Study designs must describe development of methods that objectively assess clinical masticatory performance in adult individuals (development article) or evaluate measurement properties of methods that objectively assess clinical masticatory performance in adult individuals (validation article).

There will be no restrictions regarding type of:

  • Time frame for completing assessments such as before, during, or after dental procedures

  • Settings in which assessments were conducted

This systematic review will include studies of the general adult population, ages ≥18

Exclusion criteria

These topics and article types will be excluded from this systematic review: interview methods and self-reported questionnaires; methods/instruments that subjectively measure masticatory performance; qualitative studies and case studies; opinion and editorial pieces; animal studies; and studies of humans with severe oral health complications, for example, oral cancer, malocclusions, and trauma (these patient groups represent special dental conditions, problems, and treatments).

If a study is unavailable in full-text, then the abstract will be excluded.

Methods for objectively assessing clinical masticatory performance

In this systematic review, clinical masticatory performance is considered a method that assesses an individual’s ability to mix or comminute food/artificial food bolus.

Outcomes

Outcomes from this systematic review will be lists/tables/descriptions of:

  • Methods for objectively assessing clinical masticatory performance (i.e., articles that report development or validation studies on these types of methods)

  • Measurement properties described in the identified methods (i.e., the articles must have reported measurement properties for the method that was developed and validated)

  • Adverse events that occurred during method development or validation

Language

Scientific articles published in English only will be selected for this systematic review. A list of possible relevant titles in other languages will be provided in an appendix.

Information sources

These databases will be searched from their inception up to January 2017: MEDLINE (Ovid), Embase (embase.com), Web of Science Core Collection (Thomson Reuters), Cochrane (Wiley), and Cinahl (Ebsco). To complete our searches in the databases, the Google Scholar search engine will be used to search potential databases such as university databases and conference proceedings, among others, for articles. If only abstracts are identified, then authors will be contacted to obtain full-text articles.

The reference lists of included articles or relevant reviews identified in the search will be manually screened. Experts and investigators in the field will be contacted to obtain information on ongoing or unidentified studies.

Search strategy

The overall search strategy was developed with librarians at Karolinska Institute’s university library. The staff at this library has extensive expertise and experience in developing search strategies for systematic reviews. Library staff will also conduct the literature search.

Search strategies will be developed for each database, with appropriate terms from controlled vocabulary (e.g., MeSH in MEDLINE and Emtree in Embase). Main terms will be mastication, bite force, chewing gum, and deglutition—combined with different terms for measurement properties. Along with the terms from MeSH and Emtree, a broad range of current free-text terms will be used. The free-text terms will, if appropriate, be truncated and/or combined with proximity operators.

A further search will be done with the names of the methods found in the original search. These names will be combined with AND—with the requirements for the target population and measurement properties.

Additional file 2 shows the search strategy in more detail.

Data management

All citations will be imported into the EndNote (version X7.5) reference program. The library staff will save the electronic searches, and summaries of the searches will be printed to capture results of the searches for the protocol records.

Study selection

The EndNote reference manager software will be used during the study selection. After the initial search, obvious duplicates will be removed using the reference manager software. One reviewer will perform this procedure. Two independent reviewers will assess remaining titles and abstracts eligibility. If a title or abstract is not enough to determine eligibility, then the full-text article will be obtained.

Full-text articles will be obtained from the remaining eligible abstracts. Two reviewers will independently judge each article for eligibility. If the information in the full-text article is not enough to determine eligibility, then authors will be contacted to obtain missing information. Discussions between the two reviewers will resolve any disagreement. If agreement is not reached, then a third reviewer will decide whether the article will be included. The reasons for excluding an article will be documented. Two team members will independently screen the references lists of the all included articles for any additional relevant studies.

All review team members will receive training in using EndNote and the data extraction forms before procedures in each phase (e.g., screening, eligibility, inclusion, and data extraction) during the systematic review. Training sessions will be organized for calibrating assessments among members. Regular team meetings will be held to discuss issues—to adhere to criteria in each phase. Several abstracts and articles will be pilot tested to ensure agreement and clarify decisions among reviewers.

Data collection

Two reviewers will implement data extraction for the included articles by using standardized data extraction forms developed for this study (one for development studies and one for validation studies; see Additional file 3). If consensus is not reached, a third reviewer will decide the outcome.

Data items

Data from included articles will be summarized in standardized data extraction forms that will contain this information: First author, year of publication, title, journal (or type of publication), country of study, study purpose(s), study design, study sample, description of method to objectively assess clinical masticatory performance, and adverse events.

Outcomes and prioritization (measurement properties of identified methods)

The predefined quality criteria for rating the measurement properties of instruments and methods recommended by the consensus-based standards for the selection of the health measurement instruments (COSMIN) group will be used to assess the measurement properties of the different methods [26]. The predefined criteria are in Additional file 4 [26].

The criteria relate to these measurement properties and aspects of measurement properties: reliability (internal consistency, measurement errors, reliability), validity (content validity, structural validity, hypothesis testing), and responsiveness. Also, under consideration will be whether development of any methods included in the systematic review was based on an a priori conceptual framework/model. Two independent reviewers will assess the measurement properties for each method. If consensus is not reached, a third reviewer will decide the outcome.

Quality assessment of individual studies

The COSMIN Checklist will be used to evaluate the methodological quality of the included studies [26]. This assessment is done to avoid including development or validation articles of methods that are of low methodological quality.

Four domains are distinguished in the COSMIN Checklist: ratings of the rigor of the reliability, validity, responsiveness, and interpretability with related measurement properties and aspects of measurement properties. Additional file 5 lists these properties. For each of the measurement properties, the COSMIN Checklist consists of 5 to 18 items that cover methodological standards. In addition, each item can be scored on a four-point scale (i.e., poor, fair, good, excellent). Taking the lowest rating for each item in one box, an overall score is obtained for each measurement properties separately [26].

Data synthesis

A final report will be developed; it will summarize the identified methods to facilitate objective assessment of masticatory performance. A table of characteristics for each method will be included. Analysis of the findings will be a process of narrative synthesis to summarize evidence on the measurement properties of the identified methods. First, the methodological quality of the studies will be assessed using the COSMIN Checklist. This process will generate a separate rating for each of the measurement properties, where estimated in each study. Second, the estimated measurement properties of the methods will be assessed against the established criteria of measurement properties (see Additional file 4).

Meta-biases

Meta-bias refers to the biased selection of research findings and covers reporting bias and publication bias. Reporting bias, such as not reporting findings as stated in previous published study protocol, is mainly a concern in articles that report RCT studies and other trials. In development and validation studies, there is no tradition of publishing study protocols before starting data collection in the research study. So this systematic review cannot search for study protocols. The first author will be contacted for articles in which we lack important data or information for conducting our systematic review.

Confidence in cumulative estimate

The scoring system for the COSMIN Checklist will be used to summarize the confidence in cumulative estimate in this review [26]. This scoring system is similar to the GRADE system that is used for synthesizing evidence from clinical trials [27]. The resulting level of evidence for the measurement properties of each method will be classified as per criteria in Additional file 6.

Differences between the protocol and the review

If criteria or other methods must be changed during review implementation, then all differences will be reported between published protocol and the review. The rationale for each type of change of methods will be documented.

Discussion

The objective of this systematic review is to conduct a comprehensive assessment of different methods designed to objectively assess clinical masticatory performance. This systematic review will rate these methods, assess their measurement properties, and identify one or more methods that can be recommended for use in clinical or scientific environments. From what is known to us, no systematic evaluation of different methods used to objectively assess clinical masticatory performance has been published.

Poor oral status affects nutritional status and quality of life and leads to impaired function [28, 29]. If the treatment goal of dental practitioner is to restore oral function, then surely masticatory performance would be one of those aspects to consider. This would be of value for all individuals with compromised dentitions—especially older individuals. Recent research has pointed to the relation between cognitive and chewing functions [30]—a factor that makes it very important to find valid, reliable methods to objectively assess clinical masticatory performance.

The strength in this systematic review will be use of the COSMIN Checklist to assess measurement properties of the identified methods and methodological quality of included studies [26]. The COSMIN Checklist was developed for health status questionnaires. But this checklist has been used in several systematic reviews for evaluating methods such as performance-based measures to assess physical function in hip and knee osteoarthritis [31] multicomponent tools to assess frailty in older adults [32] and functional assessments of older adults at risk of activity and participation limitations [33]. Availability of the university library of Karolinska Institute and its qualified staff is another strength.

One limitation for this review is that it will include articles published in English only. Possible relevant titles for identified articles in other languages will be provided in a list. Identification of methods published in other languages is not expected, and financial resources are unavailable for translation of potential articles. If a seemingly important article in a language other than English is found, then the author(s) will be contacted and a version or information in English will be requested.

Two of the authors have earlier experience in reading and searching for eligible articles for systematic reviews, and all authors will be trained in this work—with the library staff—before the systematic review starts.