An increasing number of chemical, physical and biological tests are performed on manufactured nanomaterials for scientific and regulatory purposes. Existing test guidelines and measurement methods are not always directly applicable to or relevant for nanomaterials. Therefore, it is necessary to verify the use of the existing methods with nanomaterials, thereby identifying where modifications are needed, and where new methods need to be developed and validated. Efforts for verification, development and validation of methods as well as quality assurance of (routine) test results significantly benefit from the availability of suitable test and reference materials. This paper provides an overview of the existing types of reference materials and introduces a new class of test materials for which the term ‘representative test material’ is proposed. The three generic concepts of certified reference material, reference material (non-certified) and representative test material constitute a comprehensive system of benchmarks that can be used by all measurement and testing communities, regardless of their specific discipline. This paper illustrates this system with examples from the field of nanomaterials, including reference materials and representative test materials developed at the European Commission’s Joint Research Centre, in particular at the Institute for Reference Materials and Measurements (IRMM), and at the Institute for Health and Consumer Protection (IHCP).
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Price includes VAT for USA
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
This is the net price. Taxes to be calculated in checkout.
Several definitions exist for the term nanomaterial (e.g. ISO 2010a). For regulatory purposes, the European Commission published in 2011 a recommendation for a definition for nanomaterials (EC 2011): ‘"Nanomaterial" means a natural, incidental or manufactured material containing particles, in an unbound state or as an aggregate or as an agglomerate and where, for 50% or more of the particles in the number size distribution, one or more external dimensions is in the size range 1 nm to 100 nm’.
Aschberger K, Micheletti C, Sokull-Klüttgen B, Christensen FM (2011) Analysis of currently available data for characterising the risk of engineered nanomaterials to the environment and human health—lessons learned from four case studies. Environ Int 37:1143–1156
Braun A, Franks K, Kestens V, Roebben G, Lamberty A, Linsinger TPJ (2011) Certification of equivalent spherical diameters of silica nanoparticles in water, certified reference material ERM®-FD100, EUR 24620 EN, ISBN 978-92-79-18676-9. Publications Office of the European Union, Luxembourg
EC (European Commission) (1967) Council Directive 67/548/EEC of 27 June 1967 on the approximation of laws, regulations and administrative provisions relating to the classification, packaging and labelling of dangerous substances. OJ L 196, 16.8.1967, 1–98
EC (European Commission) (2004) Directive 2004/10/EC of the European Parliament and of the Council of 11 February 2004 on the harmonisation of laws, regulations and administrative provisions relating to the application of the principles of good laboratory practice and the verification of their applications for tests on chemical substances. OJ L 50, 20.2.2004, p. 44–59
EC (European Commission) (2006) Regulation (EC) No 1907/2006 of the European Parliament and of the Council of 18 December 2006 concerning the Registration, Evaluation, Authorisation and Restriction of Chemicals (REACH), establishing a European Chemicals Agency, amending Directive 1999/45/EC and repealing Council Regulation (EEC) No 793/93 and Commission Regulation (EC) No 1488/94 as well as Council Directive 76/769/EEC and Commission Directives 91/155/EEC, 93/67/EEC, 93/105/EC and 2000/21/EC. OJ L 396, 30.12.2006, 1–849
EC (European Commission) (2011) Commission Recommendation of 18 October 2011 on the definition of nanomaterial (2011/696/EU). OJ L 275, 20.10.2011, 38–40
Emons H (2006) The ‘RM family’—identification of all its members. Accred Qual Assur 10:690–691
Emons H, Linsinger TPJ, Gawlik BM (2004) Reference materials: terminology and use. Can’t one see the forest for the trees? Trends Anal Chem 23:442–449
Franks K, Braun A, Charoud-Got J, Couteau O, Kestens V, Lamberty A, Linsinger TPJ, Roebben G (2012) Certification of the equivalent spherical diameters of silica nanoparticles in aqueous solution, certified reference material ERM®-FD304, EUR 25018 EN, ISBN 978-92-79-21867-5. Publications Office of the European Union, Luxembourg
IHCP (Institute for Health and Consumer Protection) (2011) http://ihcp.jrc.ec.europa.eu/our_activities/nanotechnology/nanomaterials-repository/list_materials_JRC_rep_oct_2011.pdf
IRMM (Institute for Reference Materials and Measurements) (2005) IRMM-481 Product Information Sheet, December 2005, http://irmm.jrc.ec.europa.eu/Pages/rmcatalogue.aspx
ISO (International Organization for Standardization) (2006) ISO Guide 35, reference materials—General and statistical principles for certification. ISO, Geneva
ISO (International Organization for Standardization) (2008a) ISO Guide 30:1992/Amd.1:2008, Terms and definitions used in connection with reference materials. ISO, Geneva
ISO (International Organization for Standardization) (2008b) ISO 148-2:2008 Metallic materials, Charpy pendulum impact test, Part 2: Verification of testing machines, ISO, Geneva
ISO (International Organization for Standardization) (2009) ISO Guide 34. General requirements for the competence of reference material producers, ISO, Geneva
ISO (International Organization for Standardization) (2010a) ISO/TS 80004–1:2010 Nanotechnologies—Vocabulary—Part 1: Core terms. ISO, Geneva
ISO (International Organization for Standardization) (2010b) ISO 1182:2010 Reaction to fire tests for products. Non-combustibility test, ISO, Geneva
ISO (International Organization for Standardization) (2011) ISO/DTR 13014, Nanotechnologies, Guidance on physico-chemical characterization for manufactured nano-objects submitted for toxicological testing, (approved for publication) ISO, Geneva
ISO (International Organization for Standardization) (2012) ISO Concept Database, http://cdb.iso.org, accessed 11 January 2012
IUPAC (International Union for Pure and Applied Chemistry) (1995) Harmonized guidelines for internal quality control in analytical chemistry laboratories. Pure Appl Chem 67:649–666
IUPAC (International Union for Pure and Applied Chemistry) (2012) IUPAC compendium of chemical terminology—the gold book, http://goldbook.iupac.org/ Accessed 11 January 2012
JCGM (Joint Committee for Guides in Metrology) (2008). International vocabulary of metrology—Basic and general concepts and associated terms (VIM), 3rd Edition, JCGM 200:2008, Sevres, France, 2008. http://www.bipm.org/utils/common/documents/jcgm/JCGM_200_2008.pdf
Johnston HJ, Hutchison GR, Christensen FM, Peters S, Hankin S, Stone V (2009) Identification of the mechanisms that drive the toxicity of TiO2 particulates; the contribution of physicochemical characteristics. Part Fibre Toxicol 6:33. doi:10.1186/1743-8977-6-33
Johnston HJ, Hutchison GR, Christensen FM, Peters S, Hankin S, Aschberger K, Stone V (2010a) A critical review of the biological mechanisms underlying the in vivo and in vitro toxicity of carbon nanotubes: the contribution of physico-chemical characteristics. Nanotoxicology 4:207–246
Johnston HJ, Hutchison GR, Christensen FM, Peters S, Hankin S, Stone V (2010b) A review of the in vivo and in vitro toxicity of silver and gold particulates: particle attributes and biological mechanisms responsible for the observed toxicity. Crit Rev Toxicol 40:328–346
Klein CL, Comero S, Stahlmecke B, Romazanov J, Kuhlbusch TAJ, Van Doren E, De Temmerman PJ, Mast J, Wick P, Krug H, Locoro G, Hund-Rinke K, Kördel W, Friedrichs S, Maier G, Werner J, Linsinger T and Gawlik BM. (2011). NM-Series of Representative Manufactured Nanomaterials, NM-300 Silver, Characterisation, Stability, Homogeneity. EUR 24693 EN. ISBN 978-92-79-19068-1
Linsinger TPJ, Roebben G, Solans C, Ramsch R (2011) Reference materials for measuring the size of nanoparticles. Trends Anal Chem 30:18–27
NIST (National Institute for Standardisation) (2011) NIST releases First Certified Reference Material for Single-Wall Carbon Nanotubes, http://www.nist.gov/mml/polymers/cnt-122011.cfm
OECD (Organisation for Economic Co-operation and Development) (1998) OECD Principles on Good Laboratory Practice, in OECD Series on principles of Good Laboratory Practice and Compliance Monitoring, Number 1 ENV/MC/CHEM(98)17
OECD (Organisation for Economic Co-operation and Development) (2005) Guidance Document on the Validation and International Acceptance of new or Updated Test Methods for Hazard Assessment, ENV/JM/MONO(2005)14, in OECD Series on Testing and Assessment, Number 34
OECD (Organisation for Economic Co-operation and Development) (2008) OECD-WPMN, Series on the Safety of Manufactured Nanomaterials, Number 6, List of manufactured nanomaterials and list of endpoints for phase one of the OECD testing programme, ENV/JM/MONO13 (2008)
OECD (Organisation for Economic Co-operation and Development) (2009) Preliminary Review of OECD Test Guidelines for their Applicability to Manufactured Nanomaterials. ENV/JM/MONO(2009)21
OECD (Organisation for Economic Co-operation and Development) (2010) Guidance Manual for the Testing of Manufactured Nanomaterials: OECD’s Sponsorship Programme; first revision. ENV/JM/MONO(2009)20/REV
Poland CA, Duffin R, Kinloch I, Maynard A, Wallace WAH, Seaton A, Stone V, Brown S, Macnee W, Donaldson K (2008) Carbon nanotubes introduced into the abdominal cavity of mice show asbestos-like pathogenicity in a pilot study. Nat Nanotechnol 3:423–428
Roebben G, Linsinger TPJ, Lamberty A, Emons H (2010) Metrological traceability of the measured values of properties of engineering materials. Metrologia 47:S23–S31
Roebben G, Emons H, Reiners G (2011), Nanoscale Reference Materials, in Nanotechnology Standards, eds. V. Murashov, J. Howard, Springer Science+Business Media, New York/Heidelberg, pp 53–75
Scaravelli E, Brohée M, Marchelli R, van Hengel AJ (2009) The effect of heat treatment on the detection of peanut allergens as determined by ELISA and real-time PCR. Anal Bioanal Chem 395:127–137
Singh C, Friedrichs S, Levin M, Birkedal R, Jensen KA, Pojana G, Wohlleben W, Schulte S, Wiench K, Turney T, Koulaeva O, Marshall D, Hund-Rinke K, Kördel W, Van Doren E, De Temmerman PJ, Abi Daoud Francisco M, Mast J, Gibson N, Koeber R, Linsinger T, Klein CL. (2011), NM-Series of Representative Manufactured Nanomaterials, Zinc Oxide NM-110, NM-111, NM-112, NM-113, Characterisation and Test Item Preparation. EUR 25066 EN, ISBN 978-92-79-22215-3
UNODC (United Nations Office on Drugs and Crime) (2009) Glossary of terms for quality assurance and good laboratory practices, ST/NAR/26/Rev.1
Warheit DB (2010) Debunking some misconceptions about nanotoxicology. Nano Lett 10:4777–4782
WHO (World Health Organisation) International Biological reference Preparations, Geneva (2011), catalogue downloadable from http://www.who.int/bloodproducts/ref_materials/
The authors wish to thank Juan Riego Sintes (JRC-IHCP) for valuable comments.
Basic concepts for measurement and testing and related quality assurance
A number of basic measurement and testing concepts are explained in this annex. This will help the reader of the paper to better understand some of the terms used in the main body of the text. The authors also wanted to illustrate the similarities between the concepts behind the different terms used in different fields of measurement and (regulatory) testing.
The terms ‘testing’ and ‘measurement’
Two fundamental concepts in this article are ‘test’ and ‘measurement’, which may have different connotations in different scientific disciplines.
For regulatory testing, the OECD guidance document 34 (OECD 2005) defines a test method as (p. 17): ‘… an experimental system that can be used to obtain a range of information from chemical properties through the adverse effects of a substance. The term ‘test method’ may be used interchangeably with ‘assay’ for ecotoxicity as well as for human health studies. …’. Testing means applying a test method.
Measurement is defined (JCGM 2008) as the process of experimentally obtaining one or more quantity values (number and reference together expressing magnitude) of a quantity, the latter being a property of a phenomenon, body, or substance, where the property has a magnitude that can be expressed as a number and a reference. The science of measurement and its application is called metrology.
When speaking in the most general sense, there are tests that are not usually seen as measurements, and measurements that are not usually called tests. However, the basic elements of the above definitions are highly similar.
Substances, materials and samples
The term substance generally describes a chemical element or compound.
This paper uses the REACH (EC 2006) definition of substance: In the EU regulatory context (EC 1967), now part of REACH, the term ‘substance’ has a more specific meaning: substance means ‘a chemical element and its compounds in the natural state or obtained by any manufacturing process, including any additive necessary to preserve its stability and any impurity deriving from the process used, but excluding any solvent which may be separated without affecting the stability of the substance or changing its composition’. Hence, REACH substances may consist of one or more chemical compounds, and guidance is found on http://echa.europa.eu.
There is no unique definition of the term material. Its exact meaning varies between different scientific fields or industrial sectors (ISO 2012), but most of the existing ISO definitions [for example in ISO 1182:2010 (ISO 2010b)] describe a material as a single substance or a uniformly dispersed mixture of substances. This definition implies that the term material has a broader coverage than the term substance as defined in REACH. Examples of materials that are not typically called substance are concrete, timber, stone, milk powder, etc. Nevertheless, as REACH addresses all forms of substances placed on the market, materials, including nanomaterials, are covered by REACH.
Both materials and substances may be quite complex in composition, including for example impurities and necessary stabilisers and may consist of multiple phases or components with a certain variability in composition. In any case, material and substance are collective terms for kinds of matter with properties that are considered uniform above a certain scale. A relevant question to ask is when substances or materials produced as different batches, or in different places, or by different processes can be considered as identical, equivalent or similar. The answer depends amongst others on the acceptable heterogeneity, for example in the variation of property values between different batches, as well as on the context, which for example may relate to specific legal requirements. To assess the heterogeneity within or between batches, tests need to be performed on samples of the material(s): a sample is a specific, unique portion of material or substance selected from a larger amount of parent material. A representative sample is a sample that reflects the average property of the parent material.
The terms test sample, test material, and test substance are straightforward combined terms, to be interpreted in accordance with the above understanding of the terms sample, material, or substance. Hence, a test material or test substance is a material or substance to be tested. A test sample is a portion of a test material or test substance.
The terms test item [see e.g. Good Laboratory Practice (GLP) (OECD 1998)], test piece [see e.g. ISO 148–2 (ISO 2008b)] and test specimen are used synonymously, and have the same meaning as test sample.
Steps in a test or measurement process
On the most generic level, any test or measurement consists of the following steps:
A representative sample is taken from the material to be tested and often undergoes pre-treatment (dispersion, dissolution, digestion, etc.).
The test sample is fed into a test system where it creates a response. A wide range of test systems exists, for example physical instruments (electron microscopes, etc.) or biological systems (microbiological assays for antibiotics, rats for toxicity testing, etc.). The nature of the response can be chemical (e.g. production of a precipitate), physical (e.g. absorption of light of a certain wavelength) or biological (e.g. change of growth of bacteria in the presence of the sample).
The response is expressed in quantitative terms (e.g. mass of precipitate is 1.245 g) or in qualitative terms (e.g. there is a blue precipitate).
The response is compared with the response of a (sample of a) second material, with known properties and response, either in a quantitative or in a qualitative way. As the discussion below shows, numerous terms like ‘calibrant’, ‘calibrator’, ‘standard’, ‘reference substance’, ‘reference chemical’ or ‘certified reference material’ and ‘control’ exist for this second sample (Emons et al. 2004), and possibly each term has a slightly different meaning in its context of origin. This comparison is an important part of the metrological traceability chain of the test result (see “Metrological traceability” section).
In addition to this generic procedure, there are of course features which are particular to the test system (e.g. higher variability in observed responses when using biological test systems as compared to physical test systems). Also in these cases, the above generic procedure would still provide a descriptive framework.
A key concept in any testing is ‘metrological traceability’, defined by the Joint Committee for Guides in Metrology (JCGM 2008) as ‘property of a measurement result whereby the result can be related to a reference through a documented unbroken chain of calibrations, each contributing to the measurement uncertainty’. The level of traceability establishes the degree of comparability of the measurement for example over time and geographically: whether the result of a measurement can be compared to the previous one, to a measurement result from a year ago, or to the result of a measurement performed anywhere else in the world.
Metrological traceability includes the identity of the measurand (the property to be measured) and its quantity value. The identity of the measurand can be structurally defined (such as mass, or bond lengths in a specific molecule) or procedurally defined. Examples of test procedures defining the measurand are the mass fraction of dietary fibre in fruits, enzyme activity or skin sensitization according to OECD Test Guideline 429, where the measurand is the proliferation of lymphocytes in the lymph node in test groups of animals exposed to the test substance. This is compared to the proliferation of lymphocytes in the lymph node in test groups of animals which are vehicle treated controls, and gives a Stimulation Index.
Traceability of the quantity value is defined by the calibration system. In its simplest form, an international agreement has been reached to use a certain material as standard, and a well-known example is the international kilogram stored in Paris, but also many primary WHO preparations (WHO 2011) fall under this category.
Quality assurance of test and measurement methods
In order to ensure that the testing is as reliable as required by the user of the test results, methods are validated, calibrated and subjected to continuous quality control, as relevant. The main aspects of such quality assurance efforts, as well as the requirements of the corresponding benchmark materials, are described below.
Calibration is the process where the response of the calibrant or reference substance is related to its property value. The curve of the known property values of a set of calibrants versus responses of the test system allows assigning a quantity value to other substances measured thereafter. A first key requirement is that the calibrant or reference substance is homogeneous and stable to ensure that any portion of it gives the same result. A second key requirement is that the value of the measurand of interest is well established. The value of the measurand can for example be a concentration or an antibiotic potency. The measurement unit does not need to be a physical unit, and for example, the result of a test may be that a substance A is ‘x times more potent than reference substance B’. Often, calibrants or reference substances are idealised samples, for example consisting of a single chemical compound. For (eco-) toxicological testing (using for example the OECD test guidelines), the tests may not have designs that lend themselves to classical calibration, and the term ‘calibrant/calibration’ is not used.
For (eco-) toxicological testing, the OECD Guidance Document 34 (OECD 2005) defines test method validation as ‘… a process based on scientifically sound principles by which the reliability and relevance of a particular test, approach, method or process are established for a specific purpose. Reliability is defined as the extent of reproducibility of results from a test within and among laboratories over time, when performed using the same standardised protocol. The relevance of a test method describes the relationship between the test and the effect in the target species and whether the test method is meaningful and useful for a defined purpose, with the limitations identified. In brief, it is the extent to which the test method correctly measures or predicts the (biological) effect of interest, as appropriate. Regulatory need, usefulness and limitations of the test method are aspects of its relevance. New and updated test methods need to be both reliable and relevant, i.e. validated’.
Validation of regulatory test methods, for example within the OECD, takes place once to ensure that the methods are reliable and relevant for the endpoint and that the method is recognised within the relevant jurisdiction.
Method validation has also a more generic meaning: laboratories validate test methods, i.e. they verify whether the specified method is adequate for an intended use. According to ISO and others, method validation requires materials to test robustness, precision and trueness. One can note that robustness and precision are the equivalent of the term reliability used in OECD (OECD 2005), and that trueness is conceptually similar to the term relevance in OECD (OECD 2005).
Testing of robustness comprises including slight variations in the test protocol and observing the effect of this on the outcome of the test. The materials used for this test should resemble the actual test samples as closely as possible. In addition, the material needs to be stable over the time of the study and must be sufficiently homogeneous, so that a variation of results, if detected, indeed reflects the effect of the variations in the test protocol and not sample heterogeneity.
In a precision study, tests are performed on different subsamples of the same material to investigate the test result variation within one test series in the same laboratory (repeatability), between series in the same laboratory (intermediate precision) and between laboratories (reproducibility). Also here, the sample should closely resemble actual test samples in composition and response. To make the results meaningful, the material chosen must be stable over the time of the study and must be homogeneous to assure that observed variations reflect the variability of the method in or between laboratories, and not heterogeneity or changes of the material. The material tested does not need to be accompanied by beforehand well-established quantity values of the measurands of interest as the goal is a relative assessment.
In a trueness experiment, the response of the test system to a sample is compared to an assigned or expected response to this sample, and this necessarily requires a well-established value of the measurand in question. The material used to check trueness must be stable until the time of use and sufficiently homogeneous to ensure that different portions give the same result. Typically, a material for a trueness experiment is more complex or resembling more the real-life materials to be tested later, than a material used for calibration. The reason for this is that the trueness experiment must not only cover the signal-producing step in the measurement process, but also all sample preparation steps.
Quality control of methods
For quality control of a routinely used method, a known sample is analysed periodically or as part of every test series and results are compared with target values. If the result is within specified limits, the method is under control. The material used must be homogeneous, so that heterogeneity does not contribute to the variation of results. The material must also be stable, often over months or even years, as otherwise degradation would make comparison of results obtained over time invalid. Target values and acceptance limits are usually obtained from repeated tests.
Interlaboratory comparisons are faced with the same issues as interlaboratory method validation: A homogeneous set of samples, which is stable over the duration of the period of comparison, is required to ensure that any difference between participants’ test results are not due to changes in the inherent material properties or due to differences between the distributed samples.
About this article
Cite this article
Roebben, G., Rasmussen, K., Kestens, V. et al. Reference materials and representative test materials: the nanotechnology case. J Nanopart Res 15, 1455 (2013). https://doi.org/10.1007/s11051-013-1455-2
- Certified reference material
- Representative test material