Abstract
Modelbased methods are increasingly used in all areas of biopharmaceutical process technology. They can be applied in the field of experimental design, process characterization, process design, monitoring and control. Benefits of these methods are lower experimental effort, process transparency, clear rationality behind decisions and increased process robustness. The possibility of applying methods adopted from different scientific domains accelerates this trend further. In addition, modelbased methods can help to implement regulatory requirements as suggested by recent Quality by Design and validation initiatives. The aim of this review is to give an overview of the state of the art of modelbased methods, their applications, further challenges and possible solutions in the biopharmaceutical process life cycle. Today, despite these advantages, the potential of modelbased methods is still not fully exhausted in bioprocess technology. This is due to a lack of (i) acceptance of the users, (ii) userfriendly tools provided by existing methods, (iii) implementation in existing process control systems and (iv) clear workflows to set up specific process models. We propose that modelbased methods be applied throughout the lifecycle of a biopharmaceutical process, starting with the setup of a process model, which is used for monitoring and control of process parameters, and ending with continuous and iterative process improvement via data mining techniques.
Introduction
A safe product is the target of every production process. In the field of pharmaceutical products, this is ensured by elaborate approvals and the continuous control of independent authorities such as the Food and Drug Administration or the European Medicines Agency. The International Conference on Harmonisation (ICH) has established quality guidelines which should be considered during process lifecycle (1). A process lifecycle includes process development, scale up and continuous optimization until product discontinuation. The basis of a production process is a definition of the product by a quality target product profile (QTPP) that includes critical quality attributes (CQA) (2), such as physicochemical properties, biological activity, immunochemical properties, purity and impurities (3). The aim of each industrial production process is to satisfy the predetermined CQAs with a maximum of productivity. According to the ICH Q8(R2) guidelines the quality by design (QbD) approach is a one way of engineering an adequate production process. QbD combines sound science and quality risk management in order to identify critical material attributes (CMA) and critical process parameters (CPP), which shows significant effects on CQAs. In addition, the functional relationships between CMAs and CPPs on CQAs should be investigated (2). This requires the use of mathematical models within the framework of QbD. The basic idea of the QbD approach is that a process with controlled CMAs and CPPs in a defined design space will lead to continuous CQAs and finally to a sufficient QTPP. In order to achieve this goal process analytical technology (PAT) – tools are used. PAT includes the tasks of designing, analyzing and controlling production processes based on realtime monitoring of critical parameters including them CMAs, CPPs and CQAs (2,4).
In addition to adequate product quality, each process aims for high productivity. This includes the thoughtful use of raw materials, technologies and human resources in addition to the reduction of unwanted byproducts. In contrast to CPPs which only affect product quality, key process parameters (kPP) affect productivity and economical viability (5). During the whole process lifecycle, CPPs and kPPs have to be improved in order to react to changed boundary conditions such as fluctuations in raw materials, new production facilities and locations, new technologies and constantly fluctuating staff. In summary, the following four challenges arise during a process lifecycle: I) generation of process knowledge, II) process monitoring, III) process optimization and IV) continuous improvement of the process (Fig. 1). In order to fulfill these challenges during the entire process lifecycle, a lifecycle management is indispensable. ICH Q8(R2) and Q12 address this issue but don’t give any concrete solution (2,6). The reason for this is the lack of practicable knowledge management systems (7).
In order to solve the four previously presented challenges during the process lifecycle an overview of available methods and technologies is given in the present manuscript. The focus lies on modelbased methods which are characterized by the use of mathematical models. Basically, each process model can be described by an Eq. [1], which is defined by a model output/outputs y, a function f, the time t, model states x, and the design vector φ, including all necessary process parameters (CPPs & kPPs) such as feed rates, temperature, pH etc., and the model parameters θ.
In order to show the interaction between the four separate challenges (IIV), the red line of this paper will be analogous to a simple control loop (Fig. 1). This approach allows a scientific discussion of interaction and a possible outlook with respect to the process lifecycle.
The first challenge (challenge I) investigated is the identification of CPPs, kPPs and the generation of process knowledge. Process development and improvement can only occur if relationships and interactions are understood. With respect to modelbased methods process relevant (critical) knowledge is defined as the sum of relationships and interactions, which should be considered in a process model in order to predict a target value (CPP, kPP or CQA). Modelling is a tool for the identification and description of these relationships with mathematical equations verified by statistic tests. In chapter 2.1, different modelling workflows will be presented and compared with respect to the modelling goal, complexity as well as transferability to biopharmaceutical production processes. The basis of the parametrization and verification of each model are data. Especially in model development, data have a major impact on model structure and validity space. Therefore, there is a strong iteration between modelling and data collection. In the second part of chapter 2.1 methods are described as to which data should be collected to verify the process model. The main output of this chapter are methodologies in order to generate adequate model structures f and model parameters θ, which can be adapted during the process lifecycle based on additional data and knowledge. The models and their parameters are necessary for further monitoring and control applications.
Since every process is affected by certain disturbances which affect quality and productivity, monitoring is a need for biopharmaceutical production processes (challenge II) (2). Monitoring is defined as the supervision of process parameters and variables, which is needed for subsequent control actions. Monitoring hereby includes the collection of information by measurements and subsequent data processing, whereas in the latter modelbased methods can be applied. These methods and their application in monitoring will be discussed in chapter 2.2. It will focus on methods which help to define the needed measurements, allow the combination of multiple measurements to handle process noise and measurement uncertainty and finally allow the estimation of unmeasured states.
The final aim of process design is process control, discussed in chapter 2.3. Mainly two topics will be discussed within the challenge III) “Process Optimization”. The first topic is a clear description of the control goal within certain boundaries that are based on product, technical, physiological and economic limits. Thereby various modelbased methods for openloop and closedloop applications will be presented. With regard to modelbased methods, methodologies for optimal and predictive control are presented. The second topic is estimating an “optimal” design vector and identifying critical process limitations, which provide an important input for further process optimization.
Certain disturbances that affect every process can be classified as a) known but neglected and b) unknown and neglected ones. Both can have a significant impact on process performance and should be continuously improved. This continuous improvement (challenge IV) is a key innovation motor for existing processes during their entire lifecycle. New analytical methods, measurement devices, automation, further data evaluation and others can lead to process relevant knowledge which should be taken into account. Within chapter 2.4 this continuous improvement of the process will be investigated. Regarding modelbased methods the focus will be on datamining tools, which allow researchers to set up hypotheses of potential correlations. These hypotheses are a necessary input for further process modelextensions and support the overall goal of an adequate product quality and high productivity throughout the entire process lifecycle.
Finally, an overall statement on further applications and perspectives of modelbased methods within the biopharmaceutical process lifecycle is presented in the conclusion.
Results & Discussion
Generation of Process Knowledge
Modelling
Within the process lifecycle, knowledge is defined as the ability to describe relationships between (critical) process parameters and critical quality or performance attributes. This knowledge needs to be documented. The trend of the last years is clearly from a transfer approach, which is based on spoken and written words, towards a model approach (8). In the context of biopharmaceutical processes, this indicates the possible usage of process models as knowledge storage systems (9). The setup of these process models is still challenging. Contributions presenting workflows for modeling are increasing (10,11,12,13,14,15). According to good modelling practice, the single steps of modelling are always similar (14). These steps are: i) setup of a modelling project, ii) setup of a model, iii) analysis of the model. In addition, the documentation of the complete modelling project should be entire and transparent.
The basis of each modelling workflow is a clear definition of the model goal. This often resents a major challenge and cannot be achieved without iterations between modelers and project managers. The model goal should include the definition of target values, acceptance criteria and boundary conditions. Furthermore, the application of the model should be considered. Each process related model should be as simple as possible and as accurate as necessary. From this dogma, it follows that a model should only include necessary (critical) states, model parameters and process parameters. Depending on the goal of the model, different model types are suitable. Frequently used is the classification between data driven, mechanistic and hybrid models (16). In terms of applications of models, the classification between dynamic and static models is more appropriate. Dynamic models include differential equations, typically over time or location coordinates which allow prediction. Static models are correlations which cannot provide timedependent simulation results. Hence, they are not applicable for prediction over time or location, which is commonly required in bioprocess development. Data driven, mechanistic as well as hybrid models can be both, static and dynamic.
The set up and analysis of a model are iterative steps within each modelling workflow (13,17), which are illustrated in Fig. 2. For the setup of models, different approaches are reported in literature. To date, experts are required to set up models, as they strongly depend on prior knowledge. This limited prior knowledge is a general gap for the application of all modelbased methods. Only a few workflows for automated modelling are available. With regard to the process lifecycle, the focus of this review will be on these automated workflows for the setup of dynamic mechanistic models. A generic and strongly knowledgedriven approach is shown by the company Bayer AG (18,19): Based on an extensive dynamic metabolic flux model in combination with a generic algorithm, the initial complex model is reduced to the most necessary parts. The benefit of this topdown approach is the intense use of prior knowledge. The working group of King shows another approach, based on the detection of process events in combination with a model library (10,20,21). The benefit of this approach is that less prior knowledge is necessary and the transferability on other bioprocesses is given. As one of the drawbacks of modelbased methods is the validation of models and there parameters an automated workflow for the generation of substantial targetoriented mechanistic process models was developed in our working group (22). This approach allows the generation and validation of process models with less prior knowledge and without model libraries.
The analysis of each model follows the same order. Based on collected data and an assumed model structure a parameter fit is performed. With the use of optimization algorithms, the model parameters are adapted in a way, that the previous defined descriptor is optimized (see chapter 2.3). Typically, this is a minimization of a model deviation, which can be described by different characteristics such as the sum of square errors (SSE), a normalized root mean square error (NRMSE), a profile likelihood or other descriptors. A comparison of the achieved descriptor with a previously defined acceptance criterion is the first analysis of each model. If this fails, the model structure is not suitable for the present issue. If the model passes, the model structure could be suitable to describe the relation. The next analysis is focused on the model parameters \( \widehat{\theta} \) and their deviations. Therefore, typically, an identifiability analysis is performed which follows two aims: The first aim is the structural identifiability of model parameters, which is necessary for process models with the aim of monitoring and control. If structural identifiability is not given, model parameters can compensate each other due to cross correlation. This results in multiple solutions and can lead to spurious results. There are several methods in order to evaluate structural identifiability (23,24). If structural identifiability is given, practical identifiability should be investigated in order to fulfil the second goal, which is a statement about confidence intervals of model parameters based on existing data (24,25). This is necessary in order to decide if parameters can be estimated with the data available. If practical identifiability is given, the model parameters are significant. If not, two statements can be made: i) the available data allows no determination of the model parameter or ii) the model structure allows cross correlations between model parameters and is therefore not as simple as possible.
In addition to the analysis of model and model parameter deviations, there is a variety of methods to characterize models with their focus on robustness. The first check should be a global behavior test with the goal of ensuring the right implementation of a model: here the model is tested with extreme input values. Additionally, if possible, certain redundancy should be implemented in the model (see chapter 2.2). Typical approaches are material balances, as they are typically used for yeast or microbial processes (13,26). Another frequently used method is a sensitivity analysis with the aim of showing the impact of deviations of model parameters, process parameters and model inputs on model outputs (27,28). The information obtained in this sensitivity analysis can be used to improve the model within the process lifecycle. With respect to the further usage of models certain causes for deviations must be considered. Deviations can be mainly obtained from two sources. The first source of deviations is the model structure in itself. Based on the principle that a model is always a sum of assumptions, there is always an accepted model deviation with a predefined validity space. In addition, models can always only explain a part of the process variance. Disturbances that are not considered in the model cannot be explained by it. Within the concept of process lifecycle this implies a continuous model improvement (see chapter 2.4). The second source of variance is the deviation of the model parameters \( \widehat{\theta} \) caused by changing and not explained sources of variance. This can be improved by adapting the model structure or parameters. For both additional information is necessary. It can be provided by additional data or additional hypotheses from data mining methodologies (see chapter 2.4) leading to new model structures (Fig. 2). With respect to realtime application, several methodologies for model adaption are shown in chapter 2.2.
Generation of Information
During the process development certain experiments must be performed in order to identify CPPs and an adequate design space and to verify process models. The most widely used strategy is the standard design of experiments (DoE) (29), which is given as an example in the guidelines ICH Q8(R2) (2). However, the applicability of standard DoEs for bioprocesses comprising a huge number of potential CPPs is not given to the full extent. The reason for this is mainly the modelbased data evaluation, which typically only assumes linear or quadratic effects between process parameters and quality/product attributes. Known relationships describing physiological interactions are usually not taken into account in standard DoEs. Therefore other modelbased methods are available which are based on information.
In order to verify certain process models, information is necessary. Within this context, information is defined as the possibility of estimating the model parameters θ of a model f with collected data. Mathematical statistics call this the Fisher information, which is described by the Fisher information matrix (H _{ θ }). H _{ θ } depends, besides the static model structure, on the model parameters θ and the design vector φ and can be estimated by Eq. [2] (30,31). The design vector includes all possible process parameters, which are considered in the model, and sampling points (t_{k}) where additional data are collected. \( {H}_{\theta}^0 \) describes the initial fisher information matrix, n_{sp} the number of sampling points, N _{ y } the number of model states y and N _{ θ } the number of model parameters θ.
Applications for H _{ θ } are mainly found in the modelbased design of experiments (MBDoE). An experiment has per definition the aim to prove, refute or confirm a hypothesis. In the case of MBDoE the hypothesis is the process model in itself. Therefore, the information content of a planned experiment is maximized depending on φ. This information content should be a criterion extracted from H _{ θ }. The Doptimal design which indicates a maximization of the determinant of H _{ θ } is frequently used. Other descriptors include the maximization of the trace of H _{ θ } (Aoptimal) or the maximization of the smallest eigenvalue (Eoptimal) (32). Telen et al. investigated additional criteria and showed the applicability of MBDoE in order to estimate model parameters from a simulated fedbatch study (33). In addition, drawbacks of the single criteria are discussed and a novel multiobjective approach is investigated. This implies that MBDoE strongly depends on the chosen information criteria. This must be transparent in order to ensure systematic and sound decisions. Table I shows some applications of MBDoE and a summary of novel approaches to design criteria.
However, information is strongly coupled with the identifiability analysis of modelling workflows (see chapter 2.1.1) (44,47,48,49). As described there, available data are necessary in order to estimate identifiable parameters. MBDoE is the modelbased method solving this issue. Several publications show the application of MBDoE in order to reduce the experimental effort with the goal of verifying process models. An issue for MBDoE is the handling with uncertainties based on model and experimental deviations (50). One possibility is the realtime adaption of the experimental design, which is called continuous modelbased experimental design (CMBDoE) (39,40) or online optimal experimental redesign (41,42). This is finally a control issue and strongly related to process monitoring (see chapter 2.2) and optimization (see chapter 2.4).
Process Monitoring
Process monitoring is the description of the actual state of the process system in order to detect deflections of CPPs or key process parameters in time. With regard to the definition of PAT, monitoring without a feedback for process control is only measurement (51). Process monitoring can be seen in the context of measurement, monitoring, modeling and control (M^{3}C) (52). After describing the first tasks of monitoring and the realtime data collection, model based methods for the subsequent data processing are presented, followed by the description of implemented examples in the field of biotechnology, which are also collected in Table II.
Measurements are a central part of monitoring as they provide the time resolved raw information of the ongoing process. Measurement methodologies and devices should be simple, robust and as accurate as necessary. Besides wellestablished measurements such as pH, dissolved oxygen and gas analysis, a vast amount of process analyzers is available nowadays; however the development of measurement techniques is still a field for extensive research in Biotechnology (53,54). These include  but are not limited to  chemical /biological measurements, which are characterized by a high sensitivity and by physical sensors mainly represented by spectroscopic technologies (UV/VIS, IR; dielectric, RAMANspectroscopy) (55,56,57,58). In order to include process analyzers into monitoring it is not important whether measurements are performed inline, online, atline or offline, but it is important that the data are available in time to detect deflections and to perform control actions.
After data collection, the measured raw information needs to be converted into the desired monitoring outputs. This conversion is to be performed in realtime and includes data preprocessing e.g. outlier detection, data conversion and state and parameter estimation. For these purposes, mathematical models and modelbased methods can be used. Hereby measurements provide realtime data of the ongoing process, whereas the deployed model contains prior knowledge, technical and biological relationships and boundaries of the system (16). This combination of measurements and mathematical models is referred to as softsensor (software sensor).
In Fig. 3 the working principle of a software sensor is shown: The process states are described by x and the monitoring outputs by y. In addition to measurements, the designed inputs (u) are included as time dependent variables. The softwareimplemented models and estimation algorithms can hereby be of any format and structure. As a result the softsensor provides an estimate (\( \widehat{x} \)) of the current state.
Critical to the implementation of models in monitoring is the prediction and estimation ability of the model. Apart from the determination of reliable and significant model parameters (see chapter 2.1) the observability is important. An observability analysis can assess the structure of models in order to test whether the information contained in a set of measurements is sufficient for estimating model states (59). A simple approach is the numerical determination of initial values with a subset of known state trajectories, which fails in the unobservable and succeeds in the observable case. This can also be used to define the needed measurement accuracy and frequency in order to fulfil the monitoring goal. To guarantee observability the methodology can also be used to define suitable measurement combinations for specific model implementations, which has exemplarily been shown by our group for P. pastoris and P. chrysogenum processes (58).
Once the measurement scenario is defined, it needs to be interlinked with the model. Therefore, several algorithms are available, which can be summarized as observers or filters (60). The goal of the observer is to reconstruct current states of interest by realtime collected information and the given process model. Although the appropriate observer type is strongly dependent on the monitoring goal and the process model, the underlying principle is always similar. An additional model and state error ϵ(t) is added to the model representation of the previous chapter 2.1 eq. [3]). In a second relation, the socalled monitoring scenario, the monitoring outputs y with error v(t) are represented as a function of x (eq. [4]). Under the condition of observability, which means that the provided information in y is enough to reconstruct x, the current states can be estimated. Additionally, the measurement errors as well as process noise are considered as weightings (61,62).
Using this approach, multiple measurements can be combined or unmeasured states can be reconstructed. Additionally, this methodology can be used to provide a realtime estimate based on infrequent or very noisy measurements, which can exemplarily be seen in (63). Hereby Goffaux and Wouwer (2005) implemented different observer algorithms in a cell culture process and changed measurement noise and model uncertainty. In order to cope with nonlinearities and the complexity of biological systems suitable filtering algorithms need to be implemented, such as extended and unscented Kalman and particle filters (62). Kalman filters are especially suitable when the model is wellsuited and only measurement and process noise occur. Particle filters allow a certain degree of model uncertainty and nonGaussian noise distributions. In Table II examples of different monitoring implementations in biotechnology can be found.
Simple examples of successful model based monitoring are based on mass balancing (64,65,73). Thus elemental in and out fluxes of the reactor are measured. Considering the law of the conservation of mass, conversion rates can be determined. By applying multiple material balances, system redundancy can hereby increase the robustness of the methodology.
Kinetic models, which are more detailed and enable the description of cell internal behavior, are also well suited as softsensors. The limiting factor is often the system observability of complex kinetic models. Therefore, these models have to be simplified according to the monitoring goal. Aehle et al., for example, showed that offgasmeasurement in combination with a simple model can be used to increase the reproducibility and robustness of a mammalian cell culture process (66,74).
Recent implementations by Krämer et al. and Golabgir et al. have extended the monitoring scenario by spectroscopic NIR and RAMAN measurements in order to obtain system observability of more complex models (58,70). For this purpose, the spectral data were transformed by partial least square regression (PLS) into product and substrate concentrations, which were then used as observer input. Other approaches deal with the incorporation of delayed offline measurements for real time monitoring (75,76,77). The additional information can help to bring the observer on the right track until the next measurement is available.
In order to provide reliable and robust monitoring as a basis for control, the inclusion of all available process information and knowledge is needed. With this regard the presented model based methods enable i) the determination of needed measurements to guarantee system observability ii) the inclusion of process knowledge in form of a model iii) possible system redundancy with multiple measurements iv) the evaluation of process and measurement noise, which finally leads to v) most probable estimates of the current state of interest.
Process Optimization
Industrial processes aim to find process inputs (also denoted as design vector) to achieve the process goal (e.g. produce a certain product with defined specifications) and simultaneously an optimal process performance with respect to criteria like maximal profit. Additionally, those inputs have to respect physiological and technical constraints as well as product and system rationales. Optimal means getting to the best achievable results with respect to specified (might counteracting) objectives and conditions. If a reliable process model exists, it can be used to determine the optimal process inputs. In addition, the process should ideally be controlled to achieve an optimal process performance. Table III summarizes a selection of examples for modelbased optimization and control from literature. In the following, typical optimization goals, variables and optimization spaces according to literature are described. Afterwards, an overview on methods and software of how to perform optimizations is presented. Finally, following a description of aspects of model based optimal control, typical challenges are presented.
Mathematically, optimization problems are typically interpreted as minimization problems of an objective function. In general, three types of optimization objectives typically arising in different stages of the process lifecycle can be distinguished. These are optimizing (i) information content, (ii) productivity and (iii) robustness and reproducibility: (i) Especially but not only during process development optimization algorithms are used to find the parameters of a process model by minimizing the model deviation from the given data (see chapter 2.1.1) or to maximize the information content of planned experiments (see chapter 2.1.2) to obtain adequate process models. (ii) When having a reliable process model, the optimization of the productivity of the process is typically aimed at, e.g. to achieve highest amounts of biomass or product at the end of the process (78,79,80). (iii) Finally, robustness and reproducibility of an optimized process are typical goals. In this case the objective is usually a minimal deviation from identified (optimal) set points during the whole process. Examples are dissolved oxygen or pH, but also variables like metabolite concentration (81), growth rate or a process variable related to it like the oxygen consumption rate (74). In these cases a dynamic model is needed (see chapter 2.1.1).
A fact to be considered during model development is that only inputs that are included in the process model can be optimized (see chapter 2.1.1). For bioprocesses those are usually feedrates or initial values. The optimization space is frequently constrained, as shown in Fig. 4: on the one hand, physiological and technical constraints like maximal volume, feed rates or culture time (78,79) have to be considered  on the other hand, the optimization space has to be restricted to an area where the model can be trusted, a region the exact location of which is typically hard to define (see chapter 2.1.1). Because product quality is the priority aim of pharmaceutical production processes, the design space is limited by certain product rationales (e.g. pH and temperature area) too. In addition to that, reducing the size of the optimization space also can speed up the computation time which is needed for timesensitive optimization tasks. The optimization space is strongly dependent on the process lifecycle. New models, monitoring methods, control strategies, regulatory requirements and changed costs can lead to an expansion of the optimization space and therefore to new optimal design vectors.
There are various methods to solve optimization problems. In some cases the optimization problem can be solved analytically, which means a solution function (for example in integral form) can be obtained. However, frequently (nonlinear) numerical algorithms have to be applied. Various optimization algorithms exist, detailed descriptions can be found in textbooks like (85) or the review of (86). For bioprocesses, frequent implementations of the NelderMead simplex algorithm (fminsearch and its derivates) (87) or differential evolution (88) in MATLAB are used (74,78,83). Another powerful method for largescale nonlinear optimization is the software package IPOPT (89) e.g. used by (79) for optimizing biohydrogen production. More applied algorithms are listed in Table III. When choosing the optimization algorithm, one has to ponder aspects like the number of variables to be optimized, the complexity of the model, the implementation environment or the acceptable duration of the optimization. The last point is of major importance when performing optimizations during the process. In case the optimal design vector is timedependent it might has to be parametrized. This is frequently done by discretizing the input signal via partially constant, linear or parabolic functions (also termed as zero, first or second order hold). Simulations are a valuable tool to investigate configuration details e.g. how to parameterize the design vector. This can also help to ensure a fast computation (80).
When the optimal values of the process inputs are found, various possibilities for controlling the process to achieve the desired optimal performance exist: a simple method is to determine the optimal design vector once and control the process on those predefined set points. This approach is state of the art in most production processes.
However, this control method possibly fails when process deviations occur due to model uncertainties or unknown or neglected process disturbances which are not considered previously. The reason is that this strategy does not consider the real values of the process outputs (the controlled variables) during manipulating the inputs (the manipulated variables). This can lead to unwanted process behavior: (80) computed optimal profiles for three feeds (ammonium, phosphate, glucose) based on a mechanistic model. They studied the effect of model uncertainties by varying the model parameters and applying those feed profiles determined with the initial parameters. The results revealed a high dependency of end product (the optimization goal) on the model parameters: in 60% of the simulations less product than in the original case was achieved. They concluded that this can be avoided by applying closedloop control. In this case the manipulated variables are adjusted based on the values of the controlled variables. Besides classic closedloop controllers like PID controllers, a wellknown and powerful representative method is model predictive control (MPC) (80,81,82,83,4,85): a dynamic model is used to find the optimal inputs with respect to a defined objective function as described above. However, instead of performing the computation only once in the beginning, the optimization is repeated after a defined control horizon to react towards process deviations. Therefore, the optimization problem has to be solved in realtime, which demands robust and fast optimization algorithms. In order to be able to discover process deviations information about the current process state is needed. Depending on the measurement environment monitoring strategies as described in chapter 2.2 have to be applied.
Dynamic optimization of bioprocesses is linked with several challenges. E.g., in case of multiple objectives it is difficult to choose an optimal solution: typically, there can be counteracting objectives in such that one objective can only be improved by worsening the other, which implies a tradeoff is needed. This set of solutions is known as Pareto front. More theory on this topic can e.g. be found in the textbook by (90). Another aspect is robustness towards process deviations and model uncertainties. One way to deal with this is presented by (91), who investigated robust multiobjective optimal control in case of model uncertainties by interpreting robustness as additional objective. Another typically occurring phenomenon is, that the optimal design vector lies at the boundaries of the optimization space. One the one hand, this can be critical if the optimization space is not defined properly, for example due to limited knowledge about the validity space of the model. On the other hand this implies that the process might be optimized by increasing the optimization space e.g. by deriving more knowledge to increase the model validity space and improve the model or by technical innovations.
Summing up, optimization tasks occur during different stages of the process lifecycle, with the highly diverse goals of maximal information content, productivity and robustness and reproducibility, respectively. Methods for optimization and control are limited by the quality and the inputs of the model. In addition to that, closed loop optimal control is also limited by issues like process noise or uncertainties of the model and the system. Therefore a suitable monitoring strategy has to be established and suitable observers have to be applied. In addition to that, if optimization has to be performed online and probably unsupervised, fast and trustworthy algorithms are demanded. However, in those cases, where this is fulfilled, MPC is a valuable tool to achieve optimal processes.
Data Mining for Detection of Disturbance Variables
Although sophisticated control strategies are applied to modern processes (achieved using the above described methods with respect to determination, monitoring and optimization of CPPs), fluctuations in process performance inevitably occur. For that reason, continuous process improvement is necessary, which can be achieved by data mining techniques in order to detect disturbance variables.
Generally, every bioprocess includes known but neglected or tolerated disturbances, such as the control ranges of process parameters like pH, dissolved oxygen, feeding profiles etc. On the other side, there are unknown disturbances that might undermine process robustness and that should be identified in later stages of the process development or during process improvement. In the following, we want to focus on the upstream of biopharmaceutical processes as this is the major source of disturbances. According to the exemplification of the bioreactor as a disperse multiphasesystem, these unknown disturbances can be grouped in the following classes as follows:

1)
Biomass as disturbance variable, either due the genotype (e.g. repression or induction of certain genes) or phenotype (e.g. morphological changes)

2)
The composition of or single substances in the fluid phases as disturbance variable (e.g. raw material variability, metabolites, process additives)

3)
Physical and local characteristics such as inhomogeneities as disturbance variable (e.g. improper dispersal of base/ acid or feeds, inhomogeneities in dissolved oxygen etc.)
The detection of disturbance variables aims at enhancing the understanding of process fluctuations, thereby increasing process robustness or process performance and can finally even lead to improvement of control strategies (see chapters 1 and 2.3). The ability of process intervention according to knowledge gained via an analysis of disturbance variables is strongly coupled to the optimization and especially to the innovation space. This means that a possible intervention is limited by the biological system itself, e.g. physiological parameters like maximal specific uptake rates, but also by external factors such as technical feasibility or logistical and organizational factors, e.g. time line for upstream to downstream processing, shift work etc. One the one hand, the development or implementation of new analytical methods or probes for the characterization of the system and its disturbances can lead to an extension of the innovation space of the investigated bioprocess and thereby enhance process control strategies. On the other hand, technical or organizational constraints can restrict process intervention – within the borders of the innovation space  although a disturbance was successfully detected (Fig. 4).
Generally, the detection of important disturbance variables follows a datadriven knowledge discovery approach, mainly focusing on data mining methods (Fig. 5), i.e. statistical methods to extract information from large data sets. Risk assessment tools are commonly used for process development (2) and can also facilitate the identification of possible disturbance classes (see definition above) within the design space of the process. A prominent example of these tools is the Ishikawa (or fishbone) diagram, which illustrates that this form of process improvement is done at later stages of the process development as some prior knowledge about the process is necessary (i.e. QbD approach). According to the outcome of the risk assessment, data has to be generated or compiled. Every modern biotechnology production plant is equipped with systems that record and archive continuous and intermittent data of every process. These historical data can be used for data mining and the identification of disturbance variables  even including known but neglected disturbances. Examples of the assessment of historical data are given in (96,97,98). (99), for instance, used a threestep approach previously introduced by (100,101) in order to optimize an E.coli process for green fluorescent protein production.
Often, historical data do not represent the probable disturbance class well enough, which is why additional data are needed. These data are commonly generated via analytical measurements of specific components (e.g. HPLC, IC or ICP analysis), for instance of the raw material for media production. Examples of this approach are given by (102) and by our group (103), who focused on the detailed characterization of complex raw material. As this approach is very laborious and analytically challenging fingerprinting methods such as near infrared (NIR), mid infrared (MIR) or (2D)fluorescence spectroscopy can be applied to complex matrices. These methods generate an overall but still specific description of the composition of a complex material or media (e.g. a spectra) without the identification of certain substances, i.e. a fingerprint of the material. Spectroscopic fingerprinting methods were applied by (104,105,106,107,108) in order to determine the variability and disturbances of applied raw material.
Before data mining techniques can be applied, it should be noted that the characteristics of bioprocess data is its heterogeneity with respect to time scale. As already mentioned in chapter 2.2, bioprocess data can be continuous measurements, intermittent measurements or even onetime measurements at the beginning or the end of the process, such as raw material attributes or process titer, respectively. Hence, before data analysis can be started, preprocessing techniques, feature selection or even dimensionality reduction has to be performed. Examples of these techniques applied for historical datasets are described in (96), such as filter and wrapper methods or principle component analysis (PCA) for dimensionality reduction. If additional analytical data are generated at one point of time, e.g. measurements of specific components or fingerprinting data of the used raw material, other preprocessing methods have to be applied. For fingerprinting spectra, first, second or third order derivatives are commonly used in order to reduce noise from the spectral data. Additionally, data can be meancentered or normalized, depending on the statistical method that is used for further analysis (109,110,111,112,113). In the following step the actual data mining starts, which can be categorized in descriptive or predictive approaches (96) (Table IV).
In the descriptive approach methods for discriminant analysis are applied in order to identify patterns or clusters in the dataset. Common methods are PCA, e.g. applied by (102,103) and cluster analysis (98). For the predictive approach methods are applied that allow correlation analysis, i.e. the preprocessed data or selected features are correlated with process outcomes (i.e. CQAs and productivity) in order to identify possible relationships. Typical methods are multiple linear regression (MLR), partial least squares (PLS) regression and artificial neural networks (ANN). There are also modifications of these methods available that overcome certain drawbacks of the original method as well as relatively new methods such as support vector machines (SVM).
Jose et al. analyzed two raw materials via two fingerprinting techniques (105). In order to combine the spectra of these two materials PCA models for both raw materials were generated and the scores of these models were used for the generation of an interval partial least squares (iPLS) regression model which allowed a correlation between raw material quality and product yield and titer. iPLS is a graphical extension of regular PLS models. It divides spectral data into equidistant subintervals of which validated calibration models are developed. Hence, this method allows to depict relevant information in different spectral subdivisions and is able to remove interferences from other regions (114). Another method proposed by Gao et al. for the identification of raw material and process performance is the orthogonal partial least squares – discriminant analysis (OPLSDA) (104). This method equals partial least squares – discriminant analysis (PLSDA) which is a combination of canonical correlation analysis and linear discriminant analysis Thus, providing descriptive as well as predictive information (115,116). The integration of an orthogonal signal correction (OSC)filter, which should allow the separation between predictive and nonpredictive variation, should improve the interpretation of the model (117,118). Nevertheless, the superiority of OPLSDA over PLSDA is critically discussed among experts. Balabin et al. introduced an extension of ANN, namely support vector machines (SVM), for spectroscopic calibration and as data mining technique (119). It has the advantage of providing global models that are often unique, which is a benefit compared to normal ANN.
Descriptive as well as predictive methods result in the generation of hypotheses about disturbances, crucial parameters or interactions. These hypotheses have to be evaluated or experimentally verified by experts (e.g. via experimental design as mentioned in chapter 2.1.2) before they can be implemented in the control strategy. At this stage the control loop (Fig. 1) can be restarted by the integration of gained knowledge in the model or even by the introduction of new CPPs or kPPs. This approach can additionally result in the improvement of product quality and productivity.
In general there are three major challenges in process improvement via detection of disturbance variables: The identification of an adequate analytical method for indepth investigation of disturbance variables, such as cell morphology, raw material or scaleup effects (e.g. inhomogeneties, biomass segregation), is demanding, especially with increasing complexity of the process. The knowledge about method errors and general deviations during the process is necessary in order to allow adequate conclusions from data mining. Additionally, the choice of the appropriate statistical method that is applied to the data compilation is crucial to achieving meaningful patterns, clusters and correlations and has also an impact on the interpretability of the results.
Summing up, for continuous process improvement, the evaluation of both historical data as well as the generation of new data with respect to probable disturbance variables is necessary. Data mining of these huge datasets allows the generation of hypotheses which can be verified by experiments. Gained knowledge can further on be implemented in existing models in order to improve process robustness and performance (Fig. 2).
Conclusions
During the biopharmaceutical process lifecycle, countless challenges arise: uncontrollable external conditions, fluctuations in raw material, inaccuracies in process control and continuous innovations  and they all affect the process performance over time. The trend of the last few years has clearly pointed towards a model approach in order to ensure knowledge transfer during the entire process lifecycle and, additionally, during different processes. Modelbased methods allow the applicability of the stored knowledge. In the presented review the applicability of modelbased methods in order to ensure control has been shown. To reach the goal of control four challenges were investigated: I) generation of process knowledge, II) process monitoring, III) process optimization and IV) continuous improvement of the process (Fig. 1).
The first challenge includes the identification of CPPs and kPPs, hence, the generation of process knowledge. If relations and interactions within the process are understood, the main challenge is the setup and the verification of process models in order to predict a target value (CPP, kPP or CQA). This is a critical step because the model quality has an impact on accuracy, precision, applicability and the validity area of all modelbased methods. Main issues in the field of modelling are a lack of experts and tools for the model setup in biopharmaceutical production processes. In addition, processmodels should be extended or adapted during the whole process lifecycle. Therefore, modelling is a typical bottleneck for the application of modelbased methods in industrial processes. In order to overcome this problem, we presented modelling workflows for the setup of models. Additionally, methods for the generation of information during experiments by modelbased experimental design are presented.
The second challenge is an adequate process monitoring. The combination of realtime measurements and modelbased methods like observers allow an optimal usage of monitoring capacities. Modelbased methods are already widespread and accepted in the area of process monitoring since they allow the estimation of hard or not measureable parameters and variables, which are necessary for subsequent control tasks. The bottleneck of monitoring methods is mainly the transferability between different processes and scales concerning measurement methods and software environment. During the process lifecycle new realtime measurement sensors, changing process models and new control tasks should be considered in the process monitoring concept.
The third challenge is process optimization and process control. First of all, a proper definition of the optimization objective is needed. Especially in case of multiple objectives an adequate weighting of the different goals is not easy but important. The second task is to find an optimal design vector for the process. Modelbased methods are valuable tools to declare the optimum. Nevertheless, multidimensional optimization tasks are generally hard to implement as well as computationally demanding. Furthermore, successful optimization highly depends on the model quality as well as knowledge about the validity space of the model.
The fourth challenge is the continuous improvement of the process based on additional research and historical data assessment. Therefore, datamining tools are widespread and accepted as modelbased methods in order to generate hypotheses, which can be experimentally evaluated and furthermore gained knowledge can be included in the process model. Bottleneck of these datamining tools are mainly the availability of adequate measurement methods for the generation of additional data and the interpretability of descriptive as well as predictive modelbased methods.
Irrespective of the availability of modelbased methods, a certain acceptance of these methods in the biotechnological community has to be generated. Hence, the benefits of the application of modelbased methods on process development and production have to be demonstrated. Additionally, the training of the users is of great importance as well as the presentation of all methods in more userfriendly tools. In combination with continuous support and further development of the process model, modelbased methods are powerful tools to ensure the overall goal of biopharmaceutical processes, i.e. the guarantee of high product quality.
Abbreviations
 ANN:

Artificial neural networks
 CHO:

Chinese hamster ovary
 CMA:

Critical material attributes
 CMBDoE:

Continuous modelbased experimental design
 CPP:

Critical process parameters
 CQA:

Critical quality attributes
 DoE:

Design of experiments
 E.coli:

Escherichia coli
 HPLC:

High performance liquid chromatography
 IC:

Ion chromatography
 ICH:

International Conference on Harmonization
 ICP:

Induced coupled plasma
 iPLS:

Interval partial least squares
 IR:

Infrared
 kPP:

Key process parameters
 M^{3}C:

Measurement, monitoring, modeling and control
 MBDoE:

Modelbased design of experiments
 MIR:

Midinfrared
 MLR:

Multiple linear regression
 MPC:

Model predictive control
 NIR:

Nearinfrared
 NRMSE:

Normalized root mean square error
 OPLSDA:

Orthogonal partial least squaresdiscriminate analysis
 OSC:

Orthogonal signal correction
 PAT:

Process analytical technology
 PCA:

Principle component analysis
 PLS:

Partial least squares
 PLSDA:

Partial least squaresdiscriminate analysis
 QbD:

Quality by design
 QTPP:

Quality target product profile
 SQP:

Sequential quadratic programming
 SSE:

Sum of square errors
 SVM:

Supported vector machine
References
Guideline IHT. Development and manufacture of drug substances (chemical entities and biotechnological/biological entities) Q11. London: European medicines agency; 2011.
Guideline IHT. Pharmaceutical development Q8 (R2). 2009.
Guideline IHT. Specifications: test procedures and acceptance criteria for biotechnological/biological products Q6B. 1999.
FDA. Guidance for Industry PATA framework for innovative pharmaceutical development, Manufacturing, and Quality Assurance. wwwfdagov. 2004.
Rathore AS, Winkle H. Quality by design for biopharmaceuticals. Nat Biotech. 2009;27(1):26–34.
Guideline IHT. Q12: technical and regulatory considerations for pharmaceutical product lifecycle management endorsed by the ich steering committee on 9 September 2014. 2014;1.
Ragab MAF, Arisha A. Knowledge management and measurement: a critical review. J Knowl Manag. 2013;17(6):873–901.
Studer R, Benjamins VR, Fensel D. Knowledge engineering: principles and methods. Data Knowl Eng. 1998;25(1):161–97.
Herwig C, GarciaAponte OF, Golabgir A, Rathore AS. Knowledge management in the QbD paradigm: manufacturing of biotech therapeutics. Trend. Biotechnol. 2015;33(7):381–7.
Herold S, Heine T, King R. An automated approach to build process models by detecting biological phenomena in (fed)batch experiments. IFAC P Vol. 2010;43(6):138–43.
Jakeman AJ, Letcher RA, Norton JP. Ten iterative steps in development and evaluation of environmental models. Environ Model Softw. 2006;21(5):602–14.
Refsgaard JC, Henriksen HJ. Modelling guidelines––terminology and guiding principles. Adv Wat Resour. 2004;27(1):71–82.
Waveren H, Groot S, Scholten H, Geer FCV, Wösten JHM, Koeze RD, et al. Good modelling practice Handbook. 2000.
Weinstein MC, O'Brien B, Hornberger J, Jackson J, Johannesson M, McCabe C, et al. Principles of good practice for decision analytic modeling in healthcare evaluation: report of the ISPOR task force on good research practices—modeling studies. Value Health. 2003;6(1):9–17.
DonosoBravo A, Mailier J, Martin C, Rodríguez J, AcevesLara CA, Wouwer AV. Model selection, identification and validation in anaerobic digestion: a review. Water Res. 2011;45(17):5347–64.
Mandenius CF, Gustavsson R. Minireview: soft sensors as means for PAT in the manufacture of biotherapeutics. J Chem Technol Biotech. 2015;90(2):215–27.
Almquist J, Cvijovic M, Hatzimanikatis V, Nielsen J, Jirstrand M. Kinetic models in industrial biotechnology – improving cell factory performance. Metab Eng. 2014;24:38–60.
Neymann T, Helbing L, Engell S. Computerimplemented method for creating a fermentation model. United States Patents. 2016.
Hebing L, Neymann T, Thüte T, Jockwer A, Engell S. Efficient generation of models of fedbatch fermentations for process design and control. IFACPapersOnline. 2016;49(7):621–6.
Leifheit J, King R. Systematic structure and parameter identification for biological reaction systems supported by a softwaretool. IFAC P Vol. 2005;38(1):1095–100.
Herold S, King R. Automatic identification of structured process models based on biological phenomena detected in (fed)batch experiments. Bioprocess Biosyst Eng. 2014;37(7):1289–304.
Kroll P, Hofer A, Stelzer IV, Herwig C. Workflow to set up substantial targetoriented mechanistic process models in bioprocess engineering. Process Biochem. 2017;
Chis OT, Banga JR, BalsaCanto E. Structural identifiability of systems biology models: a critical comparison of methods. PLoS One. 2011;6(11):e27755.
Raue A, Kreutz C, Maiwald T, Bachmann J, Schilling M, Klingmüller U, et al. Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood. Bioinformat. 2009;25(15):1923–9.
Meeker WQ, Escobar LA. Teaching about Approximate Confidence Regions Based on Maximum Likelihood Estimation. American Statist. 1995;49(1):48–53.
Wechselberger P, Seifert A, Herwig CPAT. method to gather bioprocess parameters in realtime using simple input variables and first principle relationships. Chem Eng Sci. 2010;65(21):5734–46.
Lemaire C, Schoefs O, Lamy E, Pauss A, Mottelet S. Modeling of an aerobic bioprocess based on gas exchange and dynamics: a novel approach. Bioprocess Biosyst Eng. 2014;37(9):1809–16.
King JMP, TitchenerHooker NJ, Zhou Y. Ranking bioprocess variables using global sensitivity analysis: a case study in centrifugation. Bioprocess Biosyst Eng. 2007;30(2):123–34.
Mandenius CF, Brundin A. Bioprocess optimization using designofexperiments methodology. Biotechnol Prog. 2008;24(6):1191–203.
Galvanin F, Barolo M, Bezzo F. A framework for modelbased design of experiments in the presence of continuous measurement systems. IFAC P Vol. 2010;43(5):571–6.
Zullo LC. Computer aided design of experiments: an engineering approach: Imperial College London (University of London). 1991.
Franceschini G, Macchietto S. Modelbased design of experiments for parameter precision: State of the art. Chem Eng Sci. 2008;63(19):4846–72.
Telen D, Logist F, Van Derlinden E, Tack I, Van Impe J. Optimal experiment design for dynamic bioprocesses: a multiobjective approach. Chem Eng Sci. 2012;78:82–97.
Wechselberger P, Sagmeister P, Herwig C. Modelbased analysis on the extractability of information from data in dynamic fedbatch experiments. Biotechnol Prog. 2013;29(1):285–96.
Schwaab M, Luiz Monteiro J, Carlos Pinto J. Sequential experimental design for model discrimination: Taking into account the posterior covariance matrix of differences between model predictions. Chem Eng Sci. 2008;63(9):2408–19.
Schwaab M, Silva FM, Queipo CA, Barreto AG Jr, Nele M, Pinto JCA. new approach for sequential experimental design for model discrimination. Chem Eng Sci. 2006;61(17):5791–806.
Schaber SD, Born SC, Jensen KF, Barton PI. Design, execution, and analysis of timevarying experiments for model discrimination and parameter estimation in microreactors. Org Process Res Dev. 2014;18(11):1461–7.
Hoang MD, Barz T, Merchan VA, Biegler LT, ArellanoGarcia H. Simultaneous solution approach to modelbased experimental design. AICHE J. 2013;59(11):4169–83.
Barz T, López Cárdenas DC, ArellanoGarcia H, Wozny G. Experimental evaluation of an approach to online redesign of experiments for parameter determination. AICHE J. 2013;59(6):1981–95.
Galvanin F, Boschiero A, Barolo M, Bezzo F. Modelbased design of experiments in the presence of continuous measurement systems. Ind Eng Chem Res. 2011;50(4):2167–75.
Cruz Bournazou MN, Barz T, Nickel DB, Lopez Cárdenas DC, Glauche F, Knepper A, et al. Online optimal experimental redesign in robotic parallel fedbatch cultivation facilities. Biotechnol Bioeng. 2016:n/an/a.
Neddermeyer F, Marhold V, Menzel C, Krämer D, King R. Modelling the production of soluble hydrogenase in Ralstonia eutropha by online optimal experimental design. IFACPapersOnline. 2016;49(7):627–32.
Brik Ternbach M, Bollman C, Wandrey C, Takors R. Application of model discriminating experimental design for modeling and development of a fermentative fedbatch Lvaline production process. Biotechnol Bioeng. 2005;91(3):356–68.
Maheshwari V, Rangaiah GP, Samavedham L. Multiobjective framework for modelbased design of experiments to improve parameter precision and minimize parameter correlation. Ind Eng Chem Res. 2013;52(24):8289–304.
Galvanin F, Cao E, AlRifai N, Gavriilidis A, Dua V, editors. Modelbased design of experiments for the identification of kinetic models in microreactor platforms. 12th international symposium on process systems engineering and 25th European symposium on computer aided process engineering. Elsevier; 2015.
Franceschini G, Macchietto S. Novel anticorrelation criteria for modelbased experiment design: Theory and formulations. AICHE J. 2008;54(4):1009–24.
Banga JR, BalsaCanto E. Parameter estimation and optimal experimental design. Essays Biochem. 2008;45:195–210.
López CDC, Barz T, Körkel S, Wozny G. Nonlinear illposed problem analysis in modelbased parameter estimation and experimental design. Comput Chem Eng. 2015;77:24–42.
López CDC, Barz T, Peñuela M, Villegas A, Ochoa S, Wozny G. Modelbased identifiable parameter determination applied to a simultaneous saccharification and fermentation process model for bioethanol production. Biotechnol Prog. 2013;29(4):1064–82.
Barz T, ArellanoGarcia H, Wozny G. Handling Uncertainty in ModelBased Optimal Experimental Design. Ind Eng Chem Res. 2010;49(12):5702–13.
Glassey J, Gernaey KV, Clemens C, Schulz TW, Oliveira R, Striedner G, et al. Process analytical technology (PAT) for biopharmaceuticals. Biotechnol J. 2011;6(4):369–77.
Mandenius CF. Recent developments in the monitoring, modeling and control of biological production systems. Bioprocess Biosyst Eng. 2004;26(6):347–51.
Vojinović V, Cabral JMS, Fonseca LP. Realtime bioprocess monitoring: part I: In situ sensors. Sensors Actuators B Chem. 2006;114(2):1083–91.
Schügerl K. Progress in monitoring, modeling and control of bioprocesses during the last 20 years. J Biotechnol. 2001;85(2):149–73.
AbuAbsi NR, Kenty BM, Cuellar ME, Borys MC, Sakhamuri S, Strachan DJ, et al. Real time monitoring of multiple parameters in mammalian cell culture bioreactors using an inline Raman spectroscopy probe. Biotechnol Bioeng. 2011;108(5):1215–21.
Roychoudhury P, Harvey LM, McNeil B. The potential of mid infrared spectroscopy (MIRS) for real time bioprocess monitoring. Anal Chim Acta. 2006;571(2):159–66.
Striedner G, Bayer K. An advanced monitoring platform for rational design of recombinant processes. In: Mandenius CF, TitchenerHooker NJ, editors. Measurement, monitoring, modelling and control of bioprocesses. Berlin: Springer Berlin Heidelberg; 2013. p. 65–84.
Golabgir A, Herwig C. Combining mechanistic modeling and raman spectroscopy for realtime monitoring of fedbatch penicillin production. Chem Ing Tech. 2016;88(6):764–76.
Nakhaeinejad M, Bryant MD. Observability analysis for modelbased fault detection and sensor selection in induction motors. Meas Sci Technol. 2011;22(7):075202.
Mohd Ali J, Ha Hoang N, Hussain MA, Dochain D. Review and classification of recent observers applied in chemical process systems. Comput Chem Eng. 2015;76:27–41.
Dochain D. State and parameter estimation in chemical and biochemical processes: a tutorial. J Process Contr. 2003;13(8):801–18.
Simon D. Optimal state estimation: Kalman, H infinity, and nonlinear approaches. New York: Wiley; 2006.
Goffaux G, Vande Wouwer A. Bioprocess state estimation: some classical and less classical approaches. In: Meurer T, Graichen K, Gilles ED, editors. Control and observer design for nonlinear finite and infinite dimensional systems. Berlin: Springer Berlin Heidelberg; 2005. p. 111–28.
Mou DG, Cooney CL. Growth monitoring and control through computeraided online mass balancing in a fedbatch penicillin fermentation. Biotechnol Bioeng. 1983;25(1):225–55.
Wechselberger P, Sagmeister P, Herwig C. Realtime estimation of biomass and specific growth rate in physiologically variable recombinant fedbatch processes. Bioprocess Biosyst Eng. 2013;36(9):1205–18.
Aehle M, Kuprijanov A, Schaepe S, Simutis R, Lubbert A. Simplified offgas analyses in animal cell cultures for process monitoring and control purposes. Biotechnol Lett. 2011;33(11):2103–10.
Frahm B, Blank HC, Cornand P, OelÃŸner W, Guth U, Lane P, et al. Determination of dissolved CO2 concentration and CO2 production rate of mammalian cell suspension culture based on offgas measurement. J Biotechnol. 2002;99(2):133–48.
Bonarius HPJ, de Gooijer CD, Tramper J, Schmid G. Determination of the respiration quotient in mammalian cell culture in bicarbonate buffered media. Biotechnol Bioeng. 1995;45(6):524–35.
Albiol J, Robusté J, Casas C, Poch M. Biomass estimation in plant cell cultures using an extended Kalman filter. Biotechnol Prog. 1993;9(2):174–8.
Krämer D, King R. Online monitoring of substrates and biomass using nearinfrared spectroscopy and modelbased state estimation for enzyme production by S. cerevisiae. IFACPapersOnLine. 2016;49(7):609–14.
Gudi RD, Shah SL, Gray MR. Adaptive multirate state and parameter estimation strategies with application to a bioreactor. AICHE J. 1995;41(11):2451–64.
Biener R, Steinkämper A, Hofmann J. Calorimetric control for high cell density cultivation of a recombinant Escherichia coli strain. J Biotechnol. 2010;146(1–2):45–53.
Jobé AM, Herwig C, Surzyn M, Walker B, Marison I, von Stockar U. Generally applicable fedbatch culture concept based on the detection of metabolic state by online balancing. Biotechnol Bioeng. 2003;82(6):627–39.
Aehle M, Kuprijanov A, Schaepe S, Simutis R, Lubbert A. Increasing batchtobatch reproducibility of CHO cultures by robust openloop control. Cytotechnology. 2011;63(1):41–7.
Gopalakrishnan A, Kaisare NS, Narasimhan S. Incorporating delayed and infrequent measurements in Extended Kalman Filter based nonlinear state estimation. J Process Contr. 2011;21(1):119–29.
Guo Y, Huang B. State estimation incorporating infrequent, delayed and integral measurements. Automatica. 2015;58:32–8.
Soons ZITA, Shi J, van der Pol LA, van Straten G, van Boxtel AJB. Biomass growth and kLa estimation using online and offline measurements. IFAC P Vol. 2007;40(4):85–90.
Amribt Z, Niu H, Bogaerts P. Macroscopic modelling of overflow metabolism and model based optimization of hybridoma cell fedbatch cultures. Biochem Eng J. 2013;70:196–209.
del RioChanona EA, Zhang D, Vassiliadis VS. Modelbased realtime optimisation of a fedbatch cyanobacterial hydrogen production process using economic model predictive control strategy. Chem Eng Sci. 2016;142:289–98.
Kawohl M, Heine T, King R. Model based estimation and optimal control of fedbatch fermentation processes for the production of antibiotics. Chem Eng Process Process Intensif. 2007;46(11):1223–41.
Craven S, Whelan J, Glennon B. Glucose concentration control of a fedbatch mammalian cell bioprocess using a nonlinear model predictive controller. J Process Contr. 2014;24(4):344–57.
Mandenius CF, TitchenerHooker NJ. Measurement, monitoring, modelling and control of bioprocesses. Berlin: Springer; 2013.
Craven S, Shirsat N, Whelan J, Glennon B. Process model comparison and transferability across bioreactor scales and modes of operation for a mammalian cell bioprocess. Biotechnol Prog. 2013;29(1):186–96.
Dewasme L, Amribt Z, Santos LO, Hantson AL, Bogaerts P, Wouwer AV. Hybridoma cell culture optimization using nonlinear model predictive control. IFAC P Vol. 2013;46(31):60–5.
Nocedal J, Wright SJ. Numerical optimization 2nd. New York: Springer; 2006.
Biegler LT. An overview of simultaneous strategies for dynamic optimization. Chem Eng Process Process Intensif. 2007;46(11):1043–53.
Lagarias JC, Reeds JA, Wright MH, Wright PE. Convergence properties of the neldermead simplex method in low dimensions. SIAM J Optimiz. 1998;9(1):112–47.
Das S, Suganthan PN. Differential evolution: a survey of the stateoftheart. IEEE T Evolut Comput. 2011;15(1):4–31.
Wächter A, Biegler LT. On the implementation of an interiorpoint filter linesearch algorithm for largescale nonlinear programming. Math Program. 2006;106(1):25–57.
Miettinen K. Nonlinear multiobjective optimization. New York: Springer Science & Business. Media. 2012;
Logist F, Houska B, Diehl M, Van Impe JF. Robust multiobjective optimal control of uncertain (bio)chemical processes. Chem Eng Sci. 2011;66(20):4670–82.
FrancoLara E, Link H, WeusterBotz D. Evaluation of artificial neural networks for modelling and optimization of medium composition with a genetic algorithm. Process Biochem. 2006;41(10):2200–6.
Jacobson D, Gershwin S, Lele M. Computation of optimal singular controls. IEEE Trans Autom Control. 1970;15(1):67–73.
Menawat A, Mutharasan R, Coughanowr DR. Singular optimal control strategy for a fedbatch bioreactor: Numerical approach. AICHE J. 1987;33(5):776–83.
Lee J, Ramirez WF. Optimal fedbatch control of induced foreign protein production by recombinant bacteria. AICHE J. 1994;40(5):899–907.
Charaniya S, WS H, Karypis G. Mining bioprocess data: opportunities and challenges. Trend Biotechnol. 2008;26(12):690–9.
Kamimura RT, Bicciato S, Shimizu H, Alford J, Stephanopoulos G. Mining of biological data I: identifying discriminating features via mean hypothesis testing. Metab Eng. 2000;2(3):218–27.
Kamimura RT, Bicciato S, Shimizu H, Alford J, Stephanopoulos G. Mining of biological data II: assessing data structure and class homogeneity by cluster analysis. Metab Eng. 2000;2(3):228–38.
Coleman M, Block D, editors. Retrospective timedependent optimization of recombinant E. coli fermentations using historical data and hybrid neural network models. Abstr Pap Am Chem S; 2003: Amer Chemical Soc 1155 16th St, Nw, Washington, DC 20036 USA.
Subramanian V, Buck KKS, Block DE. Use of decision tree analysis for determination of critical enological and viticultural processing parameters in historical databases. Am J Enol Viticult. 2001;52(3):175–84.
Vlassides S, Ferrier JG, Block DE. Using historical data for bioprocess optimization: Modeling wine characteristics using artificial neural networks and archived process information. Biotechnol Bioeng. 2001;73(1):55–68.
Xiao X, Hou YY, Liu Y, Liu YJ, Zhao HZ, Dong LY, et al. Classification and analysis of corn steep liquor by UPLC/QTOF MS and HPLC. Talanta. 2013;107:344–8.
Hofer A, Herwig C. Quantitative determination of nine watersoluble vitamins in the complex matrix of corn steep liquor for raw material quality assessment. J Chem Technol Biotechnol. 2017;92(8):2106–13.
Gao Y, Yuan YJ. Comprehensive quality evaluation of corn steep liquor in 2ketolgulonic acid fermentation. J Agr Food Chem. 2011;59(18):9845–53.
Jose GE, Folque F, Menezes JC, Werz S, Strauss U, Hakemeyer C. Predicting mab product yields from cultivation media components, using nearinfrared and 2Dfluorescence spectroscopies. Biotechnol Prog. 2011;27(5):1339–46.
Kirdar AO, Chen GX, Weidner J, Rathore AS. Application of nearinfrared (NIR) spectroscopy for screening of raw materials used in the cell culture medium for the production of a recombinant therapeutic protein. Biotechnol Prog. 2010;26(2):527–31.
Li B, Ryan PW, Ray BH, Leister KJ, Sirimuthu NMS, Ryder AG. Rapid characterization and quality control of complex cell culture media solutions using raman spectroscopy and chemometrics. Biotechnol Bioeng. 2010;107(2):290–301.
Xiao X, Hou YY, Du J, Liu Y, Liu YJ, Dong LY, et al. Determination of main categories of components in corn steep liquor by nearinfrared spectroscopy and partial leastsquares regression. J Agr Food Chem. 2012;60(32):7830–5.
Afseth NK, Segtnan VH, Wold JP. Raman spectra of biological samples: a study of preprocessing methods. Appl Spectrosc. 2006;60(12):1358–67.
Rinnan A, van den Berg F, Engelsen SB. Review of the most common preprocessing techniques for nearinfrared spectra. TracTrend Anal Chem. 2009;28(10):1201–22.
Roggo Y, Chalus P, Maurer L, LemaMartinez C, Edmond A, Jent N. A review of near infrared spectroscopy and chemometrics in pharmaceutical technologies. J Pharmaceut Biomed. 2007;44(3):683–700.
Xu L, Zhou YP, Tang LJ, HL W, Jiang JH, Shen GL, et al. Ensemble preprocessing of nearinfrared (NIR) spectra for multivariate calibration. Anal Chim Acta. 2008;616(2):138–43.
Kroll P, Sagmeister P, Reichelt W, Neutsch L, Klein T, Herwig C. Ex situ online monitoring: application, challenges and opportunities for biopharmaceuticals processes. Pharm Bioprocessing. 2014;2(3):285–300.
Norgaard L, Saudland A, Wagner J, Nielsen JP, Munck L, Engelsen SB. Interval partial leastsquares regression (iPLS): a comparative chemometric study with an example from nearinfrared spectroscopy. Appl Spectrosc. 2000;54(3):413–9.
Barker M, Rayens W. Partial least squares for discrimination. J Chemom. 2003;17(3):166–73.
Brereton RG, Lloyd GR. Partial least squares discriminant analysis: taking the magic away. J Chemom. 2014;28(4):213–25.
Stenlund H, Gorzsas A, Persson P, Sundberg B, Trygg J. Orthogonal projections to latent structures discriminant analysis modeling on in situ FTIR spectral imaging of liver tissue for identifying sources of variability. Anal Chem. 2008;80(18):6898–906.
Trygg J, Wold S. Orthogonal projections to latent structures (OPLS). J Chemom. 2002;16(3):119–28.
Balabin RM, Lomakina EI. Support vector machine regression (SVR/LSSVM)an alternative to neural networks (ANN) for analytical chemistry? Comparison of nonlinear methods on near infrared (NIR) spectroscopy data. Analyst. 2011;136(8):1703–12.
Wold S, Esbensen K, Geladi P. Principal component analysis. Chemometr Intell Lab. 1987;2(1–3):37–52.
Guebel DV, Canovas M, Torres NV. Analysis of the escherichia coli response to glycerol pulse in continuous, highcell density culture using a multivariate approach. Biotechnol Bioeng. 2009;102(3):910–22.
Lugli E, Roederer M, Cossarizza A. Data analysis in flow cytometry: the future just started. Cytometry Part A. 2010;77a(7):705–13.
Huang J, Kaul G, Cai C, Chatlapalli R, HernandezAbad P, Ghosh K, et al. Quality by design case study: an integrated multivariate approach to drug product and process development. Int J Pharm. 2009;382(1):23–32.
Eros D, Keri G, Kovesdi I, SzantaiKis C, Meszaros G, Orfi L. Comparison of predictive ability of water solubility QSPR models generated by MLR, PLS and ANN methods. Mini Rev Med Chem. 2004;4(2):167–77.
Geladi P, Kowalski BR. Partial leastsquares regression: a tutorial. Anal Chim Acta. 1986;185:1–17.
Wold, Herman. "Partial least squares." Encyclopedia of statistical sciences (1985).
Næs T, Isaksson T, Fearn T, Davies T. A user friendly guide to multivariate calibration and classification. Chichester: NIR publications; 2002.
Landgrebe D, Haake C, Hopfner T, Beutel S, Hitzmann B, Scheper T, et al. Online infrared spectroscopy for bioprocess monitoring. Appl Microbiol Biotechnol. 2010;88(1):11–22.
Sivakesava S, Irudayaraj J, Demirci A. Monitoring a bioprocess for ethanol production using FTMIR and FTRaman spectroscopy. J Ind Microbiol Biot. 2001;26(4):185–90.
Hamburg JH, Booth DE, Weinroth GJ. A neural network approach to the detection of nuclear material losses. J Chem Inf Comp Sci. 1996;36(3):544–53.
Acknowledgments and Disclosures
The authors would like to thank Jens Fricke for his support through instructive discussions and with the graphs and Katharina Oberhuber for the English proof reading. Financial support was provided by the Austrian research funding association (FFG) under the scope of the COMET program within the research project “Industrial Methods for Process Analytical Chemistry  From Measurement Technologies to Information Systems (imPACts)” (contract # 843546) and the Christian Doppler Forschungsgesellschaft (grant number 171).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Kroll, P., Hofer, A., Ulonska, S. et al. ModelBased Methods in the Biopharmaceutical Process Lifecycle. Pharm Res 34, 2596–2613 (2017). https://doi.org/10.1007/s110950172308y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s110950172308y
Key words
 bioprocess
 data mining
 modelling
 monitoring
 optimization