Abstract
The computation of tight interval image enclosures of functions over bounded variable domains is in the heart of interval-based branch and bound optimization (and constraint satisfaction) solvers. Interval arithmetic extends arithmetic operators, such as \(+\), −, \(*\), \(\backslash \), \(\sin \), \(\cos \), etc., to intervals. In this way, the operators can be used directly for computing image enclosures of real functions over bounded domains (i.e., natural interval evaluations). Importantly, it is widely recognized that when a function f is monotonic w.r.t. some variable(s) in a given domain, we can compute tighter images of f on this domain than by using natural interval evaluations. This work presents a more general monotonicity-based method that may be applied even if the function is non-monotonic w.r.t. its variables. The method combines basic interval-based filtering techniques with a straightforward analysis of function derivatives. First, filtering based on partial derivatives detects sub-intervals in the domain where the function certainly increase or decrease. Then, we can determine in which subdomains within the interval the value should be maximizing (or minimizing) the function. Finally, we use the natural interval evaluation on the subdomains where f is maximized to compute an upper bound of the enclosure. We show that this method is equivalent to computing an enclosure by using the traditional method when f is monotonic. However, it may be more effective when f is not.
Similar content being viewed by others
Notes
Actually, when calculating these ranges using computers (machine interval arithmetic [15]), the results may be more conservative than the true bounds. This conservatism is a consequence of the inherent limitations of binary representation of real numbers in computers.
This can be done by using the automatic differentiation method [9], which is O(e) in the number of unary and binary operators of the function.
We also may identify, in the backward phase of HC4-revise, which inequality is responsible for discarding the region, and thus to know, straightforwardly, if the discarded region is non-decreasing or non-increasing (see Sect. 2.4).
References
Araya, I., Neveu, B., Trombettoni, G.: An interval extension based on occurrence grouping. Computing 94(2), 173–188 (2012)
Araya, I., Reyes, V.: Interval branch-and-bound algorithms for optimization and constraint satisfaction: a survey and prospects. J. Global Optim. 65(4), 837–866 (2016)
Araya, I., Trombettoni, G., Neveu, B., et al.: Exploiting monotonicity in interval constraint propagation. In: AAAI (2010)
Benhamou, F., Goualard, F., Granvilliers, L., Puget, J.F.: Revising hull and box consistency. In: Int. Conf. on Logic Programming. Citeseer (1999)
Berenguel, J.L., Casado, L.G., García, I., Hendrix, E.M., Messine, F.: On lower bounds using additively separable terms in interval b &b. In: International Conference on Computational Science and Its Applications, pp. 119–132. Springer (2012)
Bourgois, A., Jaulin, L.: Interval centred form for proving stability of non-linear discrete-time systems (2021). arXiv:2101.05412
Chabert, G., Jaulin, L.: Contractor programming. Artif. Intell. 173(11), 1079–1100 (2009)
Fernández, J., G.-Tóth, B.: Interval tools in branch-and-bound methods for global optimization. In: The Palgrave Handbook of Operations Research, pp. 237–267. Springer (2022)
Hansen, E., Walster, G.W.: Global Optimization using Interval Analysis: Revised and Expanded, vol. 264. CRC Press, Boca Raton (2003)
Jaulin, L., Kieffer, M., Didrit, O., Walter, E.: Applied Interval Analysis. Springer, Berlin (2001)
Kersten, J., Rauh, A., Aschemann, H.: Interval methods for robust gain scheduling controllers: an lmi-based approach. Granul. Comput. 5, 203–216 (2020)
Li, Y., Xu, Y.L.: Increasing accuracy in the interval analysis by the improved format of interval extension based on the first order taylor series. Mech. Syst. Signal Process. 104, 744–757 (2018)
Liberti, L.: Writing Global Optimization Software, pp. 211–262. Springer, Boston (2006)
Makino, K., Berz, M.: Verified computations using Taylor models and their applications. In: Numerical Software Verification: 10th International Workshop, NSV 2017, Heidelberg, Germany, July 22–23, 2017, Proceedings 10, pp. 3–13. Springer (2017)
Mayer, G.: Interval Analysis: And Automatic Result Verification, vol. 65. Walter de Gruyter GmbH & Co KG, Berlin (2017)
Messine, F.: Extentions of affine arithmetic: application to unconstrained global optimization. J. Univers. Comput. Sci. 8(11), 992–1015 (2002)
Moore, R.: Interval Analysis, vol. 60 (1966)
Moscato, M.M., Muñoz, C.A., Smith, A.P.: Affine arithmetic and applications to real-number proving. In: Interactive Theorem Proving: 6th International Conference, ITP 2015, Nanjing, China, August 24–27, 2015, Proceedings 6, pp. 294–309. Springer (2015)
Posypkin, M., Khamisov, O.: Automatic convexity deduction for efficient function’s range bounding. Mathematics 9(2), 134 (2021)
Stol, J., De Figueiredo, L.H.: Self-validated numerical methods and applications. In: Monograph for 21st Brazilian Mathematics Colloquium, IMPA, Rio de Janeiro. Citeseer, vol. 5. Citeseer (1997)
Tran, H.D., Cai, F., Diego, M.L., Musau, P., Johnson, T.T., Koutsoukos, X.: Safety verification of cyber-physical systems with reinforcement learning control. ACM Trans. Embed. Comput. Syst. (TECS) 18(5s), 1–22 (2019)
Trombettoni, G., Araya, I., Neveu, B., Chabert, G.: Inner regions and interval linearizations for global optimization. In: AAAI Conference on Artificial Intelligence, pp. 99–104 (2011)
Acknowledgements
Ignacio Araya is supported by Fondecyt Project 1200035. Victor Reyes is supported by Fondecyt Project 11230225.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Proofs
Proofs
Proof (Proof of Proposition 1)
Let the box \( {{\varvec{x}}}\) consisting of a non-monotonic region \( {{\varvec{w}}}\) w.r.t. \( x_i \), and a region \( {{\varvec{y}}}{\setminus } {{\varvec{w}}}\) that is non-decreasing w.r.t. \( x_i \), as illustrated in Fig. 7. The non-decreasing region can be partitioned into a collection of boxes (four boxes in the figure). The minimizers of all these boxes, except for the box to the right of \({{\varvec{w}}}\) (i.e., boxes 1, 2 and 4), reside in \(\underline{{{\varvec{y}}}_i}\). The minimizer of the remaining box (i.e., box 3) is in \(\overline{{{\varvec{w}}}_i} \subseteq {{{\varvec{w}}}}\).
Note that the same argument holds even if more than two dimensions are considered. In such cases, the non-decreasing region would be partitioned into more boxes, and regardless, one box would be to the right side of \({{\varvec{w}}}\). Hence, it can be concluded that the minimizer of the non-decreasing region is either in \(\underline{{{\varvec{y}}}_i}\) or in \(\overline{{{\varvec{w}}}_i}\), and similarly, the minimizer of the non-increasing region is either in \(\overline{{{\varvec{z}}}_i}\) or in \(\underline{{{\varvec{w}}}_i}\).
Finally, given that \({{{\varvec{x}}}}=({{\varvec{y}}}{\setminus } {{{\varvec{w}}}}) \cup {{{\varvec{w}}}} \cup ({{\varvec{z}}}{\setminus } {{{\varvec{w}}}})\), the minimizer of f inside \({{\varvec{x}}}\) must be in the non-decreasing region (i.e., in \(\underline{{{\varvec{y}}}_i}\) or in \(\overline{{{\varvec{w}}}_i}\)), or in the non-increasing region (i.e, in \(\overline{{{\varvec{z}}}_i}\) or in \(\underline{{{\varvec{w}}}_i}\)), or in the non-monotonic region (i.e., in \({{\varvec{w}}}\)). Hence, it must be in \(\underline{{{\varvec{y}}}_{i}} \cup {{{\varvec{w}}}} \cup \overline{{{\varvec{z}}}_{i}}\). \(\square \)
Proof (Proof of Proposition 2)
Consider the scenario illustrated in Fig. 8. Let the region \({{\varvec{y}}}\setminus {{\varvec{w}}}\) be a non-decreasing region w.r.t. \(x_i\). By Proposition 1, the minimum of f is found either in \(\underline{{{\varvec{y}}}_{i}}\) or in \({{{\varvec{w}}}}\). The minimum in \(\underline{{{\varvec{y}}}_{i}}\) is at the point marked in bold in Fig. 8, with value \(v_1=\min \limits _{x \in \underline{{{\varvec{y}}}_{i}}} f(x)\). Since the function f is non-decreasing in the gray region between \(\underline{{{\varvec{y}}}_{i}}\) and \({{\varvec{w}}}\) (as shown in Fig. 8), any point in the left bound of \({{\varvec{w}}}\) will have an image larger than or equal to \(v_1\).
Therefore, the image of any point x in the box \({{\varvec{w}}}\) must be greater than or equal to \(v_1 + \underline{{{\varvec{g}}}_i({{\varvec{w}}})} \cdot (x_i-\underline{w_i})\), where \(\underline{{{\varvec{g}}}_i({{\varvec{w}}})}\) is an underestimation of the minimum value of \(\frac{\partial f}{\partial x_i}\) in \({{\varvec{w}}}\). Since \(0 \in {{\varvec{g}}}_i({{\varvec{w}}})\) and \(\underline{{{\varvec{g}}}_i({{\varvec{w}}})} \le 0\), this expression is minimized when \(x_i=\overline{w_i}\), leading to the stated inequality. \(\square \)
Proof (Proof of Proposition 3)
Let \({{\varvec{x}}}\) be a box as illustrated in Fig. 9. As \({{\varvec{y}}}\) is non-decreasing w.r.t. \(x_i\), the minimizer of \({{\varvec{y}}}\) is at \(\underline{{{\varvec{y}}}_i}\). If we consider the point with image \(v_1\) as the minimizer of \({{\varvec{y}}}\), it follows that the image of the point above must be greater than \(v_1\). Consequently, the image \(v_2\) of the minimizer of the horizontal line \(\underline{{{\varvec{w}}}_j}\) must be greater than \(v_2+\underline{{{\varvec{g}}}_i({{\varvec{w}}})} \cdot \textsf {w}(\overline{w_i}-\underline{w_i})\), where \(\underline{{{\varvec{g}}}_i({{\varvec{w}}})} \le 0\) is an underestimation of the enclosure of \(\frac{\partial f}{\partial x_i}\) over the box \({{\varvec{w}}}\). Finally, the image \(v_3\) of the minimizer in \({{\varvec{w}}}\cup {{\varvec{z}}}\) must be greater than \(v_2+\underline{{{\varvec{g}}}_j({{\varvec{w}}}\cup {{\varvec{z}}})} \cdot (\overline{z_j}-\underline{w_j})\), where \(\underline{{{\varvec{g}}}_j({{\varvec{w}}}_j \cup {{\varvec{z}}}_j)}\) is an underestimation of the enclosure of \(\frac{\partial f}{\partial x_j}\) over the box \({{\varvec{w}}}\cup {{\varvec{z}}}\). Finally, as \(\overline{w_i}-\underline{w_i}=\textsf{w}({{\varvec{w}}})\) and \((\overline{z_j}-\underline{w_j})=\textsf {w}({{\varvec{w}}}\cup {{\varvec{z}}})\), we arrive at the inequality in the proposition.
Similarly, by considering the minimizer of \(\overline{{{\varvec{z}}}}\), we can prove that \(f(x) \ge \min \limits _{x \in \overline{{{\varvec{z}}}_{i}}} f(x) - \overline{{{\varvec{g}}}_i({{\varvec{w}}})}\cdot \textsf {w}({{\varvec{w}}}_i)-\max {\left( \overline{{{\varvec{g}}}_j({{\varvec{w}}}\cup {{\varvec{y}}})},0\right) }\cdot \textsf {w}({{\varvec{w}}}_j \cup {{\varvec{y}}}_j)\). \(\square \)
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Araya, I., Reyes, V. A revised monotonicity-based method for computing tight image enclosures of functions. J Glob Optim (2024). https://doi.org/10.1007/s10898-024-01405-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10898-024-01405-0