Skip to main content
Log in

This article has been updated

Abstract

In this paper, we compute sequence covering arrays (SCAs), which are arrays, consisting of sequences, such that all subsequences with pairwise different entries of some length are covered, via a novel approach based on commutative algebra and symbolic computation. Hereby, we provide various algebraic models being capable to characterize possibly small sets of permutations collectively containing particular shorter subsequences. These models take the form of multivariate polynomial systems of equations and are then processed via supercomputing by a Gröbner Basis solver in order to compute solutions from them. If the variety is not empty, i.e. the Gröbner basis is non-trivial, then each point in the computed variety can be transformed to a SCA. In our experiments, we observed varying computational performance depending on the chosen model, while all of them exhibited scalability issues. Additionally and for comparison, we give new SAT descriptions modelling SCAs. By employing a SAT solver on our provided SAT models, we are able to provide upper bounds, one of which is best among literature results. Lastly, we adapt our SAT approach to answer a question posed by Yuster (Des Codes Cryptogr 88(3):585–593, 2020). As a result, we find a characterization of the dimensions of all perfect SCAs with coverage multiplicity two of strength three.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Change history

  • 10 April 2023

    In the original publication, there were some typesetting problems. Now, those errors have been fixed

Notes

  1. We denote the set of positive integers with \(\mathbb {N^{\times }}\).

  2. We denote finite, nonempty sequences in tuple notation, e.g. \(\left( 0,1,2\right)\), highlighting that the order of the appearing elements is of uttermost importance. We also employ this notation to encode a single permutation of pairwise different elements.

  3. Informally, for the scope of this work, isomorphic solutions could be described as those, for which the resulting array structures can be transformed into each other by operations such as permuting the order of the rows in the array or applying a relabeling on the symbols.

  4. Here we use an inclusive interpretation of disjunction.

  5. Instead of \(\mathbb {Q}\) we can work with any ring without non-trivial zero divisors.

  6. Instead of \(\mathbb {Q}\) we can take any commutative ring with unity, which has no non-trivial zero divisors.

  7. If we work with an arbitrary commutative ring with unity, we have invertible elements instead of non-zero elements.

  8. Other integral domains would also be suitable as well, e.g. \(\mathcal {R} ={\text {GF}}(4)\), where the \(\alpha _k\) then have to be mapped to all field elements by a bijection. Notice that \(\alpha _k \mapsto \sum _{j=1}^k 1_{\mathcal {R}}\) is not admissible here.

  9. Note that other models for enforcing coverage do not assume any structure to already exist in the considered matrix.

  10. More generally, we can take any commutative ring with unity instead of \(\mathbb {Q}\).

  11. Instead of \(\mathbb {Q}\) we can work with any commutative ring with unity without non-trivial zero divisors with characteristic equal to zero or at least v.

  12. or in any commutative ring with unity without non-trivial zero divisors of characteristic zero or sufficiently large.

  13. or in any commutative ring with unity without non-trivial zero divisors.

  14. or over any commutative ring with unity without non-trivial zero divisors with characteristic equal to zero or at least \(N+1\).

  15. Recall that depending on the model, different lower bounds for the characteristic of the integral domain over which the model is built have to be met.

  16. We use the exhaustive search only for experimental performance comparison, therefore we considered just one coverage model.

  17. https://github.com/BRiAl/BRiAl.

  18. https://github.com/mzinin/bpb, being a C++ implementation of the involutive algorithm based on Pommaret monomial division (for further information consult the site).

  19. http://minisat.se/MiniSat.html.

References

  1. Banbara, M., Tamura, N., Inoue, K.: Generating event-sequence test cases by answer set programming with the incidence matrix. In: Technical Communications of the 28th International Conference on Logic Programming (ICLP’12). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik (2012)

  2. Bombarda, A., Gargantini, A.: An automata-based generation method for combinatorial sequence testing of finite state machines. In: 2020 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 157–166 (2020)

  3. Brain, M., Erdem, E., Inoue, K., Oetsch, J., Puhrer, J., Tompits, H., Yilmaz, C.: Event-sequence testing using answer-set programming. Int. J. Adv. Softw. 5 (2012)

  4. Buchberger, B.: Ein algorithmus zum auffinden der basiselemente des restklassenringes nach einem nulldimensionalen polynomideal. Ph.D. Thesis, Universität Innsbruck

  5. Chee, Y.M., Colbourn, C.J., Horsley, D., Zhou, J.: Sequence covering arrays. SIAM J. Discrete Math. 27(4), 1844–1861 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  6. Colbourn, C.J.: CRC Handbook of Combinatorial Designs. Discrete Mathematics and Its Applications, CRC Press, Boca Raton (2010)

    Book  MATH  Google Scholar 

  7. Cox, D.A., Little, J., O’Shea, D.: Ideals, Varieties, and Algorithms: An Introduction to Computational Algebraic Geometry and Commutative Algebra, 3/e (Undergraduate Texts in Mathematics). Springer, Berlin (2007)

    Book  MATH  Google Scholar 

  8. Davis, M., Putnam, H.: A computing procedure for quantification theory. J. ACM 7(3), 201–215 (1960)

    Article  MathSciNet  MATH  Google Scholar 

  9. Duan, F., Lei, Y., Kacker, R.N., Richard Kuhn, D.: An approach to t-way test sequence generation with constraints. In: 2019 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 241–250 (2019)

  10. Faugére, J.-C.: A new efficient algorithm for computing Gröbner bases (f4). J. Pure Appl. Algebra 139(1), 61–88 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  11. Garn, B., Simos, D.E.: Algebraic techniques for covering arrays and related structures. In: Electronic Notes in Discrete Mathematics, vol. 70. TCDM 2018—2nd IMA Conference on Theoretical and Computational Discrete Mathematics, University of Derby, pp. 49–54 (2018)

  12. Garn, B., Simos, D.E.: Weighted t-way sequences. In: Electronic Notes in Discrete Mathematics, vol. 70. TCDM 2018—2nd IMA Conference on Theoretical and Computational Discrete Mathematics, University of Derby, pp. 43–48 (2018)

  13. Garn, B., Simos, D.E., Duan, F., Lei, Y., Bozic, J., Wotawa, F.: Weighted combinatorial sequence testing for the TLS protocol. In: 2019 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 46–51 (2019)

  14. Gianni, P.: Properties of Gröbner bases under specializations. In: EUROCAL ’87 (Leipzig, 1987), Volume 378 of Lecture Notes in Computer Science, pp. 293–297. Springer, Berlin (1989)

  15. Gunnarsson, J.: Algebraic methods for discrete event systems—a tutorial. (1996)

  16. Horn, R.A., Johnson, C.R.: Matrix Analysis, 2nd edn. Cambridge University Press, Cambridge (2012)

    Book  Google Scholar 

  17. Kampel, L., Simos, D.E., Garn, B., Kotsireas, I.S., Zhereshchin, E.: Algebraic models for arbitrary strength covering arrays over v-ary alphabets. In: Ćirić, M., Droste, M., Pin, J.É. (eds.) Algebraic Informatics, pp. 177–189. Springer, Cham (2019)

    Chapter  MATH  Google Scholar 

  18. Kalkbrener, M.: Solving systems of algebraic equations by using Gröbner bases. In: EUROCAL ’87 (Leipzig, 1987), Volume 378 of Lecture Notes in Computer Science, pp. 282–292. Springer, Berlin (1989)

  19. Kuhn, D.R., Higdon, J.M., Lawrence, J.F., Kacker, R.N., Lei, Y.: Combinatorial methods for event sequence testing. In: 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation, pp. 601–609. IEEE (2012)

  20. Kuhn, D.R., Kacker, R.N., Lei, Y.: Introduction to Combinatorial Testing. CRC Press, Boca Raton (2013)

    MATH  Google Scholar 

  21. Loehr, N.: Combinatorics. Discrete Mathematics and Its Applications, CRC Press, Boca Raton (2017)

    MATH  Google Scholar 

  22. Margalit, O.: Better bounds for event sequencing testing. In: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops, pp. 281–284 (2013)

  23. Mathon, R., Van Trung, T.: Directed t-packings and directed t-steiner systems. Des. Codes Cryptogr. 18(1), 187–198 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  24. Mayo, Q., Michaels, R., Bryce, R.: Test suite reduction by combinatorial-based coverage of event sequences. In: 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation Workshops, pp. 128–132 (2014)

  25. Mercan, H., Yilmaz, C.: Computing sequence covering arrays using unified combinatorial interaction testing. In: 2021 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 77–80 (2021)

  26. Mora, T.: Solving Polynomial Equation Systems III: Volume 3, Algebraic Solving, vol. 157. Cambridge University Press, Cambridge (2015)

    Book  MATH  Google Scholar 

  27. Murray, P.C., Colbourn, C.J.: Sequence covering arrays and linear extensions. In: Jan, K., Miller, M., Froncek, D. (eds.) Combinatorial Algorithms, pp. 274–285. Springer, Cham (2015)

    Chapter  Google Scholar 

  28. Na, J.: Perfect sequence covering arrays. Master’s Thesis

  29. Sheng, Y., Sun, C., Jiang, S., Wei, C.: Extended covering arrays for sequence coverage. Symmetry 10(5), 146 (2018)

    Article  Google Scholar 

  30. Yuan, X., Cohen, M.B., Memon, A.M.: GUI interaction testing: incorporating event context. IEEE Trans. Softw. Eng. 37(4), 559–574 (2011)

    Article  Google Scholar 

  31. Yuster, R.: Perfect sequence covering arrays. Des. Codes Cryptogr. 88(3), 585–593 (2020)

    Article  MathSciNet  MATH  Google Scholar 

  32. Zhang, H.: Combinatorial designs by sat solvers 1. In: Handbook of Satisfiability, pp. 819–858. IOS Press, Amsterdam (2021)

Download references

Acknowledgements

SBA Research (SBA-K1) is a COMET Centre within the framework of COMET—Competence Centers for Excellent Technologies Programme and funded by BMK, BMDW, and the federal state of Vienna. The COMET Programme is managed by FFG. This work was performed partly under the following financial assistance award 70NANB21H124 from U.S. Department of Commerce, National Institute of Standards and Technology.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dimitris E. Simos.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Koelbing, M., Garn, B., Iurlano, E. et al. Algebraic and SAT models for SCA generation. AAECC (2023). https://doi.org/10.1007/s00200-023-00597-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00200-023-00597-4

Keywords

Mathematics Subject Classification

Navigation