A new discrete Fourier transform randomness test

Abstract

The randomness of random number generators (RNGs) is important for the reliability of cryptographic systems since the outputs of RNGs are usually utilized to construct cryptographic parameters. Statistical tests are employed to evaluate the randomness of the RNG outputs. The discrete Fourier transform (DFT) test is an important test item of the most popular statistical test suite NIST SP800-22. In the standard NIST DFT test and related improved studies, there exist accuracy and efficiency issues. First, the bit sequences generated by known good RNGs have a high probability to be rejected when the sequences are long or the sequence number is large, due to the deviation between the actual distribution of the test statistic values and the assumed normal distribution. Second, the long test time and high memory consumptions of the complex DFT test algorithm also affect its practicability. To solve these problems, we propose a new DFT test method for long sequences (106 or more bits). Different from the previous DFT test methods focusing on making the distribution of the test statistic values closer to the normal distribution, we reconstruct the statistic to follow the chi-square distribution. Our experiment result shows that our method has higher reliability in the two-level test, and could effectively reduce the test time and the memory consumptions. When applying our method on randomness test, the test efficiency has been increased to about 4 times for 106-bit sequences and 7 times for 107-bit sequences. In conclusion, our method has lower probability of making errors, and is more suitable for practical application scenarios.

This is a preview of subscription content, access via your institution.

References

  1. 1

    Sowmya S, Sathyanarayana S V. Symmetric key image encryption scheme with key sequences derived from random sequence of cyclic elliptic curve points over GF(p). In: Proceedings of International Conference on Contemporary Computing and Informatics, 2015. 1345–1350

    Google Scholar 

  2. 2

    Sulak F, Doğanaksoy A, Ege B, et al. Evaluation of randomness test results for short sequences. In: Proceedings of the 6th International Conference on Sequences and Their Applications, 2010

    Google Scholar 

  3. 3

    Hellekalek P, Wegenkittl S. Empirical evidence concerning AES. ACM Trans Model Comput Simul, 2003, 13: 322–333

    Article  Google Scholar 

  4. 4

    Yin R M, Wang J, Yuan J, et al. Weak key analysis for chaotic cipher based on randomness properties. Sci China Inf Sci, 2012, 55: 1162–1171

    MathSciNet  Article  Google Scholar 

  5. 5

    Rukhin A, Soto J, Nechvatal J, et al. SP 800–22 Rev. 1a. A statistical test suite for random and pseudorandom number generators for cryptographic applications. Appl Phys Lett, 2010, 22: 1645–179

    Google Scholar 

  6. 6

    Pareschi F, Rovatti R, Setti G. On statistical tests for randomness included in the NIST SP800-22 test suite and based on the binomial distribution. IEEE Trans Inform Forensic Secur, 2012, 7: 491–505

    Article  Google Scholar 

  7. 7

    Pareschi F, Rovatti R, Setti G. Second-level NIST randomness tests for improving test reliability. In: Proceedings of IEEE International Symposium on Circuits and Systems, 2007. 1437–1440

    Google Scholar 

  8. 8

    Hamano K, Kaneko T. Correction of overlapping template matching test included in NIST randomness test suite. IEICE Trans Fund Electron Commun Comput Sci, 2007, 90: 1788–1792

    Article  Google Scholar 

  9. 9

    Hamano K. Correction of “test for the longest run of ones in a block” included in NIST randomness test suite. IEICE Tech Rep, 2007, 107: 17–21

    Google Scholar 

  10. 10

    Chen M H, Fan L M, Gao S, et al. Corrected runs distribution test for pseudorandom number generators. Electron Lett, 2016, 52: 281–283

    Article  Google Scholar 

  11. 11

    Chen M H, Chen H, Fan L M, et al. Templates selection in non-overlapping template matching test. Electron Lett, 2016, 52: 1533–1535

    Article  Google Scholar 

  12. 12

    Sýs M, Říha Z, Matyáš V. Algorithm 970: optimizing the NIST statistical test suite and the berlekamp-massey algorithm. ACM Trans Math Softw, 2017, 43: 27

    MathSciNet  MATH  Google Scholar 

  13. 13

    Huang J L, Lai X J. Measuring random tests by conditional entropy and optimal execution order. In: Proceedings of International Conference on Trusted Systems, 2010. 148–159

    Google Scholar 

  14. 14

    Fan L M, Chen H, Gao S. A general method to evaluate the correlation of randomness tests. In: Proceedings of International Workshop on Information Security Applications, 2013. 52–62

    Google Scholar 

  15. 15

    Sulak F, Uğuz M, Koçak O, et al. On the independence of statistical randomness tests included in the NIST test suite. Turk J Electric Eng Comput Sci, 2017, 25: 3673–3683

    Article  Google Scholar 

  16. 16

    Pareschi F, Rovatti R, Setti G. Second-level testing revisited and applications to NIST SP800-22. In: Proceedings of the 18th European Conference on Circuit Theory and Design, 2007. 627–630

    Google Scholar 

  17. 17

    Zhu S Y, Ma Y, Lin J Q, et al. More powerful and reliable second-level statistical randomness tests for NIST SP 800–22. In: Proceedings of International Conference on the Theory and Application of Cryptology and Information Security, 2016

    Google Scholar 

  18. 18

    Hamano K, Satoh F, Ishikawa M. Randomness Test Using Discrete Fourier Transform. Technical Report 6841, 2003

    Google Scholar 

  19. 19

    Hamano K. The distribution of the spectrum for the discrete Fourier transform test included in SP800-22. IEICE Trans Fund Electron Commun Comput Sci, 2005, 88: 67–73

    Article  Google Scholar 

  20. 20

    Kim S J, Umeno K, Hasegawa A. Corrections of the NIST statistical test suite for randomness. 2004. https://eprint.iacr.org/2004/018.pdf

    Google Scholar 

  21. 21

    Daemen J, Rijmen V. The Design of Rijndael: AES–the Advanced Encryption Standard. Berlin: Springer, 2002

    Google Scholar 

  22. 22

    U.S. Department of Commerce. Secure Hash Standard - SHS: Federal Information Processing Standards Publication 180–4. Charlestone: CreateSpace Independent Publishing Platform, 2012

    Google Scholar 

Download references

Acknowledgements

This work was supported by National Key R&D Program of China (Grant No. 2018YFB- 0904900), National Cryptography Development Fund (Grant Nos. MMJJ20170214, MMJJ20170211).

Author information

Affiliations

Authors

Corresponding author

Correspondence to Limin Fan.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Chen, M., Chen, H., Fan, L. et al. A new discrete Fourier transform randomness test. Sci. China Inf. Sci. 62, 32107 (2019). https://doi.org/10.1007/s11432-018-9489-x

Download citation

Keywords

  • statistical randomness test
  • discrete Fourier transform test
  • NIST SP800-22
  • two-level test
  • chi-square distribution