Multi-walk Parallel Pattern Search Approach on a GPU Computing Platform

  • Weihang Zhu
  • James Curry
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5544)


This paper studies the efficiency of using Pattern Search (PS) on bound constrained optimization functions on a Graphics Processing Unit (GPU) computing platform. Pattern Search is a direct search optimization technique that does not require derivative information on non-linear programming problems. Pattern Search is ideally suited to a GPU computing environment due to its low memory requirement and no communication between threads in a multi-walk setting. To adapt to a GPU environment, traditional Pattern Search is modified by terminating based on iterations instead of tolerance. This research designed and implemented a multi-walk Pattern Search algorithm on a GPU computing platform. Computational results are promising with a computing speedup of 100+ compared to a corresponding implementation on a single CPU.


Nonlinear Optimization Pattern Search GPU CUDA 


  1. 1.
    Audet, C., Dennis Jr., J.E.: Analysis of Generalized Pattern Searches. SIAM Journal of Optimization 13, 889–903 (2003)zbMATHCrossRefMathSciNetGoogle Scholar
  2. 2.
    Hough, P.D., Kolda, T.G., Torczon, V.J.: Asynchronous Parallel Pattern Search for Nonlinear Optimization, SAND2000-8213, Sandia Lab Reports (January 2000)Google Scholar
  3. 3.
    Kolda, T.G.: Revisiting Asynchronous Parallel Pattern Search for Nonlinear Optimization. SIAM Journal of Optimization 16, 563–586 (2005)zbMATHCrossRefMathSciNetGoogle Scholar
  4. 4.
    Lewis, R.M., Torczon, V.J.: Why Pattern Search Works, NASA/CR-1998-208966, ICASE Report No. 98-57 (1998)Google Scholar
  5. 5.
    Lewis, R.M., Torczon, V.J., Trosset, M.W.: Direct Search Methods: Then and Now. Journal of Computational and Applied Mathematics 124(1-2), 191–207 (2000)zbMATHCrossRefMathSciNetGoogle Scholar
  6. 6.
    Li, J., Wan, D., Chi, Z., Hu, X.: A Parallel Particle Swarm Optimization Algorithm based on Fine-grained Model with GPU-Accelerating. Journal of Harbin Institute of Technology 38, 2162–2166 (2006)Google Scholar
  7. 7.
    nVidia: CUDA Programming Guide V 2.0 (2008),
  8. 8.
    Nguyen, H. (ed.): GPU Gems 3. Addison-Wesley, New York (2007)Google Scholar
  9. 9.
    Torczon, V.J.: On the Convergence of Pattern Search Algorithms. SIAM Journal of Optimization 7, 1–25 (1997)zbMATHCrossRefMathSciNetGoogle Scholar
  10. 10.
    Yao, X., Liu, Y., Lin, G.: Evolutionary Programming Made Faster. IEEE Transactions on Evolutionary Computation 3, 82–102 (1999)CrossRefGoogle Scholar
  11. 11.
    Zhu, W., Curry, J., Marquez, A.: SIMD Tabu Search with Graphics Hardware Acceleration on the Quadratic Assignment Problem. Accepted by the International Journal of Production Research (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Weihang Zhu
    • 1
  • James Curry
    • 1
  1. 1.Department of Industrial EngineeirngLamar UniversityBeaumontUSA

Personalised recommendations