Multi-walk Parallel Pattern Search Approach on a GPU Computing Platform

  • Weihang Zhu
  • James Curry
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5544)


This paper studies the efficiency of using Pattern Search (PS) on bound constrained optimization functions on a Graphics Processing Unit (GPU) computing platform. Pattern Search is a direct search optimization technique that does not require derivative information on non-linear programming problems. Pattern Search is ideally suited to a GPU computing environment due to its low memory requirement and no communication between threads in a multi-walk setting. To adapt to a GPU environment, traditional Pattern Search is modified by terminating based on iterations instead of tolerance. This research designed and implemented a multi-walk Pattern Search algorithm on a GPU computing platform. Computational results are promising with a computing speedup of 100+ compared to a corresponding implementation on a single CPU.


Nonlinear Optimization Pattern Search GPU CUDA 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Audet, C., Dennis Jr., J.E.: Analysis of Generalized Pattern Searches. SIAM Journal of Optimization 13, 889–903 (2003)MATHCrossRefMathSciNetGoogle Scholar
  2. 2.
    Hough, P.D., Kolda, T.G., Torczon, V.J.: Asynchronous Parallel Pattern Search for Nonlinear Optimization, SAND2000-8213, Sandia Lab Reports (January 2000)Google Scholar
  3. 3.
    Kolda, T.G.: Revisiting Asynchronous Parallel Pattern Search for Nonlinear Optimization. SIAM Journal of Optimization 16, 563–586 (2005)MATHCrossRefMathSciNetGoogle Scholar
  4. 4.
    Lewis, R.M., Torczon, V.J.: Why Pattern Search Works, NASA/CR-1998-208966, ICASE Report No. 98-57 (1998)Google Scholar
  5. 5.
    Lewis, R.M., Torczon, V.J., Trosset, M.W.: Direct Search Methods: Then and Now. Journal of Computational and Applied Mathematics 124(1-2), 191–207 (2000)MATHCrossRefMathSciNetGoogle Scholar
  6. 6.
    Li, J., Wan, D., Chi, Z., Hu, X.: A Parallel Particle Swarm Optimization Algorithm based on Fine-grained Model with GPU-Accelerating. Journal of Harbin Institute of Technology 38, 2162–2166 (2006)Google Scholar
  7. 7.
    nVidia: CUDA Programming Guide V 2.0 (2008),
  8. 8.
    Nguyen, H. (ed.): GPU Gems 3. Addison-Wesley, New York (2007)Google Scholar
  9. 9.
    Torczon, V.J.: On the Convergence of Pattern Search Algorithms. SIAM Journal of Optimization 7, 1–25 (1997)MATHCrossRefMathSciNetGoogle Scholar
  10. 10.
    Yao, X., Liu, Y., Lin, G.: Evolutionary Programming Made Faster. IEEE Transactions on Evolutionary Computation 3, 82–102 (1999)CrossRefGoogle Scholar
  11. 11.
    Zhu, W., Curry, J., Marquez, A.: SIMD Tabu Search with Graphics Hardware Acceleration on the Quadratic Assignment Problem. Accepted by the International Journal of Production Research (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Weihang Zhu
    • 1
  • James Curry
    • 1
  1. 1.Department of Industrial EngineeirngLamar UniversityBeaumontUSA

Personalised recommendations