Skip to main content

Achieving geometric convergence for distributed optimization with Barzilai-Borwein step sizes

This is a preview of subscription content, access via your institution.

References

  1. Wang Y H, Lin P, Hong Y G. Distributed regression estimation with incomplete data in multi-agent networks. Sci China Inf Sci, 2018, 61: 092202

    MathSciNet  Article  Google Scholar 

  2. Yu W W, Li C J, Yu X H, et al. Economic power dispatch in smart grids: a framework for distributed optimization and consensus dynamics. Sci China Inf Sci, 2018, 61: 012204

    Article  Google Scholar 

  3. Nedić A, Ozdaglar A. Distributed subgradient methods for multi-agent optimization. IEEE Trans Automat Contr, 2009, 54: 48–61

    MathSciNet  Article  Google Scholar 

  4. Shi W, Ling Q, Wu G, et al. EXTRA: an exact first-order algorithm for decentralized consensus optimization. SIAM J Optim, 2015, 25: 944–966

    MathSciNet  Article  Google Scholar 

  5. Berahas A S, Bollapragada R, Keskar N S, et al. Balancing communication and computation in distributed optimization. IEEE Trans Automat Contr, 2019, 64: 3141–3155

    MathSciNet  Article  Google Scholar 

  6. Xu J, Zhu S, Soh Y C, et al. Augmented distributed gradient methods for multi-agent optimization under uncoordinated constant stepsizes. In: Proceedings of IEEE Conference on Decision and Control, Osaka, 2015. 2055–2060

  7. Nedić A, Olshevsky A, Shi W, et al. Geometrically convergent distributed optimization with uncoordinated step-sizes. In: Proceedings of American Control Conference, Seattle, 2017. 3950–3955

  8. Huang N, Dai Y H, Burdakov O. Stabilized Barzilai-Borwein method. J Comput Math, 2019, 37: 916–936

    MathSciNet  Article  Google Scholar 

  9. Tan C H, Ma S Q, Dai Y H, et al. Barzilai-Borwein step size for stochastic gradient descent. In: Proceedings of Annual Conference on Neural Information Processing Systems, Barcelona, 2016. 685–693

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China (Grant Nos. 11671116, 12071108, 11701137, 91630202) and Strategic Priority Research Program of CAS (Grant No. XDA27000000).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xin-Wei Liu.

Additional information

Supporting information

Appendixes A—D. The supporting information is available online at info.scichina.com and link.springer.com. The supporting materials are published as submitted, without typesetting or editing. The responsibility for scientific accuracy and content remains entirely with the authors.

Supplementary File

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Gao, J., Liu, XW., Dai, YH. et al. Achieving geometric convergence for distributed optimization with Barzilai-Borwein step sizes. Sci. China Inf. Sci. 65, 149204 (2022). https://doi.org/10.1007/s11432-020-3256-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11432-020-3256-x