Abstract
We study the problems of maximizing a monotone non-submodular function subject to two types of constraints, either an independent system constraint or a p-matroid constraint. These problems often occur in the context of combinatorial optimization, operations research, economics and especially, machine learning and data science. Using the generalized curvature \(\alpha \) and the submodularity ratio \(\gamma \) or the diminishing returns ratio \(\xi \), we analyze the performances of the widely used greedy algorithm, which yields theoretical approximation guarantees of \(\frac{1}{\alpha }[1-(1-\frac{\alpha \gamma }{K})^k]\) and \(\frac{\xi }{p + \alpha \xi }\) for the two types of constraints, respectively, where k, K are, respectively, the minimum and maximum cardinalities of a maximal independent set in the independent system, and p is the minimum number of matroids such that the independent system can be expressed as the intersection of p matroids. When the constraint is a cardinality one, our result maintains the same approximation ratio as that in Bian et al. (Proceedings of the 34th international conference on machine learning, pp 498–507, 2017); however, the proof is much simpler owning to the new definition of the greedy curvature. In the case of a single matroid constraint, our result is competitive compared with the existing ones in Chen et al. (Proceedings of the 35th international conference on machine learning, pp 804–813, 2018) and Gatmiry and Rodriguez (Non-submodular function maximization subject to a matroid constraint, with applications, 2018. arXiv:1811.07863v4). In addition, we bound the generalized curvature, the submodularity ratio and the diminishing returns ratio for several important real-world applications. Computational experiments are also provided supporting our analyses.
Similar content being viewed by others
Notes
In this paper, we do not consider the intercept term in model. In the experiment, one can add bias term into the regression model by augmenting the observation matrix with a column of ones.
References
Bian, A.A., Buhmann, J.M., Krause, A., Tschiatschek, S.: Guarantees for greedy maximization of non-submodular functions with applications. In: Proceedings of the 34th International Conference on Machine Learning, pp. 498–507 (2017)
Conforti, M., Cornuéjols, G.: Submodular functions, matroids and the greedy algorithm: tight worst-case bounds and some generalizations of the Rado-Edmonds theorem. Discrete Appl. Math. 7(3), 251–274 (1984)
Calinescu, G., Chekuri, C., Pál, M., Vondrák, J.: Maximizing a submodular set function subject to a matroid constraint (extended abstract). In: Proceedings of the 12th Conference on Integer Programming and Combinatorial Optimization, vol. 4513, pp. 182–196 (2007)
Calinescu, G., Chekuri, C., Pál, M., Vondrák, J.: Maximizing a monotone submodular function subject to a matroid constraint. SIAM J. Comput. 40(6), 1740–1766 (2011)
Chen, L., Feldman, M., Karbasi, A.: Weakly submodular maximization beyond cardinality constraints: does randomization help greedy? In: Proceedings of the 35th International Conference on Machine Learning, pp. 804–813 (2018)
Das, A., Kempe, D.: Submodular meets spectral: greedy algorithms for subset selection, sparse approximation and dictionary selection. In: Proceedings of the 28th International Conference on Machine Learning, pp. 1057–1064 (2011)
Du, D.Z., Ko, K.I., Hu, X.D.: Design and Analysis of Approximation Algorithms. Springer, New York (2012)
Elenberg, E.R., Khanna, R., Dimakis, A.G., Negahban, S.: Restricted strong convexity implies weak submodularity. Ann. Stat. 46(6B), 3539–3568 (2016)
Feldman, M., Harshaw, C., Karbasi, A.: Greed is good: near-optimal submodular maximization via greedy optimization. In: Proceedings of the 30th Conference on Learning Theory, vol. 65, pp. 758–784 (2017)
Filmus, Y., Ward, J.: Monotone submodular maximization over a matroid via non-oblivious local search. SIAM J. Comput. 43(2), 514–542 (2013)
Fisher, M.L., Nemhauser, G.L., Wolsey, L.A.: An analysis of approximations for maximizing submodular set functions-II. Math. Program. Study 8, 73–87 (1978)
Gatmiry, K., Rodriguez, M.G.: Non-submodular function maximization subject to a matroid constraint, with applications (2018). arXiv:1811.07863v4
Gupta, A., Roth, A., Schoenebeck, G., Talwar, K.: Constrained non-monotone submodular maximization: offline and secretary algorithms. In: Proceedings of the 6th International Workshop on Internet and Network Economics, vol. 6484, pp. 246–257 (2010)
Hwang, S.-G.: Cauchy’s interlace theorem for eigenvalues of Hermitian matrices. Am. Math. Mon. 111(2), 157–159 (2004)
Korte, B., Hausmann, D.: An analysis of the greedy heuristic for independence systems. Ann. Discrete Math. 2(421), 65–74 (1978)
Kulesza, A., Taskar, B.: Determinantal point processes for machine learning. Found. Trends® Mach. Learn. 5(2–3), 123–286 (2012)
Lee, J., Mirrokni, V.S., Nagarajan, V., Sviridenko, M.: Maximizing non-monotone submodular functions under matroid or knapsack constraints. SIAM J. Discrete Math. 23(4), 2053–2078 (2010)
Lee, J., Mirrokni, V.S., Nagarajan, V., Sviridenko, M.: Non-monotone submodular maximization under matroid and knapsack constraints. In: Proceedings of the 41st ACM-SIAM Symposium on Theory of Computing, pp. 323–332 (2009)
Nemhauser, G.L., Wolsey, L.A., Fisher, M.L.: An analysis of approximations for maximizing submodular set functions-I. Math. Program. 14(1), 265–294 (1978)
Shi, M.J., Yang, Z.S., Kim, D.Y., Wang, W.: Non-monotone submodular function maximization under \(k\)-system constraint. J. Comb. Optim. 41(1), 128–1421 (2021)
Sviridenko, M., Vondrák, J., Ward, J.: Optimal approximation for submodular and supermodular optimization with bounded curvature. In: Proceedings of the 26th ACM-SIAM Symposium on Discrete Algorithms, pp. 1134–1148 (2015)
Vondrák, J.: Optimal approximation for the submodular welfare problem in the value oracle model. In: Proceedings of the 40th ACM Symposium on Theory of Computing, pp. 67–74 (2008)
Vondrák, J.: Submodularity and curvature: the optimal algorithm. RIMS Kokyuroku Bessatsu B23, 253–266 (2009)
Wang, Y.J., Du, D.L., Jiang, Y.J., Zhang, X.Z.: Non-submodular maximization with matroid and knapsack constraints. Asia Pac. J. Oper. Res. 38(05), 2140001 (2021)
Wang, Y.J., Xu, D.C., Wang, Y.S., Zhang, D.M.: Non-submodular maximization on massive data streams. J. Glob. Optim. 76, 729–743 (2020)
Zhang, Z.N., Liu, B., Wang, Y.S., Xu, D.C., Zhang, D.M.: Greedy algorithm for maximization of non-submodular functions subject to knapsack constraint. In: Proceedings of the 26th International Computing and Combinatorics Conference, pp. 651–662 (2019)
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Gerhard J. Woeginger.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supported by the National Natural Science Foundation of China under Grant No. 11971376.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Shi, M., Yang, Z. & Wang, W. Greedy Guarantees for Non-submodular Function Maximization Under Independent System Constraint with Applications. J Optim Theory Appl 196, 516–543 (2023). https://doi.org/10.1007/s10957-022-02145-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-022-02145-5