A Linear-Time Streaming Algorithm for Cardinality-Constrained Maximizing Monotone Non-submodular Set Functions

  • Conference paper
  • First Online:
Combinatorial Optimization and Applications (COCOA 2021)

Abstract

Nowadays, massive amounts of data are growing at a rapid rate every moment. If data can be processed and analyzed promptly as they arrive, they can bring huge added values to the society. In this paper, we consider the problem of maximizing a monotone non-submodular function subject to a cardinality constraint under the streaming setting and present a linear-time single-pass deterministic algorithm for this problem. We analyze the algorithm using the parameter of the generic submodularity ratio \(\gamma \) to achieve an approximation ratio of \(\left[ \frac{\gamma ^4}{c(1+\gamma +\gamma ^2+\gamma ^3)}-\varepsilon \right] \) for any \(\varepsilon \ge 0\) with the query complexity \(\lceil n/c \rceil +c\), and the memory complexity is \(O(ck\log (k)\log (1/\varepsilon ))\), where c is a positive integer. When \(\gamma =1\), the algorithm achieves the same ratio for the submodular version of the problem with the matching query complexity and memory complexity.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now
Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 93.08
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 117.69
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Badanidiyuru, A., Mirzasoleiman, B., Karbasi, A., Krause, A.: Streaming submodular maximization: massive data summarization on the fly. In: 20th International Proceedings on SIGKDD, pp. 671–680. ACM, New York, USA (2014)

    Google Scholar 

  2. Bian, A.A., Buhmann, J.M., Krause, A., Tschiatschek, S.: Guarantees for greedy maximization of non-submodular functions with applications. In: 34th International Proceedings on ICML, pp. 498–507. PMLR, Sydney, NSW, Australia (2017)

    Google Scholar 

  3. Buchbinder, N., Feldman, M., Schwartz, R.: Online submodular maximization with preemption. ACM Trans. Algorithms 15(3), 1–31 (2019)

    Article  MathSciNet  Google Scholar 

  4. Caldarola, E.G., Rinaldi, A.M.: Big data: a survey. In: 4th International Proceedings on DATA, pp. 362–370. SciTePress, Colmar, Alsace, France (2015)

    Google Scholar 

  5. Chakrabarti, A., Kale, S.: Submodular maximization meets streaming: matchings, matroids, and more. Math. Program. 154, 225–247 (2015)

    Article  MathSciNet  Google Scholar 

  6. Conforti, M., Cornuéjols, G.: Submodular set-functions, matroids and the greedy algorithm - tight worst-case bounds and some generalizations of the rado-edmonds theorem. Discrete Appl. Math. 7(3), 251–274 (1984)

    Article  MathSciNet  Google Scholar 

  7. Cui, M., Xu, D., Guo, L., Wu, D.: Approximation guarantees for parallelized maximization of monotone non-submodular function with a cardinality constraint. In: Zhang, Z., Li, W., Du, D.-Z. (eds.) AAIM 2020. LNCS, vol. 12290, pp. 195–203. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-57602-8_18

    Chapter  Google Scholar 

  8. Das, A., Kempe, D.: Submodular meets spectral: greedy algorithms for subset selection, sparse approximation and dictionary selection. In: 28th International Proceedings of ICML, pp. 1057–1064. Omnipress, Bellevue, Washington, USA (2011)

    Google Scholar 

  9. Elenberg, E. R., Dimakis, A. G., Feldman, M., Karbasi, A.: Streaming weak submodularity: interpreting neural networks on the fly. In: 31st International Proceedings on NIPS, pp. 4044–4054. Long Beach, CA, USA (2017)

    Google Scholar 

  10. Fahrbach, M., Mirrokn, V., Zadimoghaddam, M.: Submodular maximization with nearly optimal approximation, adaptivity and query complexity. In: 30th International Proceedings on SODA, pp. 255–273. SIAM, San Diego, CA, USA (2019)

    Google Scholar 

  11. Feldman, M., Norouzi-Fard, A., Svensson, O., Zenklusen, R.: The one-way communication complexity of submodular maximization with applications to streaming and robustness. In: 52nd International Proceedings on STOC, pp. 1363–1374. ACM, Chicago, IL, USA (2020)

    Google Scholar 

  12. Gong, S., Nong, Q., Liu, W., Fang, Q.: Parametric monotone function maximization with matroid constraints. J. Glob. Optim. 75(3), 833–849 (2019). https://doi.org/10.1007/s10898-019-00800-2

    Article  MathSciNet  MATH  Google Scholar 

  13. Kazemi, E., Mitrovic, M., Zadimoghaddam, M., Lattanzi, S., Karbasi, A.: Submodular streaming in all its glory: tight approximation, minimum memory and low adaptive complexity. In: 36th International Proceedings of ICML, pp. 3311–3320. PMLR, Long Beach, California, USA (2019)

    Google Scholar 

  14. Kempe, D., Kleinberg, J., Tardos, E.: Maximizing the spread of influence through a social network. Theor. Comput. 11(1), 105–147 (2015)

    Article  MathSciNet  Google Scholar 

  15. Kuhnle, A.: Quick streaming algorithms for maximization of monotone submodular functions in linear time. In: 24th International Proceedings on AISTATS, pp. 13–15. PMLR, Virtual Event (2021)

    Google Scholar 

  16. Kuhnle, A., Smith, J., Crawford, V.G., Thai, M.T.: Fast maximization of non-submodular, monotonic functions on the integer lattice. In: 35th International Proceedings of ICML, pp. 2786–2795. PMLR, Stockholm, Sweden (2018)

    Google Scholar 

  17. Lakkaraju, H., Bach, S.H., Leskovec, J.: Interpretable decision sets: a joint framework for description and prediction. In: 22nd International Proceedings of SIGKDD, pp. 1675–1684. ACM, San Francisco, CA, USA (2016)

    Google Scholar 

  18. Larcker, D.F., Watts, E.M.: Where’s the greenium? J. Account. Econ. 69(2), 101312 (2020)

    Article  Google Scholar 

  19. Levin, R., Wajc, D.: Streaming submodular matching meets the primal-dual method. In: 32nd International Proceedings on SODA, pp. 1914–1933. SIAM, Virtual Conference (2021)

    Google Scholar 

  20. Li, M., Zhou, X., Tan, J., Wang, W.: Non-submodular streaming maximization with minimum memory and low adaptive complexity. In: Zhang, Z., Li, W., Du, D.-Z. (eds.) AAIM 2020. LNCS, vol. 12290, pp. 214–224. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-57602-8_20

    Chapter  Google Scholar 

  21. Lin, H., Bilmes, J. A.: A class of submodular functions for document summarization. In: 49th International Proceedings on ACL, pp. 510–520. The Association for Computer Linguistics, Portland, Oregon, USA (2011)

    Google Scholar 

  22. Lin, Y., Chen, W., Lui, J.C.: Boosting information spread: an algorithmic approach. In: 33rd International Proceedings on ICDE, pp. 883–894. IEEE Computer Society, San Diego, CA, USA (2017)

    Google Scholar 

  23. Liu, B., Hu, M.: Fast algorithms for maximizing monotone nonsubmodular functions. In: Zhang, Z., Li, W., Du, D.-Z. (eds.) AAIM 2020. LNCS, vol. 12290, pp. 204–213. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-57602-8_19

    Chapter  Google Scholar 

  24. McGregor, A.: Graph stream algorithms: a survey. In: 31st International Proceedings of ICML, pp. 9–20. JMLR.org, Bei**g, China (2014)

    Google Scholar 

  25. Mirzasoleiman, B., Karbasi, A., Badanidiyuru, A., Krause, A.: Distributed submodular cover: succinctly summarizing massive data. In: 29th International Proceedings on NIPS, pp. 2881–2889. Montreal, Quebec, Canada (2015)

    Google Scholar 

  26. Mirzasoleiman, B., Karbasi, A., Sarkar, R., Krause, A.: Distributed submodular maximization: identifying representative elements in massive data. In: 27th International Proceedings on NIPS, pp. 2049–2057. Lake Tahoe, Nevada, USA (2013)

    Google Scholar 

  27. Mossel, E., Roch, S.: On the submodularity of influence in social networks. In: 39th International Proceedings on STOC, pp. 128–134. ACM, San Diego, California, USA (2007)

    Google Scholar 

  28. Muthukrishnan, S.: Data streams: algorithms and applications. Theoret. Comput. Sci. 1(2), 117–236 (2005)

    MathSciNet  MATH  Google Scholar 

  29. Nong, Q., Sun, T., Gong, S., Fang, Q., Du, D., Shao, X.: Maximize a monotone function with a generic submodularity ratio. In: Du, D.-Z., Li, L., Sun, X., Zhang, J. (eds.) AAIM 2019. LNCS, vol. 11640, pp. 249–260. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-27195-4_23

    Chapter  Google Scholar 

  30. Norouzi-Fard, A., Tarnawski, J., Mitrovic, S., Zandieh, A., Mousavifar, A., Svensson, O.: Beyond 1/2-Approximation for submodular maximization on massive data streams. In: 35th International Proceedings of ICML, pp. 3826–3835. PMLR, Stockholm, Sweden (2018)

    Google Scholar 

  31. Ribeiro, M. T., Singh, S., Guestrin, C.: “Why should I trust you?”: explaining the predictions of any classifier. In: 22nd International Proceedings of SIGKDD, pp. 1135–1144. ACM, San Francisco, CA, USA (2016)

    Google Scholar 

  32. Sviridenko, M., Vondrák, J., Ward, J.: Optimal approximation for submodular and supermodular optimization with bounded curvature. In: 26th International Proceedings on SODA, pp. 1134–1148. SIAM, San Diego, CA, USA (2015)

    Google Scholar 

  33. Wang, Y., Xu, D., Wang, Y., Zhang, D.: Non-submodular maximization on massive data streams. J. Glob. Optim. 76(4), 729–743 (2019). https://doi.org/10.1007/s10898-019-00840-8

    Article  MathSciNet  MATH  Google Scholar 

  34. Wei, K., Libbrecht, M.W., Bilmes, J.A., Noble, W.S.: Choosing panels of genomics assays using submodular optimization. Genom. Biol. 17(1), 229 (2016)

    Article  Google Scholar 

Download references

Acknowledgements

The first author is supported by Bei**g Natural Science Foundation Project No. Z200002 and National Natural Science Foundation of China (No. 12131003). The second author is supported by the Natural Sciences and Engineering Research Council of Canada (NSERC) grant 06446, and Natural Science Foundation of China (Nos. 11771386, 11728104). The third author is supported by National Natural Science Foundation of China (No. 11201333). The fourth author is supported by the Fundamental Research Funds for the Central Universities (No. E1E40108X2) and National Natural Science Foundation of China (No. 12101587).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ling Gai .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Cui, M., Du, D., Gai, L., Yang, R. (2021). A Linear-Time Streaming Algorithm for Cardinality-Constrained Maximizing Monotone Non-submodular Set Functions. In: Du, DZ., Du, D., Wu, C., Xu, D. (eds) Combinatorial Optimization and Applications. COCOA 2021. Lecture Notes in Computer Science(), vol 13135. Springer, Cham. https://doi.org/10.1007/978-3-030-92681-6_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-92681-6_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-92680-9

  • Online ISBN: 978-3-030-92681-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation