Statistical Approach for Mining Frequent Item Sets

  • Conference paper
  • First Online:
Advanced Informatics for Computing Research (ICAICR 2020)

Abstract

Current paper submits an altogether novel method to identify Frequent Itemset which applies approach of statistics further based on association rule mining which otherwise a commonly applied method in transactional database to trace high frequency itemset in data mining arena. The algorithm designs frequency distribution table, Algorithm applies the formulas of class intervals to design frequency distribution table. It calculates the frequency if item sets present in the database. It functions in two phases. Phase 1 is termed as filtering and debulking phase. Phase 2 is termed as application step alongside comparison step among class interval techniques. Threshold values are calculated within the algorithm to find frequent item sets. Threshold numeric is subjected on to the formed table showing frequency distribution and simultaneously products listed are also selected. It generates pairs by applying combination technique. Database is the alone requirement as input. Current paper therefore addresses the worth of identifying and searching frequent item sets in huge transactional database.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Han, J., Kamber, M., Pei, J.: Data Mining Concepts and Techniques. Elsevier (2011)

    Google Scholar 

  2. Goh, D.H., Ang, R.P.: An introduction to association rule mining: an application in counseling and help-seeking behavior of adolescents. Behav. Res. Meth. 39(2), 259–266 (2007). https://doi.org/10.3758/BF03193156

    Article  Google Scholar 

  3. Agrawal, R., Srikant, R.: Fast algorithms for mining association rules. In: 20th International Conference on Very Large Data Bases, VLDB, Santiago, Chile (1994)

    Google Scholar 

  4. Han, J., Pei, H., Yin, Y.: Mining frequent patterns without candidate generation. In: Management of Data, SIGMOD 2000, Dallas, TX (2000)

    Google Scholar 

  5. Al-Maqaleh, B.M., Shaab, S.K.: An efficient algorithm for mining association rules using confident frequent itemsets. In: 3rd International Conference on Advanced Computing & Communication Technologies. IEEE (2013)

    Google Scholar 

  6. Hahsler, M.: A model-based frequency constraint for mining associations from transaction data. Data Mining Knowl. Disc. 13(2), 137–166 (2006). https://doi.org/10.1007/s10618-005-0026-2

    Article  MathSciNet  Google Scholar 

  7. Karp, R.M., Shenker, S.: A simple algorithm for finding frequent elements in streams and bags. ACM Trans. Database Syst. 28(1), 51–55 (2003)

    Article  Google Scholar 

  8. Krish, A., et al.: An efficient rigorous approach for identifying statistically significant frequent item sets. ACM Trans. Database Syst. 32, 333–368 (2009)

    Google Scholar 

  9. Rathee, S., Kashyap, A.: Adaptive-miner: an efficient distributed association rule mining algorithm on Spark. J. Big Data 5(1), 1–17 (2018). https://doi.org/10.1186/s40537-018-0112-0

    Article  Google Scholar 

  10. Wang, Y., Li, H., Zhang, D., Zhang, M., Chang, E.: PFP: parallel Fp-growth for query recommendation. In: Proceedings of the 2008 ACM Conference on Recommender Systems, RecSys 2008. ACM, New York (2008)

    Google Scholar 

  11. Zhou, L., Zhong, Z., Chang, J., Li, J., Huang, J.Z., Feng, S.: Balanced parallel Fp-growth with Mapreduce. In: IEEE Youth Conference on Information, Computing and Telecommunications, Bei**g, China (2010)

    Google Scholar 

  12. Li, J., Roy, P., Khan, S.U., Wang, L., Bai, Y.: Data mining using clouds: an experimental implementation of apriori over Mapreduce. In: 12th International Conference on Scalable Computing and Communications (2012)

    Google Scholar 

  13. Al-hamodi, A.A.G., Lu, S.: MRFP: discovery frequent patterns using MapReduce frequent pattern growth. In: International Conference on Network and Information Systems for Computers. IEEE (2016)

    Google Scholar 

  14. Alon, N., Matias, Y., Szegedy, M.: The space complexity of approximating the frequency moments. In: Proceedings of the ACM Symposium on Theory of Computing, New York (1996)

    Google Scholar 

  15. Gibbons, P.B., Matias, Y.: Synopsis data structures for massive data sets. In: Proceedings of the 10th Annual ACM-SIAM Symposium on Discrete Algorithms, Baltimore, Maryland, USA (1999)

    Google Scholar 

  16. Gionis, A., Mannila, H., Mielikäinen, T., Tsaparas, P.: Assessing data mining results via swap randomization. ACM Trans. Knowl. Disc. Data 1(3), 14 (2007). https://doi.org/10.1145/1297332.1297338

    Article  Google Scholar 

  17. Bolton, R.J., Hand, D.J., Adams, N.M.: Determining hit rate in pattern search. In: Hand, D.J., Adams, N.M., Bolton, R.J. (eds.) Pattern Detection and Discovery. LNCS (LNAI), vol. 2447, pp. 36–48. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-45728-3_4

    Chapter  MATH  Google Scholar 

  18. Vreeken, J., van Leeuwen, M., Siebes, A.: KRIMP: mining itemsets that compress. Data Mining Knowl. Disc. 23(1), 169–214 (2011). https://doi.org/10.1007/s10618-010-0202-x

    Article  MathSciNet  MATH  Google Scholar 

  19. Spiegel, M.R., Schiller, J., Srinivasan, R.A.: Probability and Statistics. Schaum’s Outlines (2012)

    Google Scholar 

  20. Sturge, H.A.: The choice of class interval. J. Am. Stat. Assoc. 21(153), 65–67 (1926)

    Article  Google Scholar 

  21. Hegland, M., Garcke, J., Challis, V.: The combination technique and some generalisations. Linear Algebra Appl. 420(2), 249–275 (2007)

    Article  MathSciNet  Google Scholar 

  22. Chen, D., Sain, S.L., Guo, K.: Data mining for the online retail industry: a case study of RFM model-based customer segmentation using data mining. J. Database Mark. Customer Strategy Manage. 19, 197–208 (2012). https://doi.org/10.1057/dbm.2012.17

    Article  Google Scholar 

  23. Walpole, R.E., Myes, R.H.P., Myers, S.L., Keying, K.Y.: Probability and Statistics for Engineers and Scientists (2010)

    Google Scholar 

  24. Lipschutz, S., Lipson, M.L., Patil, V.H.: Discrete Mathematics. MacGraw Hill Education (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mishra, D., Sharma, S. (2021). Statistical Approach for Mining Frequent Item Sets. In: Luhach, A.K., Jat, D.S., Bin Ghazali, K.H., Gao, XZ., Lingras, P. (eds) Advanced Informatics for Computing Research. ICAICR 2020. Communications in Computer and Information Science, vol 1393. Springer, Singapore. https://doi.org/10.1007/978-981-16-3660-8_61

Download citation

  • DOI: https://doi.org/10.1007/978-981-16-3660-8_61

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-16-3659-2

  • Online ISBN: 978-981-16-3660-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation