Log in

AI application in video: spiral optimizer based fast intra mode selection in HEVC

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

A codec is the most important element of any streaming application like Netflix or YouTube, but its complexity is increasing with its advancement. The codec, High Efficiency Video Coding (HEVC), selects the intra mode out of a total of 35 intra modes using the brute-force method. Therefore, the Spiral Optimization Algorithm (SOA) is utilized in this article to overcome the aforementioned limitation of HEVC. Firstly, the elements of SOA are efficiently mapped to the elements of HEVC. Secondly, the current best intra mode becomes the center of the spiral of SOA. Thirdly, the current best intra mode is considered optimal if the spiral completes three spiral-loops and the current intra mode still remains the best. Otherwise, the new best intra modes becomes the center of the spiral. Results show that SOA based fast intra-mode selection reduces the time complexity of HEVC by 34.09% while BD-BR (Bjontegaard Delta - Bit Rate) overhead is only 1.56%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data Availability

Data sharing not applicable to this article as no datasets were generated or analysed during the current study.

References

  1. Falkowski-Gilski P, Uhl T (2020) Current trends in consumption of multimedia content using online streaming platforms: A user-centric survey. Comput Sci Rev 37:100268

    Article  Google Scholar 

  2. Tariq J (2019) RD-cost as statistical inference for early intra mode decision in HEVC. Multimedia Tools and Applications, pp 1–19

  3. Tariq J, Armghan A, Ijaz A, Ashraf I (2021) Light weight model for intra mode selection in HEVC. Multimed Tools Appl 80(14):21449–21464

    Article  Google Scholar 

  4. Tariq J, Armghan A, Ijaz A, Ashraf I (2020) Pure intra mode decision in HEVC using optimized firefly algorithm. J Vis Commun Image Represent 68:102766

    Article  Google Scholar 

  5. Tariq J, Javed M, Ayub B, Armghan A, Ijaz A, Alenezi F, Rahman H, Zulfiqar A (2023) Nature inspired algorithm based fast intra mode decision in HEVC. Multimedia Tools and Applications, pp 1–16

  6. HEVC Test Model (2023) https://hevc.hhi.fraunhofer.de/. Accessed

  7. Tariq J, Alfalou A, Ijaz A, Ali H, Ashraf I, Rahman H, Armghan A, Mashood I, Rehman S (2022) Fast intra mode selection in HEVC using statistical model. CMC-COMPUTERS MATERIALS and CONTINUA 70(2):3903–3918

    Article  Google Scholar 

  8. Tamura K, Yasuda K (2011) Primary study of spiral dynamics inspired optimization. IEEJ Trans Electr Electron Eng 6(S1):S98–S100

    Article  Google Scholar 

  9. Tariq J (2020) Guided filter based intra mode accelerator for HEVC. Multimed Tools Appl 79(27):20299–20318

    Article  Google Scholar 

  10. Tariq J, Ijaz A (2021) HEVC intra mode selection using benfords law. Circuits Syst Signal Process 40(1):418–437

    Article  Google Scholar 

  11. Tariq J (2019) Intra mode selection using classical secretary problem (CSP) in high efficiency video coding (HEVC). Multimedia Tools and Applications pp 1–23

  12. Wang LL, Siu WC (2013) Novel adaptive algorithm for intra prediction with compromised modes skip** and signaling processes in HEVC. IEEE Trans Circuits Syst Video Technol 23(10):1686–1694

    Article  Google Scholar 

  13. Zhao L, Zhang L, Ma S, Zhao D (2011) Fast mode decision algorithm for intra prediction in HEVC. In: Visual communications and image processing (VCIP), 2011 IEEE, pp 1–4. IEEE

  14. Liao KY, Yang JF, Sun MT (2010) Rate-distortion cost estimation for H. 264/AVC. IEEE Trans Circuits Syst Video Technol 20(1):38–49

  15. Yeh CH, Li MF, Chen MJ, Chi MC, Huang XX, Chi HW (2014) Fast mode decision algorithm through inter-view rate-distortion prediction for multiview video coding system. IEEE Trans Industr Inform 10(1):594–603

    Article  Google Scholar 

  16. Zhang H, Ma Z (2012) Fast intra prediction for high efficiency video coding. Pacific-rim conference on multimedia. Springer, Berlin, Heidelberg, pp 568–577

  17. Wang P, Ni C, Zhang G, Li K (2017) R-Lambda model based CTU-level rate control for intra frames in HEVC. Multimedia Tools and Applications pp 1–15

  18. Zhang T, Sun MT, Zhao D, Gao W (2017) Fast Intra-Mode and CU Size Decision for HEVC. IEEE Trans Circuits Syst Video Technol 27(8):1714–1726

    Article  Google Scholar 

  19. Hu Q, Zhang X, Shi Z, Gao Z (2016) Fast HEVC intra mode decision based on logistic regression classification. In: Broadband multimedia systems and broadcasting (BMSB), 2016 IEEE International Symposium on, pp 1–4. IEEE

  20. Kuanar S, Rao KR, Bilas M, Bredow J (2019) Adaptive CU mode selection in HEVC intra prediction: a deep learning approach. Circuits Syst Signal Process pp 1–22

  21. Yan Z, Cho SY, Welsen S (2019) Fast intra prediction mode decision for HEVC using random forest. In: Proceedings of the 2019 international conference on image, video and signal processing, pp 45–49. ACM

  22. Gwon D, Choi H (2019) Relative SATD based minimum risk bayesian framework for fast intra decision of HEVC. KSII Transactions on Internet and Information Systems 13(1)

  23. Tariq J (2019) High-performance intra-mode accelerator for HEVC. Vis Comput 35:1–15

    Google Scholar 

  24. Wang Y, Su Z(2020) An efficient intra prediction algorithm for HEVC intra-coding. In: 2020 13th International congress on image and signal processing, biomedical engineering and informatics (CISP-BMEI), pp 407–412. IEEE

  25. Tariq J, Ijaz A, Armghan A, Rahman H, Ali H, Alenezi F (2022) HEVC’s intra mode process expedited using histogram of oriented gradients. J Vis Commun Image Represent 88:103594

    Article  Google Scholar 

  26. Chen Y, Yu L, Wang H, Li T, Wang S (2020) A novel fast intra mode decision for versatile video coding. J Vis Commun Image Represent 71:102849

    Article  Google Scholar 

  27. Yang J, Wei A (2020) Fast mode decision algorithm for intra prediction in HEVC. In: 2020 IEEE 4th information technology, networking, electronic and automation control conference (ITNEC), vol 1, pp 1018–1022. IEEE

  28. Yang H, Shen L, Dong X, Ding Q, An P, Jiang G (2019) Low-complexity CTU partition structure decision and fast intra mode decision for versatile video coding. IEEE Trans Circuits Syst Video Technol 30(6):1668–1682

    Article  Google Scholar 

  29. Tariq J, Armghan A, Alenezi F, Ijaz A, Rehman S, Alfalou A, Ali Khan J (2021) HEVC Fast Intra-Mode Selection Using World War II Technique. Electronics 10(9):985

    Article  Google Scholar 

  30. Armghan A, Tariq J, Alenezi F, Alnaim N, Alfalou A, Rehman S (2021) HEVC’s Intra Mode Selection Using Odds Algorithm. Electronics 10(15):1839

  31. Bossen F (2011) Common test conditions and software reference configurations. Joint Collaborative Team on Video Coding (JCT-VC), JCTVC-F900

  32. Bjontegaard G (2001) Calculation of average PSNR differences between RD-curves. VCEG-M33

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Junaid Tariq.

Ethics declarations

Conflicts of interest

The author declares that there is no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by the author.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tariq, J., Javed, M., Rahman, H. et al. AI application in video: spiral optimizer based fast intra mode selection in HEVC. Multimed Tools Appl 83, 66463–66478 (2024). https://doi.org/10.1007/s11042-024-18268-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-024-18268-y

Keywords

Navigation