SpringerLink
Log in

Adaptive Intra Refresh for Screen Content Video Transmission in Dynamic Network

  • Published:
Mobile Networks and Applications Aims and scope Submit manuscript

Abstract

Screen content video has been widely used in teleconferencing, cloud gaming, screen sharing, etc. In order to improve the compression efficiency of screen content video, the international standards organization developed the extended screen content coding standard (HEVC-SCC). However, high compression rates may also cause serious information loss when transmission error occurs, degrading the quality of received video. To tackle this problem, this paper proposes an adaptive intra refresh strategy for screen content video transmission. Firstly, the intra refresh optimization problem is mathematically modeled considering error propagation and error concealment. Next, the optimization problem is simplified based on the quantization mechanism, and the optimal solution of the optimization problem is obtained using the offline training method. Then, the buffer control is designed to reduce the transmission delay. Finally, experimental results show that compared with the original HEVC-SCC encoding method, the proposed algorithm could averagely improve the rate-distortion performance by 14.12%, and significantly improve the subjective quality of the received video.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data Availability

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Peng WH, Wall FG, Cohen RA, Xu J, Ostermann J, MacInnis A, Lin T (2016) Overview of screen content video coding: Technologies, standards, and beyond. IEEE J Emerg Select Topics Circuits Syst 6(4):393–408

    Article  Google Scholar 

  2. Xu J, Joshi R, Cohen RA (2015) Overview of the emerging HEVC screen content coding extension. IEEE Trans Circuits Syst Video Technol 26(1):50–62

    Article  Google Scholar 

  3. Tang T, Li L, Wu X, Chen R, Li H, Lu G, Cheng L (2022) TSA-SCC: Text semanticaware screen content coding with ultra low bitrate. IEEE Trans Image Process. https://doi.org/10.1109/TIP.2022.3152003

    Article  Google Scholar 

  4. Oztas B, Pourazad MT, Nasiopoulos P, Leung VC (2012) A study on the HEVC performance over lossy networks. In 2012 19th IEEE International Conference on Electronics, Circuits, and Systems, pp 785–788, https://doi.org/10.1109/ICECS.2012.6463542

  5. Kulupana G, Talagala DS, Arachchi HK, Fernando (2018) End user video quality prediction and coding parameters selection at the encoder for robust HEVC video transmission. IEEE Trans Circuits Syst Video Technol 29(11):3367–3381

    Article  Google Scholar 

  6. Kung WY, Kim CS, Kuo CC (2006) Spatial and temporal error concealment techniques for video transmission over noisy channels. IEEE Trans Circuits Syst Video Technol 16(7):789–803

    Article  Google Scholar 

  7. Golmohammadi A, Mitchell DG (2021) Concatenated spatially coupled LDPC codes with sliding window decoding for joint source-channel coding. IEEE Trans Commun. https://doi.org/10.1109/TCOMM.2021.3126750

    Article  Google Scholar 

  8. Wu D, Bao R, Li Z, Wang H, Zhang H, Wang R (2021) Edge-cloud collaboration enabled video service enhancement: a hybrid human-artificial intelligence scheme. IEEE Trans Multimedia 23:2208–2221

    Article  Google Scholar 

  9. Cheng L, Zarki ME (2004) Perceptual quality feedback based progressive frame-level refreshing for robust video communication. In: 2004 IEEE Wireless Communications and Networking Conference(IEEE Cat), pp 2047–2052. https://doi.org/10.1109/ICASSP.2004.1326526

  10. Wu D, Han X, Yang Z, Wang R (2021) Exploiting transfer learning for emotion recognition under cloud-edge-client collaborations. IEEE J Sel Areas Commun 39(2):479–490

    Article  Google Scholar 

  11. Kazemi M, Ghanbari M, Shirmohammadi S (2019) Intra coding strategy for video error resiliency: behavioral analysis. IEEE Trans Multimedia 22(9):2193–2206

    Article  Google Scholar 

  12. Zhang R, Regunathan SL, Rose K (2000) Video coding with optimal inter/intra-mode switching for packet loss resilience. IEEE J Sel Areas Commun 18(6):966–976

    Article  Google Scholar 

  13. Cote G, Shirani S, Kossentini F (2000) Optimal mode selection and synchronization for robust video communications over error-prone networks. IEEE J Sel Areas Commun 18(6):952–965

    Article  Google Scholar 

  14. Girod B (1998) Feedback-based error control for mobile video transmission. IEEE J Sel Areas Commun 16(3):358–368

    Google Scholar 

  15. Zhai F, Eisenberg Y, Pappas TN, Berry R, Katsaggelos AK (2005) Rate-distortion optimized hybrid error control for real-time packetized video transmission. IEEE Trans Image Process 15(1):40–53

    Article  Google Scholar 

  16. dela Cruz, AR, Cajote RD (2014) Low complexity adaptive intra-refresh rate for realtime wireless video transmission. In Signal and Information Processing Association Annual Summit and Conference(APSIPA), pp 1–5. https://doi.org/10.1109/APSIPA.2014.7041762

  17. Schreier RM, Rothermel A (2006) Motion adaptive intra refresh for the H. 264 video coding standard. IEEE Trans Consumer Electron 52(1):249–253

    Article  Google Scholar 

  18. Vadapalli SC, Sengupta B, Sethuraman S (2008) Low-complexity frame-level joint source-channel distortion optimal, adaptive intra refresh. In 2008 IEEE 10th Workshop on Multimedia Signal Processing, pp 474–480. https://doi.org/10.1109/MMSP.2008.4665125

  19. He Z, Cai J, Chen CW (2002) Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding. IEEE Trans Circuits Syst Video Technol 12(6):511–523

    Article  Google Scholar 

  20. Drake A, Zhao C, Sun M-T et al (2015) Adaptive intra-refresh for low-delay error-resilient video coding. J Vis Commun Image Represent 31(1):294–304. https://doi.org/10.1109/APSIPA.2014.7041518

    Article  Google Scholar 

  21. Chen Q, Chen Z, Gu X, Wang C (2007) Attention-based adaptive intra refresh for error-prone video transmission. IEEE Commun Mag 45(1):52–60

    Article  Google Scholar 

  22. Ali I, Fleury M, Ghanbari M (2012) Content-aware intra-refresh for video streaming over lossy links. In 2012 IEEE International Conference on Consumer Electronics (ICCE), pp 118–119. https://doi.org/10.1109/ICCE.2012.6161768

  23. Ma Z, Song L, **e R, Zhang W (2018) Motion adaptive intra refresh for low delay HEVC encoding. In International Forum on Digital TV and Wireless Multimedia Communications, pp 379–390. https://doi.org/10.1109/ICCE.2006.1598506

  24. Zhou YR, Li GQ, Ning SS (2015) A new feedback-based intra refresh method for robust video coding. In 2015 International Conference on Computer Science and Applications (CSA), pp 218–221. https://doi.org/10.1109/CSA.2015.66

  25. Moiron S, Ghanbari M (2011) Enhanced error resiliency for video with cyclic intra-refresh lines. In 2011 18th IEEE International Conference on Image Processing, pp 3229–3232. https://doi.org/10.1109/ICIP.2011.6116357

  26. Ortega A, Ramchandran K (1998) Rate-distortion methods for image and video compression. IEEE Signal Process Mag 15(6):23–50

    Article  Google Scholar 

  27. Sullivan GJ, Wiegand T (1998) Rate-distortion optimization for video compression. IEEE Signal Process Mag 15(6):74–90

    Article  Google Scholar 

  28. Kulupana G, Talagala DS, Arachchi HK, Akinola M, Fernando A (2021) Concealment support and error resilience for HEVC to improve consumer quality of experience. IEEE Trans Consum Electron 67(2):107–118

    Article  Google Scholar 

  29. Maung HM, Aramvith S, Miyanaga Y (2015) Region-of-interest based error resilient method for HEVC video transmission. In 2015 15th International Symposium on Communications and Information Technologies (ISCIT), pp 241–244. https://doi.org/10.1109/ISCIT.2015.7458352

  30. dela Cruz AR, Cajote D (2014) Error resilient joint source-channel adaptive intra-refresh rate for wireless video transmission. In 2014 19th International Conference on Digital Signal Processing, pp 509–514. https://doi.org/10.1109/ICDSP.2014.6900718

  31. Lekcharoen S, Fung CC (2007) An adaptive fuzzy control traffic sha** scheme over wireless networks. In 2007 Asia-Pacific Conference on Communications, pp 177–182. https://doi.org/10.1109/APCC.2007.4433527

  32. Guo T, Lu XP, Zhang YX, Yu K (2021) Neighboring discriminant component analysis for asteroid spectrum classification. Remote Sens 13(16):3306. https://doi.org/10.3390/rs13163306

    Article  Google Scholar 

  33. Lu J, Wah BW (2010) Scheduling transmissions of real-time video coded frames in video conferencing applications over the Internet. In 2010 IEEE International Conference on Multimedia and Expo, pp 1695–1700, https://doi.org/10.1109/ICME.2010.5582946

  34. Guo T, Luo F, Zhang L, Tan X, Liu J, Zhou X (2019) Target detection in hyperspectral imagery via sparse and dense hybrid representation. IEEE Geosci Remote Sens Lett 17(4):716–720

    Article  Google Scholar 

  35. Kazem M, Iqbal R, Shirmohammadi S (2017) Joint intra and multiple description coding for packet loss resilient video transmission. IEEE Trans Multimedia 20(4):781–795

    Article  Google Scholar 

  36. Yu H, Cohen R, Rapaka K, Xu J (2014) Common Conditions for Screen Content Coding Tests (JCTVC-S1015)

  37. Jiang X, Shi Z, Huang LF (2007) A new scheme of establishing packet loss patterns for wireless video transmission based on Gilbert model. In 2007 IET Conference on Wireless, Mobile and Sensor Networks (CCWMSN07):205–208. https://doi.org/10.1049/cp:20070119

Download references

Funding

This work was supported by National Natural Science Foundation of China under grant U20A20157, 61771082 and 61871062, the Science and Technology Research Program of Chongqing Municipal Education Commission under grant KJQN201900604, the General Program of Chongqing Natural Science Foundation under grant cstc2021jcyj-msxmX0032, the Natural Science Foundation of Chongqing, China (cstc2020jcyj-zdxmX0024), and the University Innovation Research Group of Chongqing (CXQT20017).

Author information

Authors and Affiliations

  1. School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China

    **g Yang, Zhiyang Yin & Tong Tang

  2. Advanced Network and Intelligent Interconnection Technology Key Laboratory of Chongqing Education Commission of China, Chongqing, China

    **g Yang, Zhiyang Yin & Tong Tang

  3. Chongqing Key Laboratory of Ubiquitous Sensing and Networking, Chongqing, China

    **g Yang, Zhiyang Yin & Tong Tang

Authors
  1. **g Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhiyang Yin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tong Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tong Tang.

Ethics declarations

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, J., Yin, Z. & Tang, T. Adaptive Intra Refresh for Screen Content Video Transmission in Dynamic Network. Mobile Netw Appl (2023). https://doi.org/10.1007/s11036-023-02101-1

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11036-023-02101-1

Keywords

Search

Navigation