Learning-Based Activation of Energy Harvesting Sensors for Fresh Data Acquisition

  • Conference paper
  • First Online:
ICWE 2021 Workshops (ICWE 2021)

Abstract

We consider an energy harvesting wireless sensor network (EH-WSN), where each sensor, equipped with the battery, senses its surrounding area. We first define the estimation error of the sensing data at a measuring point, which increases as the distance to the sensor increases and the age of information (AoI) of the data increases. The AoI is the elapsed time since the latest status is generated. We also define the network coverage, which is defined as the area having the estimation errors lower than a target value. As a performance metric, we use the \(\alpha \)-coverage probability, which is the probability that the network coverage is larger than a threshold \(\alpha \). Finally, in order to deal with dynamic and complex environments, we propose a reinforcement learning (RL) based algorithm which determines the activation of the sensors. In simulation results, we show the proposed algorithm achieves higher performance than baselines. In addition, we show the impact of the transmission power and the number of sensors on the \(\alpha \)-coverage probability.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (France)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 53.49
Price includes VAT (France)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 68.56
Price includes VAT (France)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Barth-Maron, G., et al.: Distributed distributional deterministic policy gradients. In: Int. Conf. on Learning Representations (ICLR), Vancouver, Canada, April 2018

    Google Scholar 

  2. Chen, H., Li, X., Zhao, F.: A reinforcement learning-based sleep scheduling algorithm for desired area coverage in solar-powered wireless sensor networks. IEEE Sens. J. 16(8), 2763–2774 (2016)

    Article  Google Scholar 

  3. Hribar, J., Costa, M., Kaminski, N., DaSilva, L.A.: Using correlated information to extend device lifetime. IEEE Internet Things J. 6(2), 2439–2448 (2018)

    Article  Google Scholar 

  4. Kaul, S., Yates, R., Gruteser, M.: Real-time status: How often should one update? In: Proceedings IEEE Conference on Computer Communications, pp. 2731–2735, FL, USA, March 2012

    Google Scholar 

  5. Lillicrap, T.P., et al.: Continuous control with deep reinforcement learning. In: International Conference on Learning Representations (ICLR), San Juan, Puerto Rico, May 2016

    Google Scholar 

  6. Liu, W., Zhou, X., Durrani, S., Mehrpouyan, H., Blostein, S.D.: Energy harvesting wireless sensor networks: delay analysis considering energy costs of sensing and transmission. IEEE Trans. Wirel. Commun. 15(7), 4635–4650 (2016)

    Google Scholar 

  7. Shaikh, F.K., Zeadally, S.: Energy harvesting in wireless sensor networks: a comprehensive review. Renew. Sustain. Energy Rev. 55, 1041–1054 (2016)

    Article  Google Scholar 

  8. Yang, C., Chin, K.W.: Novel algorithms for complete targets coverage in energy harvesting wireless sensor networks. IEEE Commun. Lett. 18(1), 118–121 (2013)

    Article  Google Scholar 

  9. Zheng, J., Cai, Y., Shen, X., Zheng, Z., Yang, W.: Green energy optimization in energy harvesting wireless sensor networks. IEEE Commun. Mag. 53(11), 150–157 (2015)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jemin Lee .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yun, S., Kim, D., Lee, J. (2022). Learning-Based Activation of Energy Harvesting Sensors for Fresh Data Acquisition. In: Bakaev, M., Ko, IY., Mrissa, M., Pautasso, C., Srivastava, A. (eds) ICWE 2021 Workshops. ICWE 2021. Communications in Computer and Information Science, vol 1508. Springer, Cham. https://doi.org/10.1007/978-3-030-92231-3_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-92231-3_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-92230-6

  • Online ISBN: 978-3-030-92231-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation