SpringerLink
Log in

Storage and Analysis of Synchrophasor Data for Event Detection in Indian Power System Using Hadoop Ecosystem

  • Conference paper
  • First Online:
Data and Communication Networks

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 847))

Abstract

Synchrophasor devices commonly referred to as phasor measurement units (PMUs) have been rapidly deployed in power grids to get a clearer picture of the events that take place in power grid at very high sampling rates. Thus PMUs enable event predictions to become more accurate. However, high data-sampling rate of PMUs creates huge volumes of data on a GB scale per PMU per day, which in turn makes the storage and analysis of the collected data difficult; giving rise to a Big Data problem use case. In India, National Load Dispatch Centre (NLDC) uses Synchrowave; a centralized software package to collect, store and process, which runs on a single very high-end system for storage and processing. But the centralized architecture of current system gives no room for scalability, neither in computation nor storage, even with costly hardware upgrades. This paper proposes a system model with all the desired features using open-source frameworks and tools like Apache Hadoop and HBase.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 117.69
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 160.49
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Phadke, A.G.: Synchronized phasor measurements in power systems. IEEE Comput. Appl. Power 6(2), 10–15 (1993)

    Article  MathSciNet  Google Scholar 

  2. Aghaei, J., Alizadeh, M.I.: Demand response in smart electricity grids equipped with renewable energy sources: a review. Renew. Sustain. Energy Rev. 18, 64–72 (2013)

    Article  Google Scholar 

  3. Mohanta, D., Roy, D.: Importance and uncertainty analysis in software reliability assessment of computer relay. Proc. Inst. Mech. Eng. Part O J. Risk Reliab. 225(1), 50–61 (2011)

    Article  Google Scholar 

  4. Roy, D.S., Mohanta, D.K., Panda, A.: Software reliability allocation of digital relay for transmission line protection using a combined system hierarchy and fault tree approach. IET Softw. 2(5), 437–445 (2008)

    Article  Google Scholar 

  5. Das, H., Roy, D.: A grid computing service for power system monitoring. Int. J. Comput. Appl. 62(20) (2013)

    Google Scholar 

  6. Polaki, S.K., Reza, M., Roy, D.S.: A genetic algorithm for optimal power scheduling for residential energy management. In: 2015 IEEE 15th International Conference on Environment and Electrical Engineering (EEEIC), IEEE, pp. 2061–2065 (2015)

    Google Scholar 

  7. Mondal, S., Murthy, C., Roy, D., Mohanta, D.: Simulation of phasor measurement unit (pmu) using labview. In: 2014 14th International Conference on Environment and Electrical Engineering (EEEIC), IEEE, pp. 164–168 (2014)

    Google Scholar 

  8. Mohanta, D.K., Murthy, C., Sinha Roy, D.: A brief review of phasor measurement units as sensors for smart grid. Electr. Power Compon. Syst. 44(4), 411–425 (2016)

    Article  Google Scholar 

  9. Murthy, C., Mishra, A., Ghosh, D., Roy, D.S., Mohanta, D.K.: Reliability analysis of phasor measurement unit using hidden Markov model. IEEE Syst. J. 8(4), 1293–1301 (2014)

    Article  Google Scholar 

  10. Murthy, C., Roy, D.S., Mohanta, D.K.: Reliability evaluation of phasor measurement unit: a system of systems approach. Electr. Power Compon. Syst. 43(4), 437–448 (2015)

    Article  Google Scholar 

  11. Murthy, C., Varma, K.A., Roy, D.S., Mohanta, D.K.: Reliability evaluation of phasor measurement unit using type-2 fuzzy set theory. IEEE Syst. J. 8(4), 1302–1309 (2014)

    Article  Google Scholar 

  12. Roy, D.S., Murthy, C., Mohanta, D.K.: Reliability analysis of phasor measurement unit incorporating hardware and software interaction failures. IET Gener. Transm. Distrib. 9(2), 164–171 (2014)

    Article  Google Scholar 

  13. POSOCO. http://posoco.in/2013-03-12-10-34-42/synchrophasors

  14. Dahal, O.P., Brahma, S.M., Cao, H.: Comprehensive clustering of disturbance events recorded by phasor measurement units. IEEE Trans. Power Deliv. 29(3), 1390–1397 (2014)

    Article  Google Scholar 

  15. Liu, L., Chai, J., Qi, H., Liu, Y.: Power grid disturbance analysis using frequency information at the distribution level. In: 2014 IEEE International Conference on Smart Grid Communications (SmartGrid-Comm), IEEE, pp. 523–528 (2014)

    Google Scholar 

  16. Dahal, O.P., Brahma, S.M.: Preliminary work to classify the disturbance events recorded by phasor measurement units. In: 2012 IEEE Power and Energy Society General Meeting, IEEE, pp. 1–8 (2012)

    Google Scholar 

  17. Todd, M.J., Yıldırım, E.A.: On Khachiyan’s algorithm for the computation of minimum-volume enclosing ellipsoids. Discret. Appl. Math. 155(13), 1731–1744 (2007)

    Article  MathSciNet  Google Scholar 

  18. Rusitschka, S., Eger, K., Gerdes, C.: Smart grid data cloud: a model for utilizing cloud computing in the smart grid domain. In: 2010 First IEEE International Conference on Smart Grid Communications (SmartGridComm), IEEE, pp. 483–488 (2010)

    Google Scholar 

  19. Allen, A.J.: Analysis of Transmission System Events and Behavior Using Customer Level Voltage Synchrophasor Data (2013)

    Google Scholar 

  20. Bach, F., Cakmak, H.K., Maass, H., Kuehnapfel, U.: Power grid time series data analysis with pig on a Hadoop cluster compared to multi core systems. In: 2013 21st Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP), IEEE, pp. 208–212 (2013)

    Google Scholar 

  21. Song, Y., Zhu, Y., Li, L.: Large scale data storage and processing of insulator leakage current using HBase and mapreduce. In: 2014 International Conference on Power System Technology (POW-ERCON), IEEE, pp. 1331–1337 (2014)

    Google Scholar 

  22. Allen, A., Singh, M., Muljadi, E., Santoso, S.: PMU Data Event Detection: A User Guide for Power Engineers. National Renewable Energy Laboratory (2014)

    Google Scholar 

  23. Foster, I., Zhao, Y., Raicu, I., Lu, S.: Cloud computing and grid computing 360-degree compared. In: Grid Computing Environments Workshop, 2008. GCE’08, IEEE, pp. 1–10 (2008)

    Google Scholar 

  24. Borthakur, D., et al.: HDFS architecture guide. Hadoop Apache Proj. 53, 1–13 (2008)

    Google Scholar 

  25. Apache: Apache Thrift. https://thrift.apache.org

  26. Apache: Apache HBase. http://hbase.apache.org/

Download references

Acknowledgements

This work has been carried out by financial assistances from SERB-DST (File no. EMR/2017/001508). The authors wish to thank POSOCO, New Delhi for providing necessary synchrophasor data.

Author information

Authors and Affiliations

  1. National Institute of Technology Meghalaya, Shillong, India

    Akhilendra Pratap Singh, Subhendu Sekhar Paik & Diptendu Sinha Roy

  2. ICTS-TIFR, Bengaluru, India

    G. Hemant Kumar

Authors
  1. Akhilendra Pratap Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. G. Hemant Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Subhendu Sekhar Paik
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Diptendu Sinha Roy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Diptendu Sinha Roy .

Editor information

Editors and Affiliations

  1. University of Canberra, Adelaide, SA, Australia

    Lakhmi C. Jain

  2. Aurel Vlaicu University of Arad, Arad, Romania

    Valentina E. Balas

  3. School of Computing Science and Engineering, Galgotias University, Greater Noida, Uttar Pradesh, India

    Prashant Johri

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Singh, A.P., Hemant Kumar, G., Paik, S.S., Sinha Roy, D. (2019). Storage and Analysis of Synchrophasor Data for Event Detection in Indian Power System Using Hadoop Ecosystem. In: Jain, L., E. Balas, V., Johri, P. (eds) Data and Communication Networks. Advances in Intelligent Systems and Computing, vol 847. Springer, Singapore. https://doi.org/10.1007/978-981-13-2254-9_26

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-2254-9_26

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-2253-2

  • Online ISBN: 978-981-13-2254-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation