Compact Storage of Data Streams in Mobile Devices

  • Conference paper
  • First Online:
Distributed Applications and Interoperable Systems (DAIS 2024)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14677))

  • 27 Accesses

Abstract

Data streams produced by mobile devices, such as smartphones, offer highly valuable sources of information to build ubiquitous services. However, the diversity of embedded sensors and the resulting data deluge makes it impractical to provision such services directly on mobiles, due to their constrained storage capacity, communication bandwidth and processing power. Unfortunately, the improving hardware capabilities of devices are unlikely to resolve these structural issues. We, therefore, believe that mobile data management systems should, instead, handle data streams efficiently and compactly, to provision services directly at the edge, while accounting for the limits of existing assets and network infrastructures. This paper introduces the FLI framework, which leverages a piece-wise linear approximation technique to capture compact representations of data streams in mobile devices. Our experiments, performed on Android and iOS devices, show that FLI outperforms the state of the art both in memory footprint and I/O throughput. Our Flutter implementation of FLI can store stream datasets in mobile devices, which is a prerequisite to processing big data from ubiquitous devices in situ.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 59.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. An, Y., Su, Y., Zhu, Y., Wang, J.: TVStore: automatically bounding time series storage via Time-Varying compression. In: 20th USENIX Conference on File and Storage Technologies (FAST 22), pp. 83–100. USENIX Association, Santa Clara, CA (2022). https://www.usenix.org/conference/fast22/presentation/an

  2. Berlin, E., Van Laerhoven, K.: An on-line piecewise linear approximation technique for wireless sensor networks. In: IEEE Local Computer Network Conference, pp. 905–912. IEEE (2010). https://gdpr-info.eu

  3. Binder, S.: Drift library (2019). https://pub.dev/packages/drift. Accessed 21 Apr 2024

  4. Blalock, D., Madden, S., Guttag, J.: Sprintz: time series compression for the internet of things. Proc. ACM Interact. Mobile Wearable Ubiquit. Technol. 2(3), 1–23 (2018). https://doi.org/10.1145/3264903

    Article  Google Scholar 

  5. Dollinger, V., Junginger, M.: Objectbox database (2014). https://objectbox.io. Accessed 21 Apr 2024

  6. Galakatos, A., Markovitch, M., Binnig, C., Fonseca, R., Kraska, T.: Fiting-tree: a data-aware index structure. In: Proceedings of the 2019 International Conference on Management of Data, pp. 1189–1206 (2019)

    Google Scholar 

  7. Google: Flutter framework (2018). https://flutter.dev/. Accessed 21 Apr 2024

  8. Grützmacher, F., Beichler, B., Hein, A., Kirste, T., Haubelt, C.: Time and memory efficient online piecewise linear approximation of sensor signals. Sensors 18(6), 1672 (2018)

    Article  Google Scholar 

  9. Inc, T.: Timescale database (2018). https://www.timescale.com. Accessed 21 Apr 2024

  10. InfluxData: Influxdb (2013). https://www.influxdata.com/products/influxdb-overview/. Accessed 21 Apr 2024

  11. Keogh, E., Chu, S., Hart, D., Pazzani, M.: An online algorithm for segmenting time series. In: Proceedings 2001 IEEE International Conference on Data Mining, pp. 289–296. IEEE (2001)

    Google Scholar 

  12. Liu, X., Lin, Z., Wang, H.: Novel online methods for time series segmentation. IEEE Trans. Knowl. Data Eng. 20(12), 1616–1626 (2008)

    Article  Google Scholar 

  13. Moawad, A., Hartmann, T., Fouquet, F., Nain, G., Klein, J., Le Traon, Y.: Beyond discrete modeling: a continuous and efficient model for IoT. In: 2015 ACM/IEEE 18th International Conference on Model Driven Engineering Languages and Systems (MODELS), pp. 90–99. IEEE (2015)

    Google Scholar 

  14. Mokhtar, S.B., et al.: Priva’mov: analysing human mobility through multi-sensor datasets. In: NetMob 2017 (2017)

    Google Scholar 

  15. Piorkowski, M., Sarafijanovic-Djukic, N., Grossglauser, M.: Crawdad data set epfl/mobility (v. 2009-02-24) (2009)

    Google Scholar 

  16. Polar: Ignite 2 (2021). https://www.polar.com/en/ignite2. Accessed 21 Apr 2024

  17. Raes, R., Ruas, O., Luxey-Bitri, A., Rouvoy, R.: Fast linear interpolation implementation (2024). https://archive.softwareheritage.org/browse/origin/directory/?origin_url=https://gitlab.inria.fr/Spirals/temporaldb_apps.git &path=temporaldb(2022), last accessed on April 21st, 2024

    Google Scholar 

  18. Raes, R., Ruas, O., Luxey-Bitri, A., Rouvoy, R.: Memory space benchmarking application (2022). https://archive.softwareheritage.org/browse/origin/directory/?origin_url=https://gitlab.inria.fr/Spirals/temporaldb_apps.git &path=benchmarking_memory_space. Accessed 21 Apr 2024

    Google Scholar 

  19. Raes, R., Ruas, O., Luxey-Bitri, A., Rouvoy, R.: Throughput benchmarking application (2022). https://archive.softwareheritage.org/browse/origin/directory/?origin_url=https://gitlab.inria.fr/Spirals/temporaldb_apps.git &path=benchmarking_throughput. Accessed 21 Apr 2024

    Google Scholar 

  20. Tamplin, J., Lee, A.: Firebase services (2012). https://firebase.google.com. Accessed 21 Apr 2024

  21. Timescale: Building a distributed time-series database on PostgreSQL (2019). https://www.timescale.com/blog/building-a-distributed-time-series-database-on-postgresql/. Accessed 12 May 2023

  22. Vaizman, Y., Ellis, K., Lanckriet, G.: Recognizing detailed human context in the wild from smartphones and smartwatches. IEEE Pervasive Comput. 16(4), 62–74 (2017). https://doi.org/10.1109/MPRV.2017.3971131

    Article  Google Scholar 

  23. Wolfson, O., Chamberlain, S., Dao, S., Jiang, L., Mendez, G.: Cost and imprecision in modeling the position of moving objects. In: Proceedings 14th International Conference on Data Engineering, pp. 588–596 (1998).https://doi.org/10.1109/ICDE.1998.655822

Download references

Acknowledgements

This research was supported in part by the Groupe La Poste, sponsor of the Inria Foundation, in the framework of the FedMalin Inria Challenge.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Rémy Raes , Olivier Ruas , Adrien Luxey-Bitri or Romain Rouvoy .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Raes, R., Ruas, O., Luxey-Bitri, A., Rouvoy, R. (2024). Compact Storage of Data Streams in Mobile Devices. In: Martins, R., Selimi, M. (eds) Distributed Applications and Interoperable Systems. DAIS 2024. Lecture Notes in Computer Science, vol 14677. Springer, Cham. https://doi.org/10.1007/978-3-031-62638-8_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-62638-8_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-62637-1

  • Online ISBN: 978-3-031-62638-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation