Semantic Annotation of Complex Human Scenes for Multimedia Surveillance

  • Conference paper
AI*IA 2007: Artificial Intelligence and Human-Oriented Computing (AI*IA 2007)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4733))

Included in the following conference series:

Abstract

A Multimedia Surveillance System (MSS) is considered for automatically retrieving semantic content from complex outdoor scenes, involving both human behavior and traffic domains. To characterize the dynamic information attached to detected objects, we consider a deterministic modeling of spatio-temporal features based on abstraction processes towards fuzzy logic formalism. A situational analysis over conceptualized information will not only allow us to describe human actions within a scene, but also to suggest possible interpretations of the behaviors perceived, such as situations involving thefts or dangers of running over. Towards this end, the different levels of semantic knowledge implied throughout the process are also classified into a proposed taxonomy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Arens, M., Nagel, H.–H.: Behavioral Knowledge Representation for the Understanding and Creation of Video Sequences. In: Günter, A., Kruse, R., Neumann, B. (eds.) KI 2003. LNCS (LNAI), vol. 2821, pp. 149–163. Springer, Heidelberg (2003)

    Google Scholar 

  2. Assfalg, J., Bertini, M., Colombo, C., Bimbo, A.D.: Semantic Annotation of Sports Videos. Multimedia, IEEE 9(2), 52–60 (2002)

    Article  Google Scholar 

  3. Baiget, P., Fernández, C., Roca, X., Gonzàlez, J.: Automatic Learning of Conceptual Knowledge for the Interpretation of Human Behavior in Video Sequences. In: Marti, J., Benedi, J.M., Mendonca, A.M., Serrat, J. (eds.) TSDM 2000. LNCS, vol. 4477, pp. 507–514. Springer, Heidelberg (2007)

    Google Scholar 

  4. Bobick, A.F.: Movement, Activity and Action: the Role of Knowledge in the Perception of Motion. Philosophical Transactions: Biological Sciences 352(1358), 1257–1265 (1997)

    Article  Google Scholar 

  5. Cucchiara, R.: Multimedia Surveillance Systems. In: Proceedings of the third ACM international workshop on Video surveillance & sensor networks, pp. 3–10. ACM Press, New York (2005)

    Chapter  Google Scholar 

  6. Gonzàlez, J.: Human Sequence Evaluation: The Key-Frame Approach. PhD thesis, Universitat Autònoma de Barcelona, Barcelona, Spain (2004)

    Google Scholar 

  7. Haag, M., Theilmann, W., Schäfer, K., Nagel, H.-H.: Integration of Image Sequence Evaluation and Fuzzy Metric Temporal Logic Programming, pp. 301–312. Springer, London, UK (1997)

    Google Scholar 

  8. Moeslund, T.B., Hilton, A., Kruger, V.: A Survey of Advances in Vision-based Human Motion Capture and Analysis. Computer Vision and Image Understanding 104, 90–126 (2006)

    Article  Google Scholar 

  9. Nagel, H.–H.: From Image Sequences Towards Conceptual Descriptions. Image and Vision Computing 6(2), 59–74 (1988)

    Article  Google Scholar 

  10. Schäfer, K., Brzoska, C.: F-Limette Fuzzy Logic Programming Integrating Metric Temporal Extensions. Journal of Symbolic Computation 22(5-6), 725–727 (1996)

    Google Scholar 

  11. Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based Image Retrieval at the End of the Early Years. Pattern Analysis and Machine Intelligence, IEEE Transactions on 22(12), 1349–1380 (2000)

    Article  Google Scholar 

  12. Snoek, C.G.M., Worring, M.: A Review on Multimodal Video Indexing. Multimedia and Expo, 2002. In: Proceedings of the ICME 2002, vol. 2 (2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Roberto Basili Maria Teresa Pazienza

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Fernández, C., Baiget, P., Roca, X., Gonzàlez, J. (2007). Semantic Annotation of Complex Human Scenes for Multimedia Surveillance. In: Basili, R., Pazienza, M.T. (eds) AI*IA 2007: Artificial Intelligence and Human-Oriented Computing. AI*IA 2007. Lecture Notes in Computer Science(), vol 4733. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74782-6_60

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-74782-6_60

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-74781-9

  • Online ISBN: 978-3-540-74782-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation