Abstract
Visual summarization of landmarks is an interesting and non-trivial task with the availability of gigantic community-contributed resources. In this work, we investigate ways to generate representative and distinctive views of landmarks by automatically discovering the underlying Scenic Themes (e.g. sunny, night view, snow, foggy views, etc.) via a content-based analysis. The challenge is that the task suffers from the subjectivity of the scenic theme understanding, and there is lack of prior knowledge of scenic themes understanding. In addition, the visual variations of scenic themes are results of joint effects of factors including weather, time, season, etc. To tackle the aforementioned issues, we exploit the Dirichlet Process Gaussian Mixture Model (DPGMM). The major advantages in using DPGMM is that it is fully unsupervised and do not require the number of components to be fixed beforehand, which avoids the difficulty in adjusting model complexity to avoid over-fitting. This work makes the first attempt towards generation of representative views of landmarks via scenic theme mining. Testing on seven famous world landmarks show promising results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ahern, S., Naaman, M., Nair, R., Yang, J.H.-I.: World explorer: visualizing aggregate data from unstructured text in geo-referenced collections. In: JCDL, pp. 1–10 (2007)
Antoniak, C.E.: Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems. The annals of statistics 2(6), 1152–1174 (1974)
Berg, T.L., Forsyth, D.A.: Automatic ranking of iconic images. Technical report (2007)
Zisserman, A., Bosch, A., Munoz, X.: Scene classification via pLSA. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 517–530. Springer, Heidelberg (2006)
Crandall, D.J., Backstrom, L., Huttenlocher, D., Kleinberg, J.: Map** the world’s photos. In: WWW, pp. 761–770 (2009)
Escobar, M.D., West, M.: Bayesian Density Estimation and Inference Using Mixtures.. Journal of the american statistical association 90(430) (1995)
Ferguson, T.S.: A Bayesian analysis of some nonparametric problems. The annals of statistics 1(2), 209–230 (1973)
Fritz, M., Schiele, B.: Decomposition, discovery and detection of visual categories using topic models. In: CVPR, vol. 0, pp. 1–8 (2008)
Kennedy, L.S., Naaman, M.: Generating diverse and representative image search results for landmarks. In: WWW, pp. 297–306 (2008)
Li, F.-F., Perona, P.: A bayesian hierarchical model for learning natural scene categories. In: CVPR, vol. 2, pp. 524–531 (2005)
Naaman, M., Harada, S., Wang, Q., Garcia-Molina, H., Paepcke, A.: Context data in geo-referenced digital photo collections. In: MM, pp. 196–203 (2004)
Neal, R.M.: Bayesian mixture modeling. In: Maximum Entropy and Bayesian Methods: Proceedings of the 11th International Workshop on Maximum Entropy and Bayesian Methods of Statistical Analysis, Seattle, pp. 197–211 (1991)
Neal, R.M.: Markov chain sampling methods for Dirichlet process mixture models. Journal of computational and graphical statistics 9(2), 249–265 (2000)
Rasmussen, C.E.: The infinite Gaussian mixture model. Advances in neural information processing systems 12, 554–560 (2000)
Rasmussen, C.E., Ghahramani, Z.: Occam razor. In: Advances in neural information processing systems 13: Proceedings of the 2000 Conference, p. 294. The MIT Press, Cambridge (2001)
Simon, I., Snavely, N., Seitz, S.M.: Scene summarization for online image collections. In: ICCV, pp. 1–8. Citeseer (2007)
Sudderth, E.B., Torralba, A., Freeman, W.T., Willsky, A.S.: Learning hierarchical models of scenes, objects, and parts. In: ICCV, vol. 2, pp. 1331–1338 (2005)
Szummer, M., Picard, R.W.: Indoor-outdoor image classification. In: Proceedings of 1998 IEEE International Workshop on Content-Based Access of Image and Video Database, pp. 42–51 (1998)
Zheng, Y.-T., Zhao, M., Song, Y., Adam, H., Buddemeier, U., Bissacco, A., Brucher, F., Chua, T.-S., Neven, H.: Tour the world: building a web-scale landmark recognition engine. In: CVPR (June 2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhao, YL., Zheng, YT., Zhou, X., Chua, TS. (2011). Generating Representative Views of Landmarks via Scenic Theme Detection. In: Lee, KT., Tsai, WH., Liao, HY.M., Chen, T., Hsieh, JW., Tseng, CC. (eds) Advances in Multimedia Modeling. MMM 2011. Lecture Notes in Computer Science, vol 6523. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17832-0_37
Download citation
DOI: https://doi.org/10.1007/978-3-642-17832-0_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17831-3
Online ISBN: 978-3-642-17832-0
eBook Packages: Computer ScienceComputer Science (R0)