The Self-Organizing Web

One Web, an Infinity of Spiders

  • Chapter
  • First Online:
The Web Was Done by Amateurs
  • 996 Accesses

Abstract

One of the beauties of the Web is its lack of centralized control and the possibility for anyone to contribute content and functionalities. The Web is therefore a self-organizing system. In this chapter, we look at the Web through the lenses of self-organization and its implications on the Web’s growth, structure, success, and ways of searching for information.

I don’t need Google. My wife knows everything.

Anonymous

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

eBook
EUR 28.88
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 37.44
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    NetCraft and Internet Live Stats; retrieved from: http://www.internetlivestats.com/total-number-of-websites/.

  2. 2.

    http://www.worldwidewebsize.com.

  3. 3.

    The characteristic path length is the median of the average of the minimum distance between any two nodes of the graph.

  4. 4.

    Personal communication.

References

  1. Bak, P. (1996). How nature works: The science of self-organized criticality. New York: Copurnicus.

    Chapter  Google Scholar 

  2. Barabási, A.-L., & Albert, R. (1999). Emergence of scaling in random networks. Science, 286(5439), 509–512.

    Google Scholar 

  3. Barone, G., & Mocetti, S. (2016). What’s your (sur)name? Intergenerational mobility over six centuries. http://voxeu.org/article/what-s-your-surname-intergenerational-mobility-over-six-centuries

  4. Battelle, J. (2005). The birth of Google. Wired, 13(8), 108.

    Google Scholar 

  5. Becchetti, L., & Castillo, C. (2006). The distribution of PageRank follows a power-law only for particular values of the dam** factor. In Proceedings of the 15th International Conference on World Wide Web (pp. 941–942). New York: ACM.

    Chapter  Google Scholar 

  6. Bianchini, M., Gori, M., & Scarselli, F. (2005). Inside pagerank. ACM Transactions on Internet Technology, 5(1), 92–128.

    Article  Google Scholar 

  7. Bosch, A., Bogers, T., & Kunder, M. (2016). Estimating search engine index size variability: A 9-year longitudinal study. Scientometrics, 107(2), 839–856.

    Article  Google Scholar 

  8. Brin, S., & Page, L. (1998). The anatomy of a large-scale hypertextual web search engine. Computer Networks and ISDN Systems, 30(1), 107–117.

    Article  Google Scholar 

  9. Broder, A. Z., Kumar, R., Maghoul, F., Raghavan, P., Rajagopalan, S., Stata, R., et al. (2000). Graph structure in the web. Computer Networks, 33(1–6), 309–320.

    Article  Google Scholar 

  10. Chen, F., Chen, Z., Wang, X., & Yuan, Z. (2008). The average path length of scale free networks. Communications in Nonlinear Science and Numerical Simulation, 13(7), 1405–1410.

    Article  Google Scholar 

  11. Conklin, J. (1987). Hypertext: A survey and introduction. Computer, 20(9), 17–41.

    Article  Google Scholar 

  12. Franceschet, M. (2011). PageRank: Standing on the shoulders of giants. Communications of the ACM, 54(6), 92–101.

    Article  Google Scholar 

  13. Gray, M. (1995). Measuring the growth of the web: June 1993 to June 1995. http://www.mit.edu/people/mkgray/growth

  14. Kleinberg, J. M., Kumar, R., Raghavan, P., Rajagopalan, S., & Tomkins, A. S. (1999). The web as a graph: Measurements, models, and methods (pp. 1–17). Berlin: Springer.

    Google Scholar 

  15. Kuhn, T. (1962). The structure of scientific revolutions. Chicago: University of Chicago Press.

    Google Scholar 

  16. Langville, A. N., & Meyer, C. D. (2006) Google’s PageRank and beyond: The science of search engine rankings. Princeton: Princeton University Press.

    Google Scholar 

  17. Leontief, W. W. (1941). Structure of American economy, 1919–1929. Cambridge: Harvard University Press.

    Google Scholar 

  18. Milgram, S. (1967). The small world problem. Psychology Today, 1, 61–67.

    Google Scholar 

  19. Newman, M. E. J. (2003). The structure and function of complex networks. SIAM Review, 45(2), 167–256.

    Article  Google Scholar 

  20. Pagani, G. A., & Aiello, M. (2013). The power grid as a complex network: A survey. Physica A: Statistical Mechanics and Its Applications, 392(1), 2688–2700.

    Article  Google Scholar 

  21. Pinski, G., & Narin, F. (1976). Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics. Information Processing & Management, 12(5), 297–312.

    Article  Google Scholar 

  22. Saltzer, J. H., Reed, D. P., & Clark, D. D. (1984). End-to-end arguments in system design. ACM Transactions on Computer Systems, 2(4), 277–288.

    Article  Google Scholar 

  23. Seeley, J. R. (1949). The net of reciprocal influence. A problem in treating sociometric data. Canadian Journal of Experimental Psychology, 3, 234.

    Article  Google Scholar 

  24. Travers, J., & Milgram, S. (1969). An experimental study of the small world problem. Sociometry, 32(4), 425–443.

    Article  Google Scholar 

  25. Vise, D. (2007). The Google story. Strategic Direction, 23(10), 192–199.

    Article  Google Scholar 

  26. Watts, D. J., & Strogatz, S. H. (1998). Collective dynamics of ‘small-world’ networks. Nature, 393(6684), 440–442.

    Article  Google Scholar 

  27. Zimmermann, H. (1980). OSI reference model–The ISO model of architecture for open systems interconnection. IEEE Transactions on communications, 28(4), 425–432.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Aiello, M. (2018). The Self-Organizing Web. In: The Web Was Done by Amateurs. Springer, Cham. https://doi.org/10.1007/978-3-319-90008-7_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-90008-7_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-90007-0

  • Online ISBN: 978-3-319-90008-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation