Abstract
This chapter covers crawling and indexing. This is where SEO begins. Search engine robots need to crawl a website's pages to find all the information contained on those pages. Once crawled, robots then process and store the information from the website in the search engine's index. If robots are unable to crawl or index a website's pages, the website may not rank in search results. Achieving optimal SEO performance requires understanding how search engine robots work and ensuring that robots are able to crawl and index a website effectively.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature
About this chapter
Cite this chapter
Edgar, M. (2023). Crawling and Indexing. In: Tech SEO Guide. Apress, Berkeley, CA. https://doi.org/10.1007/978-1-4842-9054-5_1
Download citation
DOI: https://doi.org/10.1007/978-1-4842-9054-5_1
Published:
Publisher Name: Apress, Berkeley, CA
Print ISBN: 978-1-4842-9053-8
Online ISBN: 978-1-4842-9054-5
eBook Packages: Business and ManagementBusiness and Management (R0)Apress Access Books