What is crawl budget?
Crawl budget is how many pages a search engine is willing and able to crawl on your site in a given time. It mostly matters for very large sites.
Crawl budget describes how much time and effort a search engine spends crawling a website. It depends on how fast your server responds and how much the search engine wants to crawl your pages. Google says most sites with fewer than a few thousand pages do not need to worry about it. Large sites with many changing pages, like big online stores, can run into limits.
Why it matters for your business: For most small businesses, crawl budget is not a concern. It becomes worth watching only if your site has many thousands of pages and new ones are slow to appear in search.
Related articles
More in Glossary
Still need help?
Ask our team