Blog
Crawl Budget
2 posts
Filter by topic: Crawl Budget
Crawl Budget Optimization for Large Sites
How to find where Googlebot wastes its time on a large site, cut the waste, and verify that the pages you care about actually get indexed.
What Is Crawl Budget (and When It's Actually a Problem)
What crawl budget is, the thresholds Google itself publishes, and how to tell whether it explains your unindexed pages or something else does.
