Crawling and Indexing

Improving Indexation

Whenever users type a query, Google searches through its index (a massive database of all web pages) and retrieves the most valuable content.
Read more
XML Sitemaps

XML sitemaps are a powerful tool in your SEO toolbox. This article explains everything you need to know about sitemaps
Read more
Indexed, though blocked by robots.txt

Learn how to fix all the problems that could cause the Indexed, though blocked by robots.txt status in the Google Search Console in our detailed guide. Plus, make sure Google doesn’t index your private pages!
Read more
Robots.txt file

Use a robots.txt file to instruct search engine crawlers which pages to crawl, and which to ignore. A small mistake in a robots.txt file can have big effects.
Read more
Search Console Crawl Stats Report

Fix your crawl, and everything else becomes a breeze. Discover how to use the Search Console Crawl Stats report like a pro and troubleshoot issues!
Read more
Noindex tags

Even though Google’s bots constantly crawl the internet, that doesn’t mean they have to crawl and index every page on your website.
Read more
Redirects

301, 302, 307... It’s time to demystify all the main redirect types in SEO! Learn everything you need to know in our redirect guide.
Read more
Crawl budget

Don’t waste your crawl budget! Learn the top strategies for getting your pages indexed and ranking faster.
Read more
Removing Pages from Google and Bing

Removing pages from Google and Bing is easy, but it's important to follow the right steps. This article tells you how to remove content from search engines.
Read more
Google Coverage Statuses

Get indexed & get rankings! Learn everything you need to know about the 20 Google Coverage Statuses (and how to fix them)
Read more