How to set up Shopify crawl signatures

Learn how to set up Shopify crawl signatures in SiteGuru to authenticate your crawler, unlock faster crawl speeds, and reduce rate limiting.

On this page
  1. What are Shopify crawl signatures?
  2. What changes when you add a signature?
  3. Step 1: Create a signature in Shopify
  4. Step 2: Add the signature to SiteGuru
  5. Signature expiry
  6. Troubleshooting

What are Shopify crawl signatures?

Shopify uses a system called Web Bot Auth to let you authorize crawlers to access your online store. By generating a cryptographic signature in your Shopify admin and adding it to SiteGuru, you authenticate SiteGuru's crawler so Shopify knows it's authorized by you.

Without a signature, Shopify may rate-limit SiteGuru's requests, which slows down your audits and can cause incomplete results.

What changes when you add a signature?

  • Faster crawl speeds - the "Fast" crawl speed option becomes available for your site.
  • Fewer errors - your audits are less likely to be interrupted by rate limiting.
  • More reliable results - pages are checked without delays, giving you a complete picture of your site.

Step 1: Create a signature in Shopify

  1. In your Shopify admin, go to Online Store > Preferences.
  2. In the Crawler access section, click Create signature.
  3. Enter a name (e.g. "SiteGuru").
  4. Select the domain that matches the site you've added to SiteGuru.
  5. Choose an expiration period (maximum 3 months).
  6. Click Create.
  7. Copy the Signature and Signature-Input values.

Each signature is scoped to a specific domain. If your Shopify store has multiple domains, create a signature for the one connected to SiteGuru.

Step 2: Add the signature to SiteGuru

  1. In SiteGuru, go to Site Settings for your Shopify site.
  2. Scroll down to the Shopify crawl signature section.
  3. Paste the Signature value into the Signature field.
  4. Paste the Signature-Input value into the Signature-Input field.
  5. Click Save.

Once saved, SiteGuru will include these headers in all requests to your Shopify store.

Signature expiry

Shopify signatures expire after the period you selected (maximum 3 months). Expired signatures cannot be renewed. You need to create a new signature in your Shopify admin and update it in SiteGuru.

SiteGuru will warn you when your signature is about to expire or has expired.

Troubleshooting

  • Still getting rate-limited after adding a signature? Make sure you created the signature for the correct domain in Shopify. The domain must match the one connected to your SiteGuru site.
  • Signature fields not showing? The signature fields only appear for sites that SiteGuru has detected as Shopify stores.
  • "Fast" crawl speed still locked? Make sure both the Signature and Signature-Input fields are filled in and saved.

For more details on how Shopify's crawler authentication works, see Shopify's documentation on crawling your store.

Ready to improve your website?

Get a free, actionable SEO report in just 5 minutes. Start improving your website today.

Start free trial

Keep learning

More in SEO Playbooks

All topics

SEO Fundamentals10
On-page optimization11
Technical SEO8
Crawling and Indexing10
URLs and SEO6
Pagespeed and SEO9
Keywords8
Links7
Off-page SEO4
International SEO4
Ecommerce SEO6
Google updates and trends5
Content marketing5
Strategic SEO7
Analytics and SEO Reporting6
SEO Playbooks13
More SEO resources4
SEO and AI3
SiteGuru Automations4