SEO nerds rejoice! As of June 2021, Shopify merchants now can edit the default robots.txt file. This allows great control over how your website is crawled.
Code snippet and full guide can be found here:
https://logeix.com/shopify-robots-txt/
Get my 288 page Shopify SEO eBook (FREE):
https://logeix.com/shopify-seo/
Want me to review your website?
https://onpageteardown.com/
Hire my team and I to do this for you:
https://logeix.com/
Timestamps:
00:00 Good news, everyone!
00:15 The problem
01:50 Save crawl budget with robots.txt
02:47 Editing your robots.txt
03:44 A Very Important Reminder
04:13 /collections/all
05:14 /collections/vendors?q= and /types?q=
06:37 Product Tags
07:24 Blog Tags
07:59 Summary (& some precautions)
09:55 Conclusion
Music provided by Chillhop Music: https://chillhop.ffm.to/
