List of search engine crawlers excluded by the app

By default, the app automatically excludes Google bots and several other bots from the redirection. This feature ensures optimal website indexing and allows Google to accurately crawl and index all versions of your store.

Here are the list of bots available in the app's script.

Category	Bot Names
Google Bots	googlebot, www.google.com, googlebot-mobile, googlebot-image, googlebot-news, googlebot-video, google-adwords-instant, appengine-google, google-search-console, google-shopping-quality, google web preview analytics, storebot-google, googleweblight, google favicon, duplexweb-google, google-read-aloud, adsbot-google-mobile-apps, apis-google, google-inspectiontool, google-cloudvertexbot, google-extended, googleproducer, google-speakr, google search console, google-safety, google-cws, google-agent, googlemessages, google-notebooklm, google-pinpoint, google-producer, google-amp-cache-request, feedfetcher, googlebot-discovery
Google Ads Bots	adsbot-google, adsbot-google-mobile, mediapartners-google
Google Feeds & Preview	feedfetcher-google, google web preview, googleother-image, googleother-video, googleother
AI Crawlers	GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, PerplexityBot, MistralAI-User, Cohere-AI, meta-externalagent, meta-webindexer, meta-externalfetcher, meta-externalads, Applebot-Extended, Bytespider, Diffbot, ICC-Crawler, YouBot
AI User Fetchers	ChatGPT-User, Claude-User, Perplexity-User
Search Engine Crawlers	Amazonbot, DuckAssistBot, PetalBot
SEO / Analytics Crawlers	AhrefsBot, SemrushBot, MJ12bot, CCBot, SerpstatBot, BLEXBot, DotBot
Gemini Deep Research	gemini-deep-research
Social Media Bots	facebookexternalhit, Twitterbot, LinkedInBot, Pinterestbot, Slackbot, Discordbot, SkypeUriPreview
Apple Bot	applebot
Bing Bot	bingbot
Yandex Bot	yandexbot
DuckDuckGo Bot	duckduckbot
Baidu Bot	baiduspider
Yahoo Bot	slurp
Google Inspection Tools	google-inspectiontool, google-site-verification
Google Automation Tools	chrome-lighthouse
MSN Bot	msnbot
Open-source Crawlers	Nutch

If you are using a service for your website that uses a specific bot, please let us know by dropping us an email at [email protected].

Here is a quick video of Bots testing: