How to check whether AI crawlers can access your website
Audit one public URL against the applicable robots.txt group, then verify that the delivery layer permits the request.
Source-reviewed field guides
Practical guides for URLs, campaigns, and crawlers
Practical reading for crawler policy, campaign attribution, and URL changes—grouped by the job you need to do, rather than whichever keyword looked busiest this week.
At a glance
Five live guides, each paired with the tool that puts it into practice. Dates show the latest source review or modification available in the published guide.
Field guide collection
AI crawler policy
Separate crawl permission from search visibility, training use, and user-triggered retrieval.
GPTBot vs OAI-SearchBot vs ChatGPT-User
Choose the correct OpenAI user agent for ChatGPT search, potential training collection, or a user-requested visit.
Field guide collection
Campaign tracking
Build links that produce consistent GA4 dimensions before reports acquire a personality of their own.
A GA4 UTM naming convention that stays clean
Set one durable rule for UTM fields, casing, separators, ownership, and inbound-link tagging across the team.
How to track QR codes in GA4 without fooling yourself
Plan a tagged destination and editable redirect, test the printed code, and distinguish scans from visits and key events.
Field guide collection
URL and Shopify safety
Change public addresses only when the benefit survives contact with redirects, imports, and existing traffic.
Shopify хендъли на кирилица: безопасна смяна без загуба на SEO
Review Bulgarian-to-Latin handle suggestions, resolve duplicates, and verify Shopify redirects before changing a live catalogue.