What If My Website Blocks Crawlers?
Some websites intentionally restrict automated access.
Some websites intentionally restrict automated access.
This is common and does not necessarily indicate a problem.
Examples Of Systems That May Affect Evaluation
Examples include:
- Firewalls
- Bot-management platforms
- Security gateways
- Rate-limiting systems
- Web application security controls
What Happens If Access Is Blocked?
MarketingStride evaluates the content it can access.
If access restrictions prevent evaluation, some pages may not be included within the results.