Portal | Homepage | Blog

SEO Tools bots being blocked?


#1

I am finding that my SEO tools bots are not being able to crawl my site. The robots txt. looks like they should be allowed. What other reason could be causing this?

Thanks


#2

Usually, Chris, it’s because the robot is being abusive, i.e., they’re not respecting the rate limit directive in robots.txt.

Please open a ticket so we can investigate further. It would be best to supply the IP or IPs of the bots that are being blocked.