What is the best way to block the Facebook bot when it doesn't recognise robots.txt
It appears to be an aggressive bot and has been hitting our server resources a lot recently.
I've added their IP subnets to the 'Banned IP addresses' in the ACP for now but not sure if this is the best way to go about it.
If Mark Z'berg wants to use our content he can pay for it lol
Continue reading...
It appears to be an aggressive bot and has been hitting our server resources a lot recently.
I've added their IP subnets to the 'Banned IP addresses' in the ACP for now but not sure if this is the best way to go about it.
If Mark Z'berg wants to use our content he can pay for it lol
Continue reading...