Bug Not all bots are being detected

[ivp]

XF\Data\Robot::getRobotUserAgents() detects 35 bots only.

This function should be replaced with CrawlerDetect or similar library, which detects 1,000's of bots/spiders/crawlers:

GitHub - JayBizzle/Crawler-Detect: 🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent ​

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent - JayBizzle/Crawler-Detect

github.com

Here is the example for one thread:

• Internal XenForo counter reports 519 views.
• In server logs seeing 903 requests. After manually removing bots from the list, there are 355 views.
• Google Analytics reports 167 views.

Continue reading...