I have experienced in everyday life with very large forums (hundreds of thousands of threads in a node) or even 100 thousand entries in the RM. that the pagination is very very slow. It seems to be an OFFSETT problem.
Sure - now you could argue about who already clicks on page XXXXXXXX. But just because few do it doesn't make this problem better.
Especially since Crawler belongs to those who go through all pages.
Which is not only bad for my resources but also for the rating of the crawler.
Continue reading...
Sure - now you could argue about who already clicks on page XXXXXXXX. But just because few do it doesn't make this problem better.
Especially since Crawler belongs to those who go through all pages.
Which is not only bad for my resources but also for the rating of the crawler.
Continue reading...