In public wikis it seems to happen often that Crawlers get stuck in Special:BrowseData trying to access all possible variations of available Filters.
While is may be a reason to solve this with generic solutions like CrawlerProtection and/or Lockdown I want to open this issue in order to discuss whether there are mechanisms that can be implemented in this extension to avoid this.
In public wikis it seems to happen often that Crawlers get stuck in Special:BrowseData trying to access all possible variations of available Filters.
While is may be a reason to solve this with generic solutions like CrawlerProtection and/or Lockdown I want to open this issue in order to discuss whether there are mechanisms that can be implemented in this extension to avoid this.