C
CrowdSec•9mo ago
bbuddha

PR rdns_seo_bots.txt

Hello, since I don't know where to find the right file to make a PR, I'll do it here. https://hub-data.crowdsec.net/whitelists/benign_bots/search_engine_crawlers/rdns_seo_bots.txt before 
.googlebot.com.
.yandex.ru.
.yandex.net.
.yandex.com.
.search.msn.com.
.crawl.baidu.com.
.crawl.baidu.jp.
.crawl.yahoo.net.
.search.qwant.com.
.babbar.eu.
.crawl.amazonbot.amazon.
.crawl.sogou.com.
.googlebot.com.
.yandex.ru.
.yandex.net.
.yandex.com.
.search.msn.com.
.crawl.baidu.com.
.crawl.baidu.jp.
.crawl.yahoo.net.
.search.qwant.com.
.babbar.eu.
.crawl.amazonbot.amazon.
.crawl.sogou.com.
after 
.googlebot.com.
.yandex.ru.
.yandex.net.
.yandex.com.
.search.msn.com.
.crawl.baidu.com.
.crawl.baidu.jp.
.crawl.yahoo.net.
.search.qwant.com.
.babbar.eu.
.babbar.tech.
.crawl.amazonbot.amazon.
.crawl.sogou.com.
.googlebot.com.
.yandex.ru.
.yandex.net.
.yandex.com.
.search.msn.com.
.crawl.baidu.com.
.crawl.baidu.jp.
.crawl.yahoo.net.
.search.qwant.com.
.babbar.eu.
.babbar.tech.
.crawl.amazonbot.amazon.
.crawl.sogou.com.
4 Replies
CrowdSec
CrowdSec•9mo ago
Important Information
This post has been marked as resolved. If this is a mistake please press the red button below or type /unresolve
© Created By WhyAydan for CrowdSec ❤️
iiamloz
iiamloz•9mo ago
https://github.com/crowdsecurity/sec-lists
GitHub
GitHub - crowdsecurity/sec-lists: Repository to track keywords & pa...
Repository to track keywords & patterns lists used by crowdsec parsers and scenarios - crowdsecurity/sec-lists
bbuddha
bbuddhaOP•9mo ago
Thx 🤣
CrowdSec
CrowdSec•9mo ago
Resolving PR rdns_seo_bots.txt This has now been resolved. If you think this is a mistake please run /unresolve

Did you find this page helpful?