The Core

Why We Are Here => Traffic => Topic started by: BoL on March 16, 2022, 05:07:42 PM

Title: Has anyone seen a brave-like bot in their logs?
Post by: BoL on March 16, 2022, 05:07:42 PM
Grepped a couple of very small sites I have and can't see it. Has anyone else seen it and could share their UA/IP? Cheers
Title: Re: Has anyone seen a brave-like bot in their logs?
Post by: Brad on March 17, 2022, 12:15:32 PM
I just checked and don't see anything from Brave on either my blog or the directory.

Huawei (looks like a bot) has been real busy on the blog.  Yandex bot has been very busy on both.
Title: Re: Has anyone seen a brave-like bot in their logs?
Post by: BoL on March 23, 2022, 05:57:48 PM
Cheers Brad

Just wondering given their claim of crawling 40M URLs a day but their UA is not obvious
https://www.reddit.com/r/BATProject/comments/o68v4c/is_there_more_info_on_the_spider_bot_brave_uses/h2ri3vo/

That's a lot of crawling so I'm assuming they're not using a unique UA. At the moment I'm thinking the mimic a Chrome UA and see them from Hetzner IPs from the 5.116/16 range