AI bots strain Wikimedia as bandwidth surges 50% - Ars Technica

[rcjordan]

>incognito

Happens to my when not using incognito. Here's what I'm running.

[rcjordan]

I doubt many of the average retail users will trip it.

[rcjordan]

"Bro, ban me at the IP level if you don't like me!" - The Boston Diaries - Captain Napalm

https://boston.conman.org/2025/08/21.1

[ergophobe]

I think Privacy Badger, uBlock Origin and Ad Nauseum might all trip up Cloudflare.

If you think about it, most bot crawlers are not going to be able to handle third-party cookies, so that's a signal to Cloudflare.

I have noticed for the last few years I have spikes where I exceed CPU usage limits despite not having a huge number of page views. I know it's bots, but I wonder how much is just your old school probes and how much is AI crawlers.

I use CF for many sites, but not all since sometimes it caused an issue here or there... but I can't remember what

[rcjordan]

stolen from bsky;

[Rumbas]

Amen. These AI bots are going nuts atm. 2.7M requests on one site in a week.

[ergophobe]

Finally went into Cloudflare and turned on
 - AI Labyrinth on non-revenue sites
 - Block AI Crawlers on all sites
 - Bot Fight Mode on all sites

It's kind of astounding what CF offers for free if you have a low-traffic site (or, in my case, several which are in some cases just parked domains now but which can still get blasted by bots)