AI bots strain Wikimedia as bandwidth surges 50% - Ars Technica

Started by rcjordan, April 04, 2025, 10:12:28 PM

Previous topic - Next topic

rcjordan

>incognito

Happens to my when not using incognito. Here's what I'm running.

rcjordan


rcjordan

"Bro, ban me at the IP level if you don't like me!" - The Boston Diaries - Captain Napalm

https://boston.conman.org/2025/08/21.1

ergophobe

I think Privacy Badger, uBlock Origin and Ad Nauseum might all trip up Cloudflare.

If you think about it, most bot crawlers are not going to be able to handle third-party cookies, so that's a signal to Cloudflare.

I have noticed for the last few years I have spikes where I exceed CPU usage limits despite not having a huge number of page views. I know it's bots, but I wonder how much is just your old school probes and how much is AI crawlers.

I use CF for many sites, but not all since sometimes it caused an issue here or there... but I can't remember what

rcjordan


Rumbas

Amen. These AI bots are going nuts atm. 2.7M requests on one site in a week.

ergophobe

Finally went into Cloudflare and turned on
 - AI Labyrinth on non-revenue sites
 - Block AI Crawlers on all sites
 - Bot Fight Mode on all sites

It's kind of astounding what CF offers for free if you have a low-traffic site (or, in my case, several which are in some cases just parked domains now but which can still get blasted by bots)

rcjordan


rcjordan

There is an internal server error on Cloudflare's network.

 Internal server error Error code 500
Visit cloudflare.com for more information.
2025-11-18 13:09:02 UTC

www.theregister.com



+

Cloudflare timed out on Yeggi just prior to trying theregister link

rcjordan

Debbie said this was likely a widespread failure.  /r agreed. has meme.

that was a nice 20-minute apocalypse! : memes
https://old.reddit.com/r/memes/comments/1p0agab/that_was_a_nice_20minute_apocalypse/

rcjordan


ergophobe