Comment Re:News flash, subtext (Score 2) 33
AI scrapers use these residential proxies. It's not (just) VPNs and Tor routing. Several bottom-feeding companies openly advertise such scraping services, for pretty much any country you may want. I administer a wiki that's been on the receiving end of such scraping, and the majority of these scraping requests are in fact coming from residential IP-addresses rather than data centers.
I don't know whether these are hacked accounts, people getting tricked or paid to run these scraping apps on their devices, but it's impossible to block them all. Even if you let fail2ban block entire
Anubis seems to be taking care of it for now, but it's obviously only a matter of time before they can deal with that one too. Although its delay does enable fail2ban rules to block the IP-addresses before they get to stress the mediawiki php scripts, attempting to diff 2 revisions of a random page from 10 years ago.