Protéger Mastodon contre les bots IA avec Anubis – Techno-Fil et faits divers
Anubis is a new solution designed to protect websites from AI bots that scrape content. It employs a Proof-of-Work scheme to make scraping more expensive for mass operations while allowing legitimate users to access the site. The system is still evolving, with future plans to improve identification of headless browsers without inconveniencing real users.
- ▪Anubis protects websites against AI companies that scrape content.
- ▪It uses a Proof-of-Work scheme similar to Hashcash to deter mass scraping.
- ▪The solution requires modern JavaScript features, which may conflict with certain plugins.
Opening excerpt (first ~120 words) tap to expand
Making sure you're not a bot! Loading...You are seeing this because the administrator of this website has set up Anubis to protect the server against the scourge of AI companies aggressively scraping websites. This can and does cause downtime for the websites, which makes their resources inaccessible for everyone.Anubis is a compromise. Anubis uses a Proof-of-Work scheme in the vein of Hashcash, a proposed proof-of-work scheme for reducing email spam. The idea is that at individual scales the additional load is ignorable, but at mass scraper levels it adds up and makes scraping much more expensive.Ultimately, this is a placeholder solution so that more time can be spent on fingerprinting and identifying headless browsers (EG: via how they do font rendering) so that the challenge proof of…
Excerpt limited to ~120 words for fair-use compliance. The full article is at Gayfr.
Discussion
0 commentsMore from Gayfr
