Hacker News
points by trollbridge 2 days ago | 0 comments
I currently tarpit traffic from AWS, Azure, GCP, etc. since it's not like any of my real customers have their PC inside those networks. (I then use that for experiments with providing bogus data to AI scrapers.)

Doesn't do much to help with the "VPN that uses random consumer PCs and phones" traffic.

[–] xmcp123 2 days ago
How do you tarpit GCP if Google’s search engine scrapers scrape from their own cloud?
[–] trollbridge 2 days ago
Google’s scrapers very explicitly identify themselves and come from unique netblocks.

Most our sites don’t need to be in Google anyway.