Hacker News
points by xmcp123 2 days ago | 0 comments
How do you tarpit GCP if Google’s search engine scrapers scrape from their own cloud?
[–] trollbridge 2 days ago
Google’s scrapers very explicitly identify themselves and come from unique netblocks.

Most our sites don’t need to be in Google anyway.

Hacker News