Hacker News
points by xmcp123 2 days ago | 0 comments
It is trivial to forge a Google bot user agent and scrape through GCP.
[–] DaSHacka 2 days ago
That wouldn't work if a sysadmin implemented the rDNS lookup mentioned in TFA. The PTR specifically must end in `.googlebot.com`, not `.googleusercontent.com`.
[–] xmcp123 1 day ago
No one does that though. The latency would be significant.