Hacker News

points by consumer451 1 day ago | 0 comments

A few hours after I posted this: I am so glad that r/seattle mods found this, and the HN community requested/forced a prelimiary write up [0] (sorry to Jaco_Belordi to force the write up, and to spoiled__princess who actually found this (but had to go to pottery class) + rest of team - you probably have other jobs as well :). This is the system working as intended. This is the best of the modern Internet.

Here are my suppositions and questions:

The frontier labs feel free to use the path of least resistance to acquire more data. Currently, one of those paths must be archive.today. Proof of that is that an archive.is link is posted here on HN, for any news post, right? I certainly find those links useful.

So, now that we know that archive.today is the easiest path to paywalled data, is a threat actor, and can poison training data...

1. What is their valuation?

2. Will the labs stop using them? Is it even fair to assume that they are?

3. ... ?

[0] https://www.reddit.com/r/Seattle/comments/1xhf6qp/archivetod...

[–] eyya 1 day ago

But this might be the reason: to make the archive unexciting for AI scrapers

[–] consumer451 1 day ago

I am open to chat about any of this. Threat modeling is complex.

But, injecting malware to scuttle their own incredibly popular network would benefit them how?

[–] eyya 1 day ago

Its incredible popularity has long since led to the emergence of virtually unsolvable CAPTCHAs, designed to reduce this level.

So far, the only benefits of this popularity are the AI crawlers which cause the site to run intermittently (same issue this year with archive.org and commoncrawl) plus Finnish doxxers and fake child-porn fighters trying to shut it down.

[–] consumer451 1 day ago

OK, but what if they track all of who watches what. Isn't that the entire Facebook model? Metadata is extremely valuable. That's just facts, right? And, they are literally doing that.

Next, IIRC, one DNS provider stopped working with them for insane privacy reasons? [0]

Now, tinfoil hat time: what about the AI labs using them for training data, and it getting steered one way or another now that we know for a fact that archive is not reliable?

[0] It is Cloudflare due to EDNS Client Subnet (ECS) privacy, right?

[–] eyya 1 day ago

You have to hang out on Epstein Island to find buyers for metadata. Have you heard of any small indie projects with this kind of business model? Maybe PirateBay, Sci-Hub, Flibusta? I haven't. That's why I'm sure CloudFlare is selling your metadata (and not just that), but the archive isn't. Simply because it doesn’t fly that high. Banners, pop-unders, pop-ups—what people here like to call “malware”—yes, that’s it. Just a normal pirate website with too many too cheap visitors and an unpassable captcha and a pop-under as the result.

[–] consumer451 1 day ago

What makes you think that archive.today is any kind of indie project?

Isn't just the scale of cost indicative that is not aligned with anything close to indie?

[–] eyya 1 day ago

comparable to the 3 websites mentioned