Hacker News
News Outlets Block Internet Archive — 340+ Local Papers Limit Access to Their Journalism
More than 340 local news outlets are restricting the Internet Archive's ability to archive their content, according to Nieman Lab. The move, driven by concerns about AI training data scraping and revenue loss, hit 323 points and 122 comments on HN. For AI builders, this is another signal that the open web — the foundation training data was built on — is closing. Web scraping pipelines, RAG systems, and research tools that depend on archival access will need to adapt.
↳ Follow the thread