Reddit is killing RSS feeds and ending public API access because of AI bots
Reddit ends RSS on November 13 and public API access in March 2027, restricts Old Reddit to logged-in users, citing large-scale scraping and abuse.
Web scraping
Published entries across all sections carrying the “Web scraping” tag, newest first by publication date on this site.
2 entries
AnyCrawl: A Web Scraping Toolkit That Turns Pages into LLM-Ready Data
A self-hostable, TypeScript web scraping toolkit that covers everything from static pages to JS-rendered pages across three engines, with bulk search-result collection, full-site crawling, and LLM structured extraction, all outputting LLM-friendly data.