Hacker News new | past | comments | ask | show | jobs | submit login

yes only big conglomerates now can scrape pages. If you're not google stealing the info then...... Right?



I didn't say that but a site owner should have the right to decide.

In addition, this scraper doesn't even identify itself (I checked). It pretends to be a normal browser, without saying it's a scraper.


I think a website owner can decide. They can take the site down, or they can put it behind some kind of user wall.




Consider applying for YC's Summer 2025 batch! Applications are open till May 13

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: