It’s robots.txt with less precision. But like we all were shown recently, scraping can’t be stopped. Even when it’s actively legally protected by corporations that have the resources to enforce. So any “good actors are expected to abide” proposals are completely useless and worse they give false impression that it achieves anything.
It’s
robots.txtwith less precision. But like we all were shown recently, scraping can’t be stopped. Even when it’s actively legally protected by corporations that have the resources to enforce. So any “good actors are expected to abide” proposals are completely useless and worse they give false impression that it achieves anything.