It doesn't even make sense to crawl this way. It's just destructive for almost n... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		msgodel 6 months ago \| parent \| context \| favorite \| on: It seems like the AI crawlers learned how to solve... It doesn't even make sense to crawl this way. It's just destructive for almost no beinifit.

barbazoo 6 months ago | [–]

Maybe they assume there'll be only one winner and think, "what if this gives me an edge over the others". And money is no object. Imagine if they cared about "the web".

logicprog 6 months ago | [–]

That's what's annoying and confusing about it to me.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact