This is exactly the thinking that has characterized responses to new sources of power through history, and has been consistently used to excuse hoarding of that power. In the end, enlightenment thinking has largely won out in the western world, and society has prospered as a result.
Centralizing power is dangerous and leads to power struggles and instability.
Yes there is. Lots of researchers are more interested in making a contribution to societal flourishing than in making incredible sums of money. That’s why there’s still lots of top AI researchers in academia.
llms.txt files have nothing to do with crawlers or big LLM companies. They are for individual client agents to use. I have my clients set up to always use them when they’re available, and since I did that they’ve been way faster and more token efficient when using sites that have llms.txt files.
So I can absolutely assure you that LLM clients are reading them, because I use that myself every day.
From your website, it seems to me that LLMs.txt is addressed to all LLMs such as Claude, not just 'individual client agents' . Claude never touched LLMs.txt on my servers, hence the confusion.
> I don’t know how to trust the author if stuff like this is wrong.
She's not wrong.
A good way to do this calculation is with the log-ratio, a centered measure of proportional difference. It's symmetric, and widely used in economics and statistics for exactly this reason. I.e:
so if the numbers were “99% slower than without AI but they thought they would be 99% fast”, you’d call that “they were 529% slower”, even though it doesn’t make sense to be more than 100% slower? And you’d not only expect everyone to understand that, but you really think it’s more likely a random person on the internet used a logarithmic scale than they just did bad math?
No, your job is to help your reader get to the end of the text. That means writing in a way that most of your audience finds compelling, readable, and not intimidating.
Not all readers are the same, so you will fail at your job for some readers.
But few readers are emotionless automatons that need nothing but dry technical content, unless it’s a topic they are very motivated to understand.
> That means writing in a way that most of your audience finds compelling, readable, and not intimidating.
I would agree with that. And I think emojis and unnecessary reassurances subvert that goal. It's fluff, it's more to read, and if the writing isn't already clear, they don't fix the problem.
> But few readers are emotionless automatons that need nothing but dry technical content
Nothing in my post argues for dry technical content.
Bartosz Ciechanowski's superb work, which may have inspired the author, gets the balance just right without any hand-holding asides:
This is not due to slowness of the file system. Native ntfs tools are much faster than Unix ones in some situations. The issue is that running Unix software on windows will naturally have a performance impact. You see the same thing in reverse using Wine on Linux. Windows uses a different design for IO so requires software to be written with that design in mind.
> Native ntfs tools are much faster than Unix ones in some situations. The issue is that running Unix software on windows will naturally have a performance impact. You see the same thing in reverse using Wine on Linux.
Not true. There are increasingly more cases where Windows software, written with Windows in mind and only tested on Windows, performs better atop Wine.
Sure, there are interface incompatibilities that naturally create performance penalties, but a lot of stuff maps 1:1, and Windows was historically designed to support multiple user-space ABIs; Win32 calls are broken down into native kernel calls by kernel32, advapi32, etc., for example, similar to how libc works on Unix-like operating systems.
It's pretty typical these days for software, particularly games of the DX9-11 eras to perform better on Wine/Proton then they do under native Windows on the same hardware.
Obviously what matters is how much of the world’s products they produce - especially products that require high energy input. I can’t imagine why you think per capita is the appropriate statistic to compare.
This has already been pointed out to you in this discussion, so it seems you are not actually engaging with the information you’re being provided with for some reason.
Centralizing power is dangerous and leads to power struggles and instability.
reply