Yes, this is called Professional Liability or Errors & Omissions insurance. It's an important insurance category, but limited in market size. It's uncommon to have e.g. human sales representatives covered for this, but your doctor, lawyer, accountant, architect, etc. will all carry this kind of insurance.
The key bit is why those niches have it: typically either regulators require it or clients require it (sometimes specifying it to a given value in their contract). And that's because the consequences of mistakes some professions make can be very expensive relative to the size of their business. Also helps that a lot of the errors they cover are very rare so pooling the risk as insurance makes more sense...
cf an airline chatbot agreeing to an inappropriate refund or giving wrong advice that leaves the airline deciding to apologise and pay their holiday-related expenses. Those are costs it makes more sense for the airline to eat than get their insurers to price up (unlike other aviation insurance which can be for eye-wateringly large sums) even if it happens several times a month (which if your chatbot is an LLM supposed to handle a wide variety of questions it probably does). Same goes for the human sales representatives who may work with higher-stakes relationships than chatbots but the consequence of their error is usually not much bigger than issue refund or lose client relationship
I guess chatbots/LLMs will end up as a special case for professional indemnity insurance in a lot of those regulated firms as lawyers/accountants start to use them in certain contexts.
Yes. I would say it probably makes more sense that whoever designed the chatbot system for the airline will need indemnity insurance. Then the airline has somewhere to go if it starts giving out free plane tickets willy nilly.
Good point about risk versus pool size. An airline can "self"-insure if it's a common error, since there's no uncertainty as to whether it will happen in any given month. Insurance can't magically make it cost them less, and there's very little risk in covering the costs themselves. With a high-cost possibility that's rare, they can't tie up the huge sum of money for something that will probably never happen to themselves, so insurance is superior.
I carried E&O for years as an independent consultant. I fortunately never had to use it, but I have peers whose financial future was probably saved by having it.
I worked in this market for a few years. It was fascinating. I still have some ACORD documentation from that. I learned very quickly that standards aren’t. :)
