There's so much low hanging fruit in that "enable people to build their own personalized llm things" niche.

For instance, I keep looking at the recent llama.cpp/transformers custom grammar support, and think "wow, this is amazing, and everyone is going to use it..." But they still aren't using it! Its just some very thin middleware away from exploding in use for all sorts of niches, I think.

And thats just one random example.