I'm not sure it's all that easy though. We don't entirely know how LLMs do some of the things they do, and we can't interpret what's in them. They don't internally look up particular sources, it's just a big mess of connection weights.

Maybe my simple scheme would be all it needs. Or maybe it needs some new breakthrough and right now nobody knows how to do it. I was hoping some resident expert could let me know.