> Okay, but is that because brains are just better at optimization of linear algebra? Or is quantum mechanics involved?
No such magic.
The average ML neuron is connected in layers to maybe 100 other neurons. The brain is connected to far more ~1000 -10000 So its the dense interconnectivity at play. Whatever successes we have had with LLM now is because we are increasing the parameters of the network (although we haven't similarly scaled connectivity if I am not wrong, but definitely making progress there - for e.g. Pathways networks from Google by Jeff Dean et. al)
No such magic.
The average ML neuron is connected in layers to maybe 100 other neurons. The brain is connected to far more ~1000 -10000 So its the dense interconnectivity at play. Whatever successes we have had with LLM now is because we are increasing the parameters of the network (although we haven't similarly scaled connectivity if I am not wrong, but definitely making progress there - for e.g. Pathways networks from Google by Jeff Dean et. al)