Might I suggest an insightful seminar for anyone curious about why gradient descent is even tractable in such high dimensions:

Stanford Seminar - A Picture of the Prediction Space of Deep Networks by Pratik Chadhari:

https://youtu.be/ZD2cL-QoI5g?si=hVFU5_4CeoLYtyuB