I've lived where I live for 18 years. I've been in my current job less than a year. Does that justify pulling my kids out of school just before they do their exams so I can move house?
Where you live is not a simple choice for many of us. History of previous jobs, family commitments, schools, house prices, etc., etc... Like lots of things, it's a compromise.
Then cities need to invest into noise reduction, pollution reduction, etc. Maybe it's not that people don't value their time, but rather value not walking streets which smell like trash.