Nerd doesn't mean smart. Nerd refers to a particular kind of obsessive skill in a narrow field.

People with laser-like obsessions tend to have poor social skills, whether they are programmers or otakus.