Your opinion is not valid. Guns aren't necessarily political. Should I refrain from asking work colleagues who they think is likely to medal in the 2021 Olympics women's skeet shooting event?
Imagine your coworker talks all the time about how they love guns, how many guns they have, and how good they are at shooting. Then they talk about how they have a concealed carry permit and how it's even legal in your area for them to carry guns at work. And one time after a few happy hour beers they said that their ancestors used to shoot people like you. But not you obviously, you're a great coworker, they like you.
No direct threat. Not political. Still creepy as hell.
It depends on the tone. If their point is why the right to be armed is important for minorities and that unequal rights in this regard helped allow historic injustice, I don't think it would be creepy. It would be somewhat political though.