Does defending Musk's salute make someone a Nazi (or at least morally awful)?

Someone on my forum said that he didn't think Musk's salute was alluding to the Nazi salute. I banned him and didn't give a reason and have no intention of letting him ever come back because I believe he is a Nazi. Even if he didn't break the rules of my forum, I don't think I have any reason to follow those rules and I should be able to ban him for being a Nazi. I don't think you should give these people an inch and it's okay to bend the rules to get rid of these people?

What do you think?

Edit: he tried to message me after saying he doesn't support Nazism, that he just doesn't think it was a Nazi salute and it's just propaganda to make everyone believe it was. So I muted him from messaging.