Can’t change anything else, should I still change social security sex?

So I can’t change my birth certificate, my passport, or my marriage certificate, but my drivers license already says my correct gender. I have an appointment with social security to change my sex before the govt outlaws that too, and I don’t want to back down and comply in advance if I can still do this. I’m just wondering what the implications would be to just have my drivers license and social security listed as my correct gender and nothing else. Would this cause me problems?