Upgrade from 64GB to 128GB memory?

Does it make any sense to upgrade to 128GB from 64GB? I'm at 64GB (32GBx2) DDR5 with 2 open slots. I'm not really doing anything other than modern gaming. Would upgrading from 64GB to 128GB make any practical difference in modern games?
System is a Gigabyte X670E, Ryzen 9 7900X CPU, and RX 7900XTX GPU.