When is this socially acceptable?

I’m currently TH12 and am stuck just upgrading walls which is taking forever. At what point is it not rushing for me to start the TH upgrade?