Can I live where I want?

I currently live in the pink tent but when I get my real house, I want to live across the river to the left. However, I’ve done some research and it seems I can’t get the first bridge until I’ve built my house already. Is there any way to avoid the 30,000🔔 fee to move my house and still live across the river?