Territory

I just got the game and was playing a bit before work, some other faction has taken almost every region but isn’t building, just sending mercenaries all over from the map borders and I’m still not even a medium village yet, is that normal or am I dead before I’ve even started?