Is Poughkeepsie really that bad?

Fiancee and I are looking to move from northern NJ to Dutchess county. I am from NJ and he is from Putnam county. We are childfree and white collar professionals with a combined income of 300k a year. We feel we can get a lot more house for our money in Dutchess and want to be close to his elderly parents. Problem is I’m not loving the inventory I see online. I do see some gorgeous old Victorians in Poughkeepsie but he refuses to even look as he said it’s a terrible area. Can I please have some honest feedback thoughts and opinions on this? Thank you.