This can only end badly.

New neighbors to the south.  HOUSE sold for 560,000, 200 sqft bigger than ours.

Interest on 560000-  20000 per year, principal 17000 per year taxes 8000 per year.   total  45,000 per year  or 4k per month.

I predict they will sell children to keep their home-  4 kids.