Adding Density Destroys Neighborhoods One House at a Time