getting rid of a lot in the lakes of the north

we inherited a lot in lakes of the north and have paid on it for years. turns out now no one want the thing so we have all taxes paid up and it is just a parasite on our budgets. so it looks like the land up there is of no real value and from what i see most lots go for 1 to 2k so i found out the county and state will not slam us with a credit hit but can any one tell me if the association will slam us with one if we just stop paying for this and let it go back.