That's very true for the south. Yet, the north still got on and did even better than the south.

Never the less, you can go to any other place which didn't have slaves and they still got on without income taxes.

And, if you go to parts of the middle east where slavery exists today, income taxes have not prevented it, so it's beside the point.