I don’t think we have the data to disprove the stronger claim “societies collapse”, and I don’t think being unfair (whatever that means) makes societies collapse earlier. Did slavery hasten the fall of Rome, for example, or the Gulag the fall of the USSR?
As to “whatever that means”, I think that’s hard, if not impossible, to define objectively. Catholic dogma says the Pope is the representative of god, for example, so catholics (less so in modern times, I think) don’t question his decisions. Many would call that unfair, even if the pope would be elected 100% by merit.
I mean of course the universe has no need to be fair - that's a frankly asinine observation in the context of a discussion about social policy and resource distribution.
the universe doesn't require opposition to slavery either but I'll be bold and assume you oppose it anyway
If you grow up in the right place at the right time, how much should you be in control of everyone else's life?