I think super asymmetric societies are less just. I'm not sure I'm a Utilitarian in all things, but I think we should try to make as many people as happy and content as possible, not the 1% or 0.1% of society. I'm OK with there being unhappy or less privileged people, but a just world should be closer to a normal distribution (and your outcome should be based on the content of your character, not your birthright).
Maybe something closer to the Star Trek vision of the future (vs. the other two sci fi visions I mentioned).