Einherjar86
Active Member
I know it's from the same article, it's what made me go from "awesome headline" to "god damn it wasn't really about the headline but about capitalism"
Sorry, the way you said "unless he's done character pieces before on Gates and Musk in the quote you cited" made me think you assumed the excerpt was from something else he wrote.
you wouldn't say this is a leap of character for both Gates and Musk?
I wouldn't call it a leap of character. I think it's a legitimate interpretation based on their observable behavior and past comments about AI. It's only a leap of character to the extent that it makes assumptions about someone's character based on their actions.
agreed, which is why I say it's a leap of character. Musk made his money on PayPal, not enslaving a foreign people and forcing them to do cheap labor.
I don't think that's quite what Chiang has in mind.
He's comparing corporate entities to superintelligent AI, but Chiang never blames an AI for its behavior. Basically, he's saying that superintelligent AIs would evolve and behave in accordance with their prime directive, and would optimize their functionality in order to achieve their goals efficiently. Since machines lack insight, they wouldn't acknowledge when their behavior poses a legitimate ethical concern.
Likewise, Chiang notes that corporations also exhibit no insight; we don't expect corporate entities to reflect upon their decisions, which is why some level of government oversight is (or should be) mandatory.
Chiang is pointing out that the de facto leaders of these tech giants don't seem to think it's necessary for them to promote any culture of insight or self-reflection within the corporate community, or as a part of the corporation's prime directive. They justify their corporation's potentially unethical behavior by appealing to a corporate body's prime directive--i.e. to deliver the goods to its stakeholders by making as much money as it can. Yet people like Musk and Gates have no trouble suggesting that superintelligent AIs might be dangerous because they lack insight.
I don't think he's criticizing Musk's or Gates's personal character. I don't even think he's saying corporations shouldn't necessarily do what they do, or that superintelligent AIs shouldn't be created. I think he's just trying to say that there's a little bit of a double-standard going on here.