Will Artificial Super Intelligence lock in values humans generally come to disagree with?

Prediction market on manifold. Conditional on artificial super intelligence being created and not wiping out humanity. Will an artificial super intelligence lock in some or any moral values that the majority future humans or human descendants come to disagree with but are unable to change due to the lock in?

Liquidity: $1,020. Resolves: 1/20/2100.