Will second-order optimizers displace first-order optimizers for training LLMs by 2030?

Prediction market on manifold. Will something like Shampoo become the default instead of Adam?

Liquidity: $1,000. Resolves: 12/31/2029.