DeepSpeed Zero needs to come clean

[qrdlgit]

It's not really about 'democratizing' large models, at least not yet.

A democratizing solution would be about arbitrary execution of large models on lower end systems.

DeepSpeed Zero is more about shifting some of the resource requirements around.