API REFERENCE
convert_to_zero_v2()
LowLevelZeroOptimizer
ShardedModelV2
ShardedOptimizerV2
ZeroOptimizer
Useful links for Colossal-AI
A naive implementation which shard each tensor evenly over all ranks