colossalai.zero.utils

class colossalai.zero.utils.ZeroHook(shard_strategy, memstarts_collector=None, stateful_tensor_mgr=None, process_group=None)[source]

A hook to process sharded param for ZeRO method. Warning: this class has been deprecated after version 0.1.12