Test the weight sync from an AutoTP trainer into a TP4 copy - #1

Test the weight sync from an AutoTP trainer into a TP4 copy#1

Achyuthan-S wants to merge 1 commit into

LiRunGuo:rollout-affine-weight-syncLiRunGuo/DeepSpeed:rollout-affine-weight-syncfrom

Achyuthan-S:autotp-sync-testAchyuthan-S/DeepSpeed:autotp-sync-testCopy head branch name to clipboard