[megatron] don't re-assert no_sync_func every step with overlap_grad_reduce#2066
Open
HaozheZhang6 wants to merge 3 commits into
Open
[megatron] don't re-assert no_sync_func every step with overlap_grad_reduce#2066HaozheZhang6 wants to merge 3 commits into
HaozheZhang6 wants to merge 3 commits into
background
wait
wait-all
cancel
parallel
Loading