-
Notifications
You must be signed in to change notification settings - Fork 47
Open
Description
Setting reduction = 'sum' does not work because of this line:
if self._reduction:
merged_grad[shared] = torch.stack([g[shared]
for g in pc_grad]).mean(dim=0)
because if reduction is a string, self._reduction is always True
KarlXing, feifei-Lee and clw5180
Metadata
Metadata
Assignees
Labels
No labels