Skip to content

Context switching causes multi GPU idling #11

@CanyonWind

Description

@CanyonWind

x = F.broadcast_mul(x, block_channel_mask.as_in_context(x.context))

running_mean = F.add(F.multiply(self.running_mean.data(), self.momentum.as_in_context(x.context)),
F.multiply(mean, self.momentum_rest.as_in_context(x.context)))
running_var = F.add(F.multiply(self.running_var.data(), self.momentum.as_in_context(x.context)),
F.multiply(var, self.momentum_rest.as_in_context(x.context)))

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions