Skip to content

Question using sharp on one A100 device #114

Description

@LeiHaoa

Hi,
I have used a single A100 device to test the sharp performance when I test the RDMA performance, the device-to-device send/recv speed is about 18GB/s, when I use sharp to do allreduce operation (as only one process is used, there are no calculations i think.), the speed is 12GB/s. So my question what may cause the performance to degrade?

Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions