Hi,
I have used a single A100 device to test the sharp performance when I test the RDMA performance, the device-to-device send/recv speed is about 18GB/s, when I use sharp to do allreduce operation (as only one process is used, there are no calculations i think.), the speed is 12GB/s. So my question what may cause the performance to degrade?
Thanks!
Hi,
I have used a single A100 device to test the sharp performance when I test the RDMA performance, the device-to-device send/recv speed is about 18GB/s, when I use sharp to do allreduce operation (as only one process is used, there are no calculations i think.), the speed is 12GB/s. So my question what may cause the performance to degrade?
Thanks!