Is DualParal can run in multiple devices?

[t108368527]

Is DualParal can run in multiple devices or just single device with multiple VGA?

[INV-WZQ]

Hi @t108368527 ,

Are you referring to GPUs when you mention VGA? From my understanding, you're asking whether our method can run across multiple devices (each containing multiple GPUs) or if it can only run on a single device with multiple GPUs.

Currently, our method is designed to run on a single device with multiple GPUs. We haven't tested it on multiple devices yet, but theoretically, it be possible.

If you have any further questions or need additional assistance, please feel free to reach out!

Thank you!