Hi,
I'm one of the maintainers of TorchData and I would like to note that TorchData does support remote data loading, especially from Amazon S3. You can use the S3FileLoader and you can find more examples with fsspec here.
Thanks for your interest in our library! Feel free to reach out if there is any question about it.
cc: @ejguan
Hi,
I'm one of the maintainers of TorchData and I would like to note that TorchData does support remote data loading, especially from Amazon S3. You can use the
S3FileLoaderand you can find more examples withfsspechere.Thanks for your interest in our library! Feel free to reach out if there is any question about it.
cc: @ejguan