Skip to content

Unpinned s3fs pulls in an ancient and slow version #77

Description

@athewsey

Installing latest LLMeter on a fresh environment pulls in s3fs==0.4.2 (from 2020) - and using S3 features raises the following warning:

UserWarning: Your installed version of s3fs is very old and known to cause
severe performance issues, see also https://github.com/dask/dask/issues/10276

To fix, you should specify a lower version bound on s3fs, or
update the current installation.

  warnings.warn(s3_msg)

As mentioned in the cited thread, it seems like this is caused how dependency resolvers handle the vastly different release frequencies of s3fs, aiobotocore, and botocore/boto3.

Maybe LLMeter should pin s3fs at some reasonable compromise minimal version (e.g. >=2023?) to avoid the issue?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions