Skip to content

[Bug]: Cannot browse large buckets #28

Description

@jboren

Brows3 version

0.2.44

Operating system

macOS

Storage provider

Other S3-compatible storage

What happened?

Brows3 cannot seem to browse large buckets. I'm using it against Backblaze B2. It connects instantly, lists the buckets perfectly and is capable of browsing smaller buckets, but I have one bucket with around 400,000 files, about 5TB in size. Trying to list this bucket gives inconsistent results. Usually it just says "Empty Folder", but occasionally it will list the first folder, and if I click into that it lists a few of the folders in it, but only a few. Clearing the cache doesn't seem to make any difference. When it tries to list the large bucket it spins for 10 seconds and then either shows the one folder, or the Empty Folder message. When I use the B2 file browser to list the bucket, it takes about a full minute to build the file list. So it seems maybe there is something timing out before it can list the large bucket contents. Other than this issue, it seems to work very well.

Steps to reproduce

  1. Connect to Backblaze B2 with a key that has read/write access to all buckets
  2. List all buckets.
  3. Try to list a very large bucket
  4. Observe

Expected behavior

List the entire contents of any bucket, taking how ever long is required to pull a complete file tree.

Logs, screenshots, or error messages

No response

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions