Skip to content

[Bug] External storage transfer stats reports summation of durations instead of wall-clock duration #1562

Description

@jmaeagle99

What are you really trying to do?

Get more accurate transfer statistics for external storage uploads and downloads.

Describe the bug

External storage transfer stats are summing the durations of each driver invocation instead of tracking overlapping intervals. The stats should be reporting wall-clock time rather than duration summation. See https://github.com/temporalio/sdk-python/blob/main/temporalio/converter/_extstore.py#L48C9-L48C21. For example, if 3 drivers are concurrently invoked during retrieval and each takes about 100 ms, the reported duration will be 300 ms instead of the expected value that is much closer to 100 ms.

Possible solution

Use edge detection to track and record durations.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions