Operating System
macOS
Other Linux
No response
Workflow Version
v1.5.9
Workflow Execution
Command line (Cluster)
Other workflow execution
No response
EPI2ME Version
No response
CLI command run
No response
Workflow Execution - CLI Execution Profile
None
What happened?
At https://github.com/epi2me-labs/wf-basecalling/blob/master/main.nf#L169, the report html path will be the same for multiple html report. I am aware that the pipeline is using a progressive method which will make the newer report contain all chunk stats.
But when the output dir is a s3 folder for which the AWS batch role does not have DeteleObject permission, it will cause error since the pipeline tries to overwrite report html multiple times.
Relevant log output
Workflow execution completed unsuccessfully
User: arn:aws:sts::xxxx:assumed-role/xxx/i-xxx is not authorized to perform: s3:DeleteObject on resource: "arn:aws:s3:::x/y/z/wf-basecalling-report.html" because no identity-based policy allows the s3:DeleteObject action (Service: S3, Status Code: 403, Request ID: XXXXX, Extended Request ID: XYZ) (SDK Attempt Count: 1)
Application activity log entry
Were you able to successfully run the latest version of the workflow with the demo data?
yes
Other demo data information
Operating System
macOS
Other Linux
No response
Workflow Version
v1.5.9
Workflow Execution
Command line (Cluster)
Other workflow execution
No response
EPI2ME Version
No response
CLI command run
No response
Workflow Execution - CLI Execution Profile
None
What happened?
At https://github.com/epi2me-labs/wf-basecalling/blob/master/main.nf#L169, the report html path will be the same for multiple html report. I am aware that the pipeline is using a progressive method which will make the newer report contain all chunk stats.
But when the output dir is a s3 folder for which the AWS batch role does not have DeteleObject permission, it will cause error since the pipeline tries to overwrite report html multiple times.
Relevant log output
Workflow execution completed unsuccessfully User: arn:aws:sts::xxxx:assumed-role/xxx/i-xxx is not authorized to perform: s3:DeleteObject on resource: "arn:aws:s3:::x/y/z/wf-basecalling-report.html" because no identity-based policy allows the s3:DeleteObject action (Service: S3, Status Code: 403, Request ID: XXXXX, Extended Request ID: XYZ) (SDK Attempt Count: 1)Application activity log entry
Were you able to successfully run the latest version of the workflow with the demo data?
yes
Other demo data information