Skip to content

Option to run Pipelines in sequence in 03-Child #101

Description

@bukarev

Currently, the ForEach activity in the pipeline "03-Child" triggers all worker pipelines in a given stage at once, in parallel. I had a source system (API) which returned me error related to exceeded limit of requests from multiple worker pipelines trying to query that API.

There is a "Sequential" setting in ForEach activity, which could be parameterised per Batch. Likely, a new field would be required in Stages table, and a new SP and Lookup would be required for getting that value into the pipeline 03-Child.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions