Pipelines.jl

A lightweight and powerful Julia package for computational pipelines.

Building reusable pipelines and workflows is easier than you have ever thought.

Package Features

• Easy to build both simple and complex tasks.
• Supports external command lines and pure Julia functions.
• Supports resuming interrupted tasks, retrying failed tasks, and skipping finished tasks.
• Supports thread-safe redirection to stdout and stderr.
• Supports dependency check.
• Supports inputs, outputs validation, and so on.
• Supports program queuing and workload management with JobSchedulers.jl

Installation

Pipelines.jl can be installed using the Julia package manager. From the Julia REPL, type ] to enter the Pkg REPL mode and run

pkg> add Pipelines

To use the package, type

using Pipelines

Documentation

• STABLE — documentation of the most recently tagged version.
• DEVEL — documentation of the in-development version.