pipeline

Manage Refinery pipelines

refinery pipeline [option]

Options: --list --show --start
--force-start --stop --status
--status-summary --intraday-write --rollover --layout

refinery pipeline [option] --instance [pipeline instance number]

refinery pipeline [option] --instance all

--list

List all pipelines within the Refinery installation.

--show pipeline

List the processes that form the specified pipeline

Supports the additional --instance pipeline_instance option.

--layout pipeline

Lists the processes that form the specified pipeline, including their host, port, and status, online or offline.

--start pipeline/s

Start an individual pipeline or list of pipelines.

If starting multiple pipelines, separate names with commas e.g. --start pipeline1,pipeline2

Supports the additional --instance pipeline_instance option.

--force-start pipeline/s

Starts processes within the specified pipeline(s) and can start offline processes within partially running pipeline(s)

If force starting multiple pipelines, separate names with commas (e.g. --force-start pipeline1,pipeline2)

Requires the additional --instance pipeline_instance option.

--stop pipeline/s

Gracefully stop an individual pipeline or list of pipelines.

If stopping multiple pipelines, separate names with commas e.g. --stop pipeline1,pipeline2

Requires the additional --instance pipeline_instance option.

--status pipeline

Shows the status of each process within the pipeline

Supports the additional --instance pipeline_instance option.

--status-summary

Shows the overall status of all pipelines within the Refinery installation.

A pipeline status is derived from the status of all processes within it.

Supports the additional --instance pipeline_instance option.

--intraday-write pipeline --instance pipeline_instance

Force intra-day writedown for specified pipeline.

Requires --instance option described below.

Does not support --instance all.

--rollover pipeline --instance pipeline_instance [--include-today]

Manually trigger writedown of late data timestamped before today's date from PDB to HDB.

Requires --instance option.

Optional argument --include-today writes down today's partition also.