pipeline¶
Manage Refinery pipelines
refinery pipeline [option]
Options: --list --show --start
--force-start --stop --status
--status-summary --intraday-write --rollover --layoutrefinery pipeline [option] --instance [pipeline instance number]
refinery pipeline [option] --instance all
--list-
List all pipelines within the Refinery installation.
--show pipeline-
List the processes that form the specified pipeline
-
Supports the additional --instance pipeline_instance option.
--layout pipeline-
Lists the processes that form the specified pipeline, including their host, port, and status, online or offline.
--start pipeline/s-
Start an individual pipeline or list of pipelines.
-
If starting multiple pipelines, separate names with commas e.g.
--start pipeline1,pipeline2 -
Supports the additional --instance pipeline_instance option.
--force-start pipeline/s-
Starts processes within the specified pipeline(s) and can start offline processes within partially running pipeline(s)
-
If force starting multiple pipelines, separate names with commas (e.g.
--force-start pipeline1,pipeline2) -
Requires the additional --instance pipeline_instance option.
--stop pipeline/s-
Gracefully stop an individual pipeline or list of pipelines.
-
If stopping multiple pipelines, separate names with commas e.g.
--stop pipeline1,pipeline2 -
Requires the additional --instance pipeline_instance option.
--status pipeline-
Shows the status of each process within the pipeline
-
Supports the additional --instance pipeline_instance option.
--status-summary-
Shows the overall status of all pipelines within the Refinery installation.
-
A pipeline status is derived from the status of all processes within it.
-
Supports the additional --instance pipeline_instance option.
--intraday-write pipeline --instance pipeline_instance-
Force intra-day writedown for specified pipeline.
-
Requires
--instanceoption described below. -
Does not support
--instance all. --rollover pipeline --instance pipeline_instance [--include-today]-
Manually trigger writedown of late data timestamped before today's date from PDB to HDB.
-
Requires
--instanceoption. -
Optional argument
--include-todaywrites down today's partition also.