Choose from the list of available writers listed below.
- Click to edit node. When a node is clicked, the property panel to the right will be editable.
- Right-click to rename a node, remove (delete) or duplicate a node. A duplicated node will copy the details of the node, including any defined properties in the original node. The duplicated node will have a
-nnumeric tag in the name.
Writes events to the kdb+ console. Can be used for simple streams running on a local deployment. By default, all vectors (lists of the same type) are printed on a single line. By enabling the
Split Lists option, vectors will be printed on separate lines. Lists of mixed type are always printed on separate lines.
|Prefix||A string for output messages.|
|Split Lists||When enabled, each item in a list appears on a new line.|
|QLog||When enabled, prints all console logs to a QLog stream.|
KX Insights Database
Writes events to a KX Insights Database
|Database||Select from available databases|
|Table||Select a table from the schema associated with the database|
|Deduplicate Stream||When enabled, duplicate messages caused by failure events will be deduplicated before being sent to any downstream consumers. With this value enabled, the pipeline must be deterministic to avoid any undefined behaviour.|
Publish data on a Kafka topic. Kafka is a distributed event streaming platform. A Kafka producer will publish data to a Kafka broker which can then be consumed by any downstream listeners. All data published to Kafka must be encoded as either strings or serialized as bytes. If data reaches the Kafka publish point that is not encoded, it is converted to q IPC serialization representation.
|Broker||Define Kafka connection details as host:port information - for example:
|Topic||The name of the Kafka data service to publish on.|
|Use TLS||Enable TLS.|
|Kubernetes Secret*||The name of a Kubernetes secret that is already available in the cluster and contains your TLS certificates.|
|Certificate Password*||TLS certificate password, if required.|
Writes events to another kdb+ process, publishes data to a table or invokes a function with that data.
|Handle||q style IPC Handle to destination process, includes port details to write to.|
|Table||The name of table to upsert data to for further exploration.|
|Asynchronous||When enabled, push to the output process asynchronously. This increases the throughput allowing multiple messages to be queued without blocking processing.|
KX Insights Stream
Writes events to a KX Insights stream.
|Table||Categorize stream messages by table name|
|Deduplicate Stream||When enabled, duplicated message caused by failure events will be de-duplicated before sent downstream. When enabled, the pipeline must be deterministic to avoid any undefined behavior.|