Configuration

A kdb Insights Database's configuration is composed of a schema, a stream, and multiple data tiers for real-time and historical data. In kdb Insights Enterprise, a database can be configured using the kdb Insights user interface, or using a configuration file called an assembly file.

At a minimum, an kdb Insights Database needs:

• A gateway for routing and an aggregator to aggregate responses.
• A set of labels to organize and route data queries.
• A schema configuration with one or more tables.
• A source stream to ingest data into the system.
• One or more data tiers for querying data.

Once the database has been configured, the database can be deployed.

Configuration methods

In kdb Insights and kdb Insights Enterprise, configuration for a database can be submitted through an assembly file. When using kdb Insights Enterprise, databases can also be configured using the Insights user interface.

Example

User InterfaceYAML

Databases are configured using an assembly object to correlate a database, a schema, and a stream to a deployment.

apiVersion: insights.kx.com/v1
kind: Assembly
metadata:
  name: factory
spec:
  attach: false
  labels:
    region: us-east-1
  tables:
    trace:
      description: Manufacturing trace data
      type: partitioned
      blockSize: 10000
      prtnCol: updateTS
      sortColsOrd: [sensorID]
      sortColsDisk: [sensorID]
      columns:
        - name: sensorID
          description: Sensor Identifier
          type: int
          attrMem: grouped
          attrDisk: parted
          attrOrd: parted
        - name: readTS
          description: Reading timestamp
          type: timestamp
        - name: captureTS
          description: Capture timestamp
          type: timestamp
        - name: valFloat
          description: Sensor value
          type: float
        - name: qual
          description: Reading quality
          type: byte
        - name: alarm
          description: Enumerated alarm flag
          type: byte
        - name: updateTS
          description: Ingestion timestamp
          type: timestamp
  mounts:
    rdb:
      type: stream
      baseURI: none
      partition: none
      dependency:
      - idb
    idb:
      type: local
      partition: ordinal
    hdb:
      type: local
      partition: date
      dependency:
      - idb
  elements:
    sm:
      size: 1
      source: south
      tiers:
        - name: streaming
          mount: rdb
        - name: interval
          mount: idb
          schedule:
            freq: 00:10:00
        - name: historical
          mount: hdb
          schedule:
            freq: 1D00:00:00
            snap: 01:35:00
          retain:
            time: 3 Months
    dap:
      instances:
        da:
          source: south
          mountList:
          - idb
          - rdb
          - hdb
    sequencer:
      south:
        external: false