Skip to content

kdb Insights SDK - Release Notes

This page details the release notes for the latest series of kdb Insights SDK releases. To find the release notes for an older release, refer to the previous releases page.

1.19.0

Release date: 2026-06-18

kdb Insights SDK 1.19 introduces more flexibility in deployment topologies and greater flexibility in Bring-Your-Own-Database scenarios, in addition to a number of improvements and bug fixes.

New Features

  1. Deploy RT Clusters Outside a Container

    RT can now run a 3-node cluster outside of a container. See Running RT outside of a container for an example on how to run in this configuration.

  2. Support for Custom Names for sym Files

    You can now import data from sym files that have custom names. See Initial Important Process for an overview of how to perform this operation.

Improvements

1.19 brings a broad set of improvements across the product. Database changes focus on operational flexibility — finer control over memory allocation, garbage collection, and reference data retention — alongside expanded SQL2 and API support. Expand the following sections for more details.

Database

  • The Storage Manager now retains the reference data tables in the last N IDB(s). This prevents long-running queries from failing when they span an interval boundary. To do this, add the KXI_SM_EOI_RETAIN_REF environment variable, which gives the number of IDB intervals to retain refdata snapshots for.

  • The new kxi_sm_eod_start_count metric, used alongside with KXI_SM_EOD_COUNT, lets you identify when an EOD is still in progress or has taken longer than expected.

  • Timeout messages from the Resource Coordinator now include the timeout value used in the request to assist with debugging.

  • UDAs now support default values for distinguished arguments, allowing the target database or table to be pre-set rather than requiring the user to specify it on every call.

  • For the kxi-da-single image, you can now set individual memory allocation of subprocesses via KXI_DA_{MOUNT}_MEM_PERCENTAGE. For example: If there is an RDB mount setting KXI_DA_RDB_MEM_PERCENTAGE to 20, the RDB sets its -w parameter to be 20% of the total memory allocated on the container.

  • Added limit, inputTZ, outputTZ and outputTZCols as supported parameters for the DB Reader API. Refer to the DB Reader for more details.

  • Added TCP keepalive to connections opened between data services processes. This helps to ensure that the Storage Manager and DAPs are able to handle an EOD or batch update during long-running requests

  • UDAs now support .py extensions in addition to .p, making it easier to work with standard Python tooling.

  • Added support for SQL2 cast expressions using x::type syntax. See SQL Functions for details.

  • You can now set the garbage collection mode via environment variables in SM, DAPs, Agg, and RC processes. The environment variable is KXI_GC_MODE and can be set to 0 or 1 as defined in the q garbage collection reference. On containers hosting multiple processes, process-specific overrides are also supported. For example, setting KXI_GC_MODE to 1 and KXI_RDB_GC_MODE to 0 on a kxi-da-single container configures immediate GC for IDB/HDB and deferred GC for the RDB.

  • Added support for fractional GB values in the KXI_SM_EOD_SORT_LIMIT and KXI_SM_EOI_SORT_LIMIT environment variables, allowing memory limits to be specified below 1 GB.

Stream Processor

  • The Kafka reader now supports subsets of partitions.

  • Multiple kdb Insights Database Writers can now be added to a single pipeline.

Python API

  • All public kdb Insights Python ApiClient subclasses (Query, ClientController, EntitlementService, WorkloadClient, ObservabilityService, InformationService, GroupManager, ClientManager, PackageManagerClient, UserManager) now have class-level docstrings with descriptions and code examples.

  • UDAs can now be discovered and run via the kdb Insights Python API.

Installation and Upgrade
  • The Configuration guide now documents all fields available in the values.yaml file used for installation and upgrades.

Fixes

1.19 resolves a significant number of Database issues, particularly around Storage Manager stability during EOD processing, batch delete reliability, and query correctness. Stream Processor fixes address coordinator connectivity and S3 authentication issues. Expand the following sections for more details.

Database

  • The Resource Coordinator now immediately fails any in-flight request if a DAP runs out of memory and crashes, rather than waiting for a timeout.

  • Fixed an issue where queries combining count(*) with LIMIT could return incorrect results.

  • Fixed an issue where the Storage Manager could fail to start after all tables with symbol-type columns were deleted and a new one was added.

  • Fixed an issue where the qIPC header was not being correctly removed from struct-text responses.

  • Fixed an issue where the Storage Manager would stop processing EODs after a failed dispatch on a closed connection, requiring a manual restart to recover.

  • Fixed an issue where disabling encryption on a database prevented it from starting.

  • Fixed an issue where a batch delete would fail with a {{Cannot delete from RDB tier}} error when performed after an emergency EOI.

  • Fixed an issue where setting a limit value greater than the payload size when calling getdata caused an error.

  • Fixed an issue where the Storage Manager could not process a schema change because the DB-conversion EOI signal was being replaced by a regular EOD signal and not published.

  • Fixed an issue where batch delete could skip some date partitions due to an incorrectly triggered optimization.

  • Fixed an issue where the getMeta API could fail with a no_labels error when multiple RCs were present and one had no DAPs assigned.

  • Fixed an issue where a non-recoverable error during a batch update would cause the next EOD to exit rather than perform cleanup.

  • Fixed an issue where SQL2 did not correctly handle scalar extensions when no columns were present in the aggregation clause.

Stream Processor

  • Fixed an issue where the Stream Processor Coordinator was unable to resolve the controller host name.

  • Reduced repetitive log output when the Stream Processor Coordinator loses connection to the controller.

  • Improved argument handling and documentation for the Transform Schema operator.

  • Fixed an issue where EKS service account authentication was failing for the v2 S3 Reader.

  • Fixed an issue where the v2 Stream Writer would error on restart if checkpoints had been cleared.

Reliable Transport
  • Fixed an issue where multiple writers in the RT C language interface could write to the same log file simultaneously.
  • Fixed an issue where a power outage caused a corruption on a client side subscriber log.

Artifacts

All artifacts updated for this release are highlighted.

KX Nexus

The KX Downloads Portal is the preferred repository for all use cases, and KX Nexus links will be removed once the KX Nexus repository is decommissioned. Nexus links on this page are provided as a temporary alternative to the KX Downloads Portal for existing users.

Stream Processor

service Nexus Docker Downloads Portal Docker
Controller registry.dl.kx.com/kxi-sp-controller:1.19.0 portal.dl.kx.com/kxi-sp-controller:1.19.0
Worker registry.dl.kx.com/kxi-sp-worker:1.19.0 portal.dl.kx.com/kxi-sp-worker:1.19.0
Coordinator registry.dl.kx.com/kxi-sp-coordinator:1.19.0 portal.dl.kx.com/kxi-sp-coordinator:1.19.0
Worker-Python registry.dl.kx.com/kxi-sp-python:1.19.0 portal.dl.kx.com/kxi-sp-python:1.19.0
Worker-ML registry.dl.kx.com/kxi-ml:1.19.0 portal.dl.kx.com/kxi-ml:1.19.0

Database

service Nexus Docker Downloads Portal Docker Helm Chart
Data Access Process (DAP) registry.dl.kx.com/kxi-da:1.19.0 portal.dl.kx.com/kxi-da:1.19.0
Single container registry.dl.kx.com/kxi-da-single:1.19.0 portal.dl.kx.com/kxi-da-single:1.19.0
Storage Manager registry.dl.kx.com/kxi-sm-single:1.19.0 portal.dl.kx.com/kxi-sm-single:1.19.0
Gateway registry.dl.kx.com/kxi-sg-gw:1.19.0 portal.dl.kx.com/kxi-sg-gw:1.18.3
Resource Coordinator registry.dl.kx.com/kxi-sg-rc:1.19.0 portal.dl.kx.com/kxi-sg-rc:1.19.0
Aggregator registry.dl.kx.com/kxi-sg-agg:1.19.0 portal.dl.kx.com/kxi-sg-agg:1.19.0
Rollback registry.dl.kx.com/kxi-db-rollback:1.19.0 portal.dl.kx.com/kxi-db-rollback:1.19.0

Reliable Transport

service Nexus Docker Downloads Portal Docker Helm Chart
Reliable Transport registry.dl.kx.com/kxi-rt:1.19.0 portal.dl.kx.com/kxi-rt:1.19.0 kxi-rt-1.19.0.tgz

Miscellaneous

service Nexus Docker package
Metrics Sidecar registry.dl.kx.com/kxi-sidecar:1.19.0
OpenAPI SDK Generator registry.dl.kx.com/kxi-openapi-codegen:0.8.0 kxi-openapi-codegen-0.8.0-shaded.jar
Back to top