Skip to content

Release Notes - kdb Insights Microservices 1.3.1

kdb Insights Microservices 1.3.1 release.

Release Date

2022-12-06

New Features

Storage Manager

  • SM now supports writing its own inventory file, under the tier settings. Inventory files can speed load times for databases - you can read more here.
          - name: s3
            mount: hb
            store: s3://kxi-sm-test/bucketroot/db
            inventory:
              enabled: true
              location: s3://kxi-sm-test/bucketroot/inventory.tgz
    
    The DA should be configured to set KX_OBJSTR_INVENTORY_FILE as an env var to a path relative to the root of the bucket. For example bucketroot/inventory.tgz.

DA/Aggregator

  • The garbage collection in the DAP and Aggregator processes has been moved to a staggered timer for improved query throughput. The default is 10 minutes, and is configurable through the KXI_GC_FREQ environment variables on each service. Previously, the garbage collection ran after each query.

Fixes

Storage Manager

  • Tables with names starting with underscores are no longer considered invalid.

  • Schema changes no longer fail on assemblies with configured—but empty—object storage tiers.

Data Access

  • An upgrade issue where DAs could register with SM before all tables were ready has been fixed. This could result in Error executing listener for event discovery

Artifacts

Highlights denote artifacts which have been updated as part of this patch release. All other artifacts are unchanged from the previous major or minor release.

Service Discovery

microservice Docker Helm Chart
Discovery Registry registry.dl.kx.com/kxi-eureka-discovery:1.3.1 https://nexus.dl.kx.com/repository/kx-insights-charts/kxi-discovery-service-1.3.1.tgz
Discovery Proxy registry.dl.kx.com/kxi-discovery-proxy:1.3.1

Stream Processor

microservice Docker qpk
Controller registry.dl.kx.com/kxi-sp-controller:1.3.1
Worker registry.dl.kx.com/kxi-sp-worker:1.3.1 https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-sp-worker/1.3.1/kxi-sp-worker.1.3.1.qpk
Coordinator registry.dl.kx.com/kxi-sp-coordinator:1.3.1
Worker-Python registry.dl.kx.com/kxi-sp-python:1.3.1
Worker-ML registry.dl.kx.com/kxi-ml:1.3.1

Data Access

microservice Docker
Data Access Process (DA) registry.dl.kx.com/kxi-da:1.3.3
Single container registry.dl.kx.com/kxi-da-single:1.3.3

Storage Manager

microservice Docker
Storage Manager registry.dl.kx.com/kxi-sm:1.3.3
End of Interval (EOI) registry.dl.kx.com/kxi-sm-eoi:1.3.3
End of Day (EOD) registry.dl.kx.com/kxi-sm-eod:1.3.3
Database Migration (DBM) registry.dl.kx.com/kxi-sm-dbm:1.3.3
Single Container registry.dl.kx.com/kxi-sm-single:1.3.3

Service Gateway

microservice Docker
Gateway registry.dl.kx.com/kxi-sg-gw:1.3.3
Resource Coordinator registry.dl.kx.com/kxi-sg-rc:1.3.3
Aggregator registry.dl.kx.com/kxi-sg-agg:1.3.3

User interface

microservice Docker Helm Chart
Dashboards registry.dl.kx.com/kxi-gui-dash:1.3.1 https://nexus.dl.kx.com/repository/kx-insights-charts/gui-dash-1.3.0.tgz
Gateway registry.dl.kx.com/kxi-gui-gateway:1.3.1 https://nexus.dl.kx.com/repository/kx-insights-charts/gui-gateway-1.3.0.tgz
Data registry.dl.kx.com/kxi-gui-data:1.3.1 https://nexus.dl.kx.com/repository/kx-insights-charts/gui-data-1.3.0.tgz

Machine Learning

microservice package
ML Registry https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-ml-registry/0.8.0/kxi-ml-registry.0.8.0.qpk
ML Analytics https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-ml-analytics/0.8.0/kxi-ml-analytics.0.8.0.qpk

Miscellaneous

microservice Docker package
Metrics Sidecar registry.dl.kx.com/kxi-sidecar:1.3.0
OpenAPI SDK Generator registry.dl.kx.com/kxi-openapi-codegen:0.8.0 https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-openapi-codegen/0.8.0/kxi-openapi-codegen-0.8.0-shaded.jar