Release Notes - Microservices 1.1.3
kdb Insights Microservices 1.1.3 release.
Release Date
2022-08-17
Changes
Storage Manager & Data Access
[FIX] Fix for Alpine vulnerability CVE-2022-37434
Stream Processor
[FIX] Fix for Alpine vulnerability CVE-2022-37434
Service Discovery
[FIX] Fix for Alpine vulnerabilities CVE-2022-37434 and CVE-2022-32207
Sidecar
[FIX] Fix for Alpine vulnerabilities CVE-2022-37434
Known Issues
-
If you request too much data in a single getData(), the request will fail. To overcome this issue you should request less data per getData() call. The error message returned will look like the example below:
{"header":{"http":"json","corr":"6dd8f0c5-1895-49c9-a87a-636a834af370","logCorr":"6dd8f0c5-1895-49c9-a87a-636a834af370","client":":10.0.10.76:5050","api":".kxi.getData","protocol":"gw","numRP":1,"ogRcID":"10.0.10.100:5060","to":"2022-04-07T11:41:35.717000000","retryCount":0,"rc":42,"ac":10,"ai":"Agg died"},"payload":[]}
- If metrics reporting is enabled within a microservice, along with the handler for
.z.ps
, services calling through the.z.ps
with0(f;x)
will throw atype
error due to a failure in the handler to return correctly. The workaround is if metrics reporting is enabled, disable the.z.ps
event handler in the metrics configuration for all microservices.
"metrics": {
"enabled": "true",
"frequency": 5,
"handler": {
"pc": true,
"pg": true,
"ph": true,
"po": true,
"pp": true,
"ps": false,
"ts": true,
"wc": true,
"wo": true,
"ws": true
}
}
Upgrade considerations
Licensing
From 1.1.0 licensing changes are included to enable feature and comsumption based licensing in some cases. As part of this Microservices now require clients to upgrade to new licenses with feature flags. Previous licenses only required KXCE
in the banner.
To validate if a license has feature flags, start a process or Microservice using it and check .z.l 4
in the terminal. This should return something like "insights.lib.embedq insights.lib.pykx insights.lib.sql insights.app.rt insig..
Database (Service Gateway, Data Access, Storage Manager)
- Critical invalid configuration will now fatally exit the process with a
FATAL
log message and information on the configuration error - Assembly
mounts.*.uri
is now defined asmounts.*.baseURI
- existing assembly files will need to be updated accordingly - Update to RT Client Library for new API signatures: https://code.kx.com/insights/1.1/microservices/storage-manager/sm-interface.html#interface-with-a-messaging-service
Artifacts
Service Discovery
microservice | Docker | Helm Chart |
---|---|---|
Discovery Registry | registry.dl.kx.com/kxi-eureka-discovery:1.1.3 | https://nexus.dl.kx.com/repository/kx-insights-charts/kxi-discovery-service-1.1.4.tgz |
Discovery Proxy | registry.dl.kx.com/kxi-discovery-proxy:1.1.3 |
Stream Processor
microservice | Docker | qpk |
---|---|---|
Controller | registry.dl.kx.com/kxi-sp-controller:1.1.3 | |
Worker | registry.dl.kx.com/kxi-sp-worker:1.1.3 | https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-sp-worker/1.1.3/kxi-sp-worker.1.1.3.qpk |
Coordinator | registry.dl.kx.com/kxi-sp-coordinator:1.1.3 | |
Worker-Python | registry.dl.kx.com/kxi-sp-python:1.1.3 | |
Worker-ML | registry.dl.kx.com/kxi-ml:1.1.3 |
Data Access
microservice | Docker |
---|---|
Data Access Process (DA) | registry.dl.kx.com/kxi-da:1.1.2 |
Storage Manager
microservice | Docker |
---|---|
Storage Manager | registry.dl.kx.com/kxi-sm:1.1.0 |
End of Interval (EOI) | registry.dl.kx.com/kxi-sm-eoi:1.1.0 |
End of Day (EOD) | registry.dl.kx.com/kxi-sm-eod:1.1.0 |
Database Migration (DBM) | registry.dl.kx.com/kxi-sm-dbm:1.1.0 |
Service Gateway
microservice | Docker |
---|---|
Gateway | registry.dl.kx.com/kxi-sg-gw:1.1.1 |
Resource Coordinator | registry.dl.kx.com/kxi-sg-rc:1.1.2 |
Aggregator | registry.dl.kx.com/kxi-sg-agg:1.1.1 |
User interface
microservice | Docker | Helm Chart |
---|---|---|
Dashboards | registry.dl.kx.com/kxi-gui-dash:1.1.2 | https://nexus.dl.kx.com/repository/kx-insights-charts/gui-dash-1.1.2.tgz |
Gateway | registry.dl.kx.com/kxi-gui-gateway:1.1.2 | https://nexus.dl.kx.com/repository/kx-insights-charts/gui-gateway-1.1.2.tgz |
Data | registry.dl.kx.com/kxi-gui-data:1.1.2 | https://nexus.dl.kx.com/repository/kx-insights-charts/gui-data-1.1.2.tgz |
Machine Learning
Miscellaneous
microservice | Docker | package |
---|---|---|
Metrics Sidecar | registry.dl.kx.com/kxi-sidecar:1.1.8 | |
OpenAPI SDK Generator | registry.dl.kx.com/kxi-openapi-codegen:0.8.0 | https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-openapi-codegen/0.8.0/kxi-openapi-codegen-0.8.0-shaded.jar |