Skip to content

Release Notes - Version Insights Services 18/Aug/21

Artifacts

Service Discovery

microservice Docker Helm Chart
Discovery Registry registry.dl.kx.com/kxi-eureka-discovery:1.0.0 https://nexus.dl.kx.com/repository/kx-insights-charts/kxi-discovery-service-0.8.0.tgz
Discovery Proxy registry.dl.kx.com/kxi-discovery-proxy:0.8.2

Stream Processor

microservice Docker qpk
Controller registry.dl.kx.com/kxi-sp-controller:0.9.0
Worker registry.dl.kx.com/kxi-sp-worker:0.9.0 https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-sp-worker/0.9.0/kxi-sp-worker.0.9.0.qpk
Coordinator registry.dl.kx.com/kxi-sp-coordinator:0.9.0

Data Access

microservice Docker qpk
Data Access Process(DA) registry.dl.kx.com/kxi-da:0.9.0 https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-da/0.9.0/kxi-da.0.9.0.qpk
Data Access Operator registry.dl.kx.com/kxi-da-operator:0.9.0 https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-da-operator/0.9.0/kxi-da-operator.0.9.0.qpk

Storage Manager

microservice Docker qpk
Storage Manager registry.dl.kx.com/kxi-sm:0.9.0 https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-sm/0.9.0/kxi-sm.0.9.0.qpk
End of Interval(EOI) registry.dl.kx.com/kxi-sm-eoi:0.9.0 https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-sm-eoi/0.9.0/kxi-sm-eoi.0.9.0.qpk
End of Day(EOD) registry.dl.kx.com/kxi-sm-eod:0.9.0 https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-sm-eod/0.9.0/kxi-sm-eod.0.9.0.qpk
Database Migration(DBM) registry.dl.kx.com/kxi-sm-dbm:0.9.0 https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-sm-dbm/0.9.0/kxi-sm-dbm.0.9.0.qpk

Service Gateway

microservice Docker qpk
Gateway registry.dl.kx.com/kxi-sg-gw:0.9.1
Resource Coordinator registry.dl.kx.com/kxi-sg-rc:0.9.1 https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-sg-rc/0.9.1/kxi-sg-rc.0.9.1.qpk
Aggregator registry.dl.kx.com/kxi-sg-agg:0.9.1 https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-sg-agg/0.9.1/kxi-sg-agg.0.9.1.qpk

User Interface

microservice Docker Helm Chart
Dashboards registry.dl.kx.com/kxi-gui-dash:0.9.0 https://nexus.dl.kx.com/repository/kx-insights-charts/gui-dash-0.9.0.tgz
Gateway registry.dl.kx.com/kxi-gui-gateway:0.9.0 https://nexus.dl.kx.com/repository/kx-insights-charts/gui-gateway-0.9.0.tgz
Data registry.dl.kx.com/kxi-gui-data:0.9.0 https://nexus.dl.kx.com/repository/kx-insights-charts/gui-data-0.9.0.tgz

Machine Learning

microservice package
ML Registry https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-ml-registry/0.8.0/kxi-ml-registry.0.8.0.qpk
ML Analytics https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-ml-analytics/0.8.0/kxi-ml-analytics.0.8.0.qpk

Miscelleaneous

microservice Docker package
Metrics Sidecar registry.dl.kx.com/kxi-sidecar:0.8.0
OpenAPI SDK Generator registry.dl.kx.com/kxi-openapi-codegen:0.8.0 https://nexus.dl.kx.com/repository/kx-insights-packages/kxi-openapi-codegen/0.8.0/kxi-openapi-codegen-0.8.0-shaded.jar

Features

Stream Processor
Add support for operators using nested namespaces
API for metrics and status for pipelines
Pipeline recovery from Controller fault
Chunked file reading from file
API to inspect running pipelines
Pipeline teardown API
Pipeline heartbeats in coordinator
Persistent volumes for Checkpoints
Kafka reader 'fromBeginning' / 'fromEnd' usability
Length error running passing some atoms to a pipeline
CSV Decode
Data Access
Update DA to latest rt client qpk
Have DA's return failure codes when a query is unsuccessful
Update Data Access helm charts for ETE testing
Definition and implementation of what metrics the DA microservice will expose
React to data lifecycle events
Determine, fulfill, and report temporal purview of process at start-up
Storage Manager
Support for pushing data to S3 via SM
Handling ObjStor in initial import
Document SM's interaction with object storage
Updates to db-initial-import technical debt from M2
Fix wrong RDB and IDB purview for freshly imported DB
Kurl updates for on-prem DBs
Copy data to object storage
Partition layout w.r.t. object storage
Migration integration with EOD
Tier compression
Generic/custom tickerplant as EMS substrate
Service Gateway
Surface assembly info and table schemas via SG's getMeta API
SG asymmetric DAP mode
Health and Readyness checks for Service Gateway
Update core charts repository with latest gateway images
Timeout requests
Fail requests on timeouts
Detect request timeouts
Metadata retreival API for SG/DA
Support for custom code loading in SG and DA
Machine learning
ML Analytics Beta release
ML Registry Beta release

Bugs

Service Gateway
Fix to reconnection logic for coordinator when conection is dropped
Aggregator sidecar erroring when trying to register with discovery
If discovery is up, but then getServices() fails, we did not retry
Stream Processor
.sp.push isn't working for operators with foreign values as parameters
Kafka commit offset on checkpoint
Kafka is not reading from the start of a partition
.qsp.run isn't starting all parent pipelines
Cleanup callback on pipeline teardown
.qsp.filter should verify the type of the return value
Runtime fails to compile when operations have the same ID
isAsync dict is incorrect if two plugins have the same ID