How to Deploy the FSI Accelerator
See the following for steps on how to deploy an FSI accelerator package.
Push the Packages
Push the fsi-lib and accelerator package to your kdb Insights Enterprise install using the kxi package push command.
> ls /tmp/artifacts
fsi-data-assembly-1.0.0.kxi fsi-lib-1.0.0.kxi
>
> kxi package push --force fsi-lib/1.0.0
{
"fsi-lib": [
{
"version": "1.0.0",
"_status": "InstallationStatus.SUCCESS"
}
]
}
>
> kxi package push --force fsi-data-assembly/1.0.0
{
"fsi-data-assembly": [
{
"version": "1.0.0",
"_status": "InstallationStatus.SUCCESS"
}
]
}
>
> kxi package remote-list
{
"fsi-data-assembly": [
{
"fields": {},
"version": "1.0.0"
}
],
"fsi-lib": [
{
"fields": {},
"version": "1.0.0"
}
]
}
>
Bounce the aggregators and resource coordinators
Bounce the insights aggregators and resource coordinators to ensure the fsi-lib aggregation functions are picked up.
> kubectl delete pod insights-aggregator-0
pod "insights-aggregator-0" deleted
>
> kubectl delete pod insights-qe-aggregator-0
pod "insights-qe-aggregator-0" deleted
>
> kubectl delete pod insights-resource-coordinator-0
pod "insights-resource-coordinator-0" deleted
>
> kubectl delete pod insights-qe-resource-coordinator-0
pod "insights-qe-resource-coordinator-0" deleted
>
Note that if the pre-requisite has not been done that lists the package in the aggregator and resource coordinator, then the APIs will error reporting no such join function fsiJoin.
If the environment variables for the package were not set up pre-install in the values.yaml, they can be added by editing the stateful set.
> kubectl edit sts insights-aggregator
adding
- name: KXI_PACKAGES
value: fsi-lib:1.0.0
at spec.template.spec.contains.env next to
- name: KX_PACKAGE_PATH
value: /opt/kx/shared/packaging/packages
Deploy fsi-data-assembly
Deploy the fsi-data-assembly package with kxi package deploy.
> kubectl get pods
NAME READY STATUS RESTARTS AGE
insights-aggregator-0 2/2 Running 221 (4h52m ago) 13h
insights-api-gateway-867d9776d5-r2g6d 1/1 Running 0 14h
insights-client-controller-86b88cf88d-hcmtx 2/2 Running 0 2d8h
insights-discovery-proxy-d478c5d7-scp6b 2/2 Running 237 (4h53m ago) 14h
insights-gui-848cf5b5d9-jfw2m 1/1 Running 0 22h
insights-gui-data-69b4f86899-gn6m8 1/1 Running 0 2d8h
insights-gui-gateway-0 1/1 Running 119 (4h55m ago) 14h
insights-information-service-65ffb69cfd-jgfqc 2/2 Running 0 2d8h
insights-keycloak-0 1/1 Running 1 (4d17h ago) 4d17h
insights-kxi-acc-svc-0 1/1 Running 1 (4h48m ago) 4d8h
insights-kxi-controller-0 2/2 Running 0 4d17h
insights-kxi-discovery-service-0 1/1 Running 0 4d17h
insights-kxi-package-manager-77d669db59-hkgv2 1/1 Running 0 2d1h
insights-kxi-scratchpad-788985f968-tqjqp 1/1 Running 0 4d17h
insights-kxi-service-broker-5c5978fb46-djt2z 1/1 Running 0 14h
insights-kxi-sp-5f758b8c68-96wcp 2/2 Running 254 (4h52m ago) 15h
insights-postgresql-0 1/1 Running 0 15h
insights-qe-aggregator-0 2/2 Running 253 (4h53m ago) 15h
insights-qe-gateway-84f58899f8-pdbt5 1/1 Running 109 (4h48m ago) 15h
insights-qe-resource-coordinator-0 2/2 Running 221 (4h52m ago) 13h
insights-resource-coordinator-0 2/2 Running 220 (4h53m ago) 13h
insights-sg-gateway-767cc9db5d-6z7zg 1/1 Running 100 (4h55m ago) 2d22h
>
>
>
> kxi package deploy fsi-data-assembly/1.0.0 --local --without-version
Deployment fsi-data-assembly-100-0f9a: Starting
Searching for potential name collisions:
Searching: Finished
Deployment fsi-data-assembly-100-0f9a: Ready
Deployment fsi-data-assembly-100-0f9a: Deployed
{
"packageName": "fsi-data-assembly",
"packageVersion": "1.0.0",
"uuid": "d979635d-352a-4dca-8a01-2ae3e3550f9a",
"status": "Deployed",
"pipelines": [
"eb164462-e38e-54da-3bbf-e203ae0bdb32",
"23e93d00-c799-40ac-38b8-62a6bc0b5cbf",
"40f8a542-0a38-6a58-4f83-120914b2420a",
"de2ed92f-716d-63cf-2f26-98dabfe6549d",
"5f2f752a-43f9-e63f-f243-49ad16acfc46",
"3bac5431-bd07-470b-5e48-f3ab8053073d",
"d145e849-3234-ecf4-cd0e-7c5e66bc050b",
"ddd79936-b321-6c91-3ab5-18846187e0ff",
"8466bce8-395d-303e-f8d3-f9041a27363d",
"6d46d33d-d1dd-531a-a78a-eb9e1c3b3c6d"
],
"databases": [
"ec1c709e-33c6-6934-e1e9-71e8bfd2e903"
],
"assemblies": [
"a086610d-a1dd-7854-496d-c42caf590acc"
],
"streams": [
"fc5eb6d1-64ab-b3b6-5601-b715f31d1f3f",
"c4866c3b-e5cf-9e63-93ba-53dd09b93caf"
],
"schemas": [
"9ec4ebcb-bece-c316-60c5-0379c826125f"
],
"update_time": "2023-07-11T23:51:28.372986",
"instance": "https://user.aws-acceldev.kxi-dev.kx.com",
"name": "fsi-data-assembly-100-0f9a",
"deploy_name": "fsi-data-assembly",
"error": {
"content": ""
}
}
>
>
>
>
> kubectl get pods
NAME READY STATUS RESTARTS AGE
fsi-data-assembly-cancordaybeforeyday-1-spwork-0 2/2 Running 0 65s
fsi-data-assembly-cancordaybeforeyday-spctl-0 2/2 Running 0 82s
fsi-data-assembly-cancoreachsecondtoday-1-spwork-0 2/2 Running 0 58s
fsi-data-assembly-cancoreachsecondtoday-spctl-0 2/2 Running 0 82s
fsi-data-assembly-cancortoday-1-spwork-0 2/2 Running 0 62s
fsi-data-assembly-cancortoday-spctl-0 2/2 Running 0 81s
fsi-data-assembly-cancoryday-1-spwork-0 2/2 Running 0 60s
fsi-data-assembly-cancoryday-spctl-0 2/2 Running 0 81s
fsi-data-assembly-dap-hdb-0 2/2 Running 0 82s
fsi-data-assembly-dap-idb-0 2/2 Running 0 82s
fsi-data-assembly-dap-rdb-0 2/2 Running 0 82s
fsi-data-assembly-qe-dap-hdb-0 2/2 Running 0 79s
fsi-data-assembly-qe-dap-idb-0 2/2 Running 0 79s
fsi-data-assembly-qe-dap-rdb-0 2/2 Running 0 79s
fsi-data-assembly-refcorpactions-1-spwork-0 2/2 Running 0 60s
fsi-data-assembly-refcorpactions-spctl-0 2/2 Running 0 82s
fsi-data-assembly-refinitivrealtime-1-spwork-0 2/2 Running 0 60s
fsi-data-assembly-refinitivrealtime-spctl-0 2/2 Running 0 82s
fsi-data-assembly-refinstrument-1-spwork-0 2/2 Running 0 60s
fsi-data-assembly-refinstrument-spctl-0 2/2 Running 0 81s
fsi-data-assembly-sm-0 2/2 Running 0 82s
fsi-data-assembly-trthcancor-1-spwork-0 2/2 Running 0 59s
fsi-data-assembly-trthcancor-spctl-0 2/2 Running 0 81s
fsi-data-assembly-trthquotes-1-spwork-0 2/2 Running 0 60s
fsi-data-assembly-trthquotes-spctl-0 2/2 Running 0 81s
fsi-data-assembly-trthtrades-1-spwork-0 2/2 Running 0 60s
fsi-data-assembly-trthtrades-spctl-0 2/2 Running 0 81s
insights-aggregator-0 2/2 Running 221 (4h54m ago) 13h
insights-api-gateway-867d9776d5-r2g6d 1/1 Running 0 14h
insights-client-controller-86b88cf88d-hcmtx 2/2 Running 0 2d8h
insights-discovery-proxy-d478c5d7-scp6b 2/2 Running 237 (4h55m ago) 14h
insights-gui-848cf5b5d9-jfw2m 1/1 Running 0 22h
insights-gui-data-69b4f86899-gn6m8 1/1 Running 0 2d8h
insights-gui-gateway-0 1/1 Running 119 (4h57m ago) 14h
insights-information-service-65ffb69cfd-jgfqc 2/2 Running 0 2d8h
insights-keycloak-0 1/1 Running 1 (4d17h ago) 4d17h
insights-kxi-acc-svc-0 1/1 Running 1 (4h50m ago) 4d8h
insights-kxi-controller-0 2/2 Running 0 4d17h
insights-kxi-discovery-service-0 1/1 Running 0 4d17h
insights-kxi-package-manager-77d669db59-hkgv2 1/1 Running 0 2d1h
insights-kxi-scratchpad-788985f968-tqjqp 1/1 Running 0 4d17h
insights-kxi-service-broker-5c5978fb46-djt2z 1/1 Running 0 14h
insights-kxi-sp-5f758b8c68-96wcp 2/2 Running 254 (4h54m ago) 15h
insights-postgresql-0 1/1 Running 0 15h
insights-qe-aggregator-0 2/2 Running 253 (4h55m ago) 15h
insights-qe-gateway-84f58899f8-pdbt5 1/1 Running 109 (4h49m ago) 15h
insights-qe-resource-coordinator-0 2/2 Running 221 (4h54m ago) 13h
insights-resource-coordinator-0 2/2 Running 220 (4h55m ago) 13h
insights-sg-gateway-767cc9db5d-6z7zg 1/1 Running 100 (4h56m ago) 2d22h
rt-fsi-data-assembly-fsi-data-0 2/2 Running 0 83s
rt-fsi-data-assembly-fsi-data-1 2/2 Running 0 67s
rt-fsi-data-assembly-fsi-data-2 2/2 Running 0 53s
rt-fsi-data-assembly-fsi-north-0 2/2 Running 0 82s
rt-fsi-data-assembly-fsi-north-1 2/2 Running 0 67s
rt-fsi-data-assembly-fsi-north-2 2/2 Running 0 53s
>