Skip to content

How to Deploy the FSI Accelerator

See the following for steps on how to deploy an FSI accelerator package.

Push the Packages

Push the fsi-lib and accelerator package to your kdb Insights Enterprise install using the kxi package push command.

 > ls /tmp/artifacts
fsi-data-assembly-1.0.0.kxi  fsi-lib-1.0.0.kxi
 >
 > kxi package push --force fsi-lib/1.0.0
{
    "fsi-lib": [
        {
            "version": "1.0.0",
            "_status": "InstallationStatus.SUCCESS"
        }
    ]
}
 >
 > kxi package push --force fsi-data-assembly/1.0.0
{
    "fsi-data-assembly": [
        {
            "version": "1.0.0",
            "_status": "InstallationStatus.SUCCESS"
        }
    ]
}
 >
 > kxi package remote-list
{
    "fsi-data-assembly": [
        {
            "fields": {},
            "version": "1.0.0"
        }
    ],
    "fsi-lib": [
        {
            "fields": {},
            "version": "1.0.0"
        }
    ]
}
 >

Bounce the aggregators and resource coordinators

Bounce the insights aggregators and resource coordinators to ensure the fsi-lib aggregation functions are picked up.

 > kubectl delete pod insights-aggregator-0
pod "insights-aggregator-0" deleted
 >
 > kubectl delete pod insights-qe-aggregator-0
pod "insights-qe-aggregator-0" deleted
 >
 > kubectl delete pod insights-resource-coordinator-0
pod "insights-resource-coordinator-0" deleted
 >
 > kubectl delete pod insights-qe-resource-coordinator-0
pod "insights-qe-resource-coordinator-0" deleted
 >

Note that if the pre-requisite has not been done that lists the package in the aggregator and resource co-ordinator, then the APIs will error reporting no such join function fsiJoin.

If the environment variables for the package were not set up pre-install in the values.yaml, they can be added by editing the stateful set.

 > kubectl edit sts insights-aggregator

adding

        - name: KXI_PACKAGES
          value: fsi-lib:1.0.0

at spec.template.spec.contains.env next to

        - name: KX_PACKAGE_PATH
          value: /opt/kx/shared/packaging/packages

Deploy fsi-data-assembly

Deploy the fsi-data-assembly package with kxi package deploy.

 > kubectl get pods
NAME                                            READY   STATUS    RESTARTS          AGE
insights-aggregator-0                           2/2     Running   221 (4h52m ago)   13h
insights-api-gateway-867d9776d5-r2g6d           1/1     Running   0                 14h
insights-client-controller-86b88cf88d-hcmtx     2/2     Running   0                 2d8h
insights-discovery-proxy-d478c5d7-scp6b         2/2     Running   237 (4h53m ago)   14h
insights-gui-848cf5b5d9-jfw2m                   1/1     Running   0                 22h
insights-gui-data-69b4f86899-gn6m8              1/1     Running   0                 2d8h
insights-gui-gateway-0                          1/1     Running   119 (4h55m ago)   14h
insights-information-service-65ffb69cfd-jgfqc   2/2     Running   0                 2d8h
insights-keycloak-0                             1/1     Running   1 (4d17h ago)     4d17h
insights-kxi-acc-svc-0                          1/1     Running   1 (4h48m ago)     4d8h
insights-kxi-controller-0                       2/2     Running   0                 4d17h
insights-kxi-discovery-service-0                1/1     Running   0                 4d17h
insights-kxi-package-manager-77d669db59-hkgv2   1/1     Running   0                 2d1h
insights-kxi-scratchpad-788985f968-tqjqp        1/1     Running   0                 4d17h
insights-kxi-service-broker-5c5978fb46-djt2z    1/1     Running   0                 14h
insights-kxi-sp-5f758b8c68-96wcp                2/2     Running   254 (4h52m ago)   15h
insights-postgresql-0                           1/1     Running   0                 15h
insights-qe-aggregator-0                        2/2     Running   253 (4h53m ago)   15h
insights-qe-gateway-84f58899f8-pdbt5            1/1     Running   109 (4h48m ago)   15h
insights-qe-resource-coordinator-0              2/2     Running   221 (4h52m ago)   13h
insights-resource-coordinator-0                 2/2     Running   220 (4h53m ago)   13h
insights-sg-gateway-767cc9db5d-6z7zg            1/1     Running   100 (4h55m ago)   2d22h
 >
 >
 >
 > kxi package deploy fsi-data-assembly/1.0.0 --local --without-version
Deployment fsi-data-assembly-100-0f9a: Starting
Searching for potential name collisions:
Searching: Finished
Deployment fsi-data-assembly-100-0f9a: Ready
Deployment fsi-data-assembly-100-0f9a: Deployed
{
    "packageName": "fsi-data-assembly",
    "packageVersion": "1.0.0",
    "uuid": "d979635d-352a-4dca-8a01-2ae3e3550f9a",
    "status": "Deployed",
    "pipelines": [
        "eb164462-e38e-54da-3bbf-e203ae0bdb32",
        "23e93d00-c799-40ac-38b8-62a6bc0b5cbf",
        "40f8a542-0a38-6a58-4f83-120914b2420a",
        "de2ed92f-716d-63cf-2f26-98dabfe6549d",
        "5f2f752a-43f9-e63f-f243-49ad16acfc46",
        "3bac5431-bd07-470b-5e48-f3ab8053073d",
        "d145e849-3234-ecf4-cd0e-7c5e66bc050b",
        "ddd79936-b321-6c91-3ab5-18846187e0ff",
        "8466bce8-395d-303e-f8d3-f9041a27363d",
        "6d46d33d-d1dd-531a-a78a-eb9e1c3b3c6d"
    ],
    "databases": [
        "ec1c709e-33c6-6934-e1e9-71e8bfd2e903"
    ],
    "assemblies": [
        "a086610d-a1dd-7854-496d-c42caf590acc"
    ],
    "streams": [
        "fc5eb6d1-64ab-b3b6-5601-b715f31d1f3f",
        "c4866c3b-e5cf-9e63-93ba-53dd09b93caf"
    ],
    "schemas": [
        "9ec4ebcb-bece-c316-60c5-0379c826125f"
    ],
    "update_time": "2023-07-11T23:51:28.372986",
    "instance": "https://user.aws-acceldev.kxi-dev.kx.com",
    "name": "fsi-data-assembly-100-0f9a",
    "deploy_name": "fsi-data-assembly",
    "error": {
        "content": ""
    }
}
 >
 >
 >
 >
 > kubectl get pods
NAME                                            READY   STATUS    RESTARTS          AGE
fsi-data-assembly-cancordaybeforeyday-1-spwork-0       2/2     Running   0                 65s
fsi-data-assembly-cancordaybeforeyday-spctl-0          2/2     Running   0                 82s
fsi-data-assembly-cancoreachsecondtoday-1-spwork-0     2/2     Running   0                 58s
fsi-data-assembly-cancoreachsecondtoday-spctl-0        2/2     Running   0                 82s
fsi-data-assembly-cancortoday-1-spwork-0               2/2     Running   0                 62s
fsi-data-assembly-cancortoday-spctl-0                  2/2     Running   0                 81s
fsi-data-assembly-cancoryday-1-spwork-0                2/2     Running   0                 60s
fsi-data-assembly-cancoryday-spctl-0                   2/2     Running   0                 81s
fsi-data-assembly-dap-hdb-0                            2/2     Running   0                 82s
fsi-data-assembly-dap-idb-0                            2/2     Running   0                 82s
fsi-data-assembly-dap-rdb-0                            2/2     Running   0                 82s
fsi-data-assembly-qe-dap-hdb-0                         2/2     Running   0                 79s
fsi-data-assembly-qe-dap-idb-0                         2/2     Running   0                 79s
fsi-data-assembly-qe-dap-rdb-0                         2/2     Running   0                 79s
fsi-data-assembly-refcorpactions-1-spwork-0            2/2     Running   0                 60s
fsi-data-assembly-refcorpactions-spctl-0               2/2     Running   0                 82s
fsi-data-assembly-refinitivrealtime-1-spwork-0         2/2     Running   0                 60s
fsi-data-assembly-refinitivrealtime-spctl-0            2/2     Running   0                 82s
fsi-data-assembly-refinstrument-1-spwork-0             2/2     Running   0                 60s
fsi-data-assembly-refinstrument-spctl-0                2/2     Running   0                 81s
fsi-data-assembly-sm-0                                 2/2     Running   0                 82s
fsi-data-assembly-trthcancor-1-spwork-0                2/2     Running   0                 59s
fsi-data-assembly-trthcancor-spctl-0                   2/2     Running   0                 81s
fsi-data-assembly-trthquotes-1-spwork-0                2/2     Running   0                 60s
fsi-data-assembly-trthquotes-spctl-0                   2/2     Running   0                 81s
fsi-data-assembly-trthtrades-1-spwork-0                2/2     Running   0                 60s
fsi-data-assembly-trthtrades-spctl-0                   2/2     Running   0                 81s
insights-aggregator-0                           2/2     Running   221 (4h54m ago)   13h
insights-api-gateway-867d9776d5-r2g6d           1/1     Running   0                 14h
insights-client-controller-86b88cf88d-hcmtx     2/2     Running   0                 2d8h
insights-discovery-proxy-d478c5d7-scp6b         2/2     Running   237 (4h55m ago)   14h
insights-gui-848cf5b5d9-jfw2m                   1/1     Running   0                 22h
insights-gui-data-69b4f86899-gn6m8              1/1     Running   0                 2d8h
insights-gui-gateway-0                          1/1     Running   119 (4h57m ago)   14h
insights-information-service-65ffb69cfd-jgfqc   2/2     Running   0                 2d8h
insights-keycloak-0                             1/1     Running   1 (4d17h ago)     4d17h
insights-kxi-acc-svc-0                          1/1     Running   1 (4h50m ago)     4d8h
insights-kxi-controller-0                       2/2     Running   0                 4d17h
insights-kxi-discovery-service-0                1/1     Running   0                 4d17h
insights-kxi-package-manager-77d669db59-hkgv2   1/1     Running   0                 2d1h
insights-kxi-scratchpad-788985f968-tqjqp        1/1     Running   0                 4d17h
insights-kxi-service-broker-5c5978fb46-djt2z    1/1     Running   0                 14h
insights-kxi-sp-5f758b8c68-96wcp                2/2     Running   254 (4h54m ago)   15h
insights-postgresql-0                           1/1     Running   0                 15h
insights-qe-aggregator-0                        2/2     Running   253 (4h55m ago)   15h
insights-qe-gateway-84f58899f8-pdbt5            1/1     Running   109 (4h49m ago)   15h
insights-qe-resource-coordinator-0              2/2     Running   221 (4h54m ago)   13h
insights-resource-coordinator-0                 2/2     Running   220 (4h55m ago)   13h
insights-sg-gateway-767cc9db5d-6z7zg            1/1     Running   100 (4h56m ago)   2d22h
rt-fsi-data-assembly-fsi-data-0                        2/2     Running   0                 83s
rt-fsi-data-assembly-fsi-data-1                        2/2     Running   0                 67s
rt-fsi-data-assembly-fsi-data-2                        2/2     Running   0                 53s
rt-fsi-data-assembly-fsi-north-0                       2/2     Running   0                 82s
rt-fsi-data-assembly-fsi-north-1                       2/2     Running   0                 67s
rt-fsi-data-assembly-fsi-north-2                       2/2     Running   0                 53s
 >