KX Insights Core 1.0.4

Release Date

2021-05-11

REST Client

[FIX] CURL_CA_BUNDLE flag introduced to allow specification of location of CA cert file

[FIX] OAuth2 Remote Disclaimers added

Object Store

[FIX] Nested file support added. This was previously missing as it did not escape # or ## which is part of the nested tri-file. This escapes the usual special chars other than !'()*@ which should not be in a filename anyway. Tested by reading the nested tri-files at get`:s3://kxtaq/data/nested the tri-files are nested, nested# and nested##, all of which are read when one loads nested.

[FIX] ignore keys ending in /. When a folder is created via the aws console, it creates a null object in the folder. This was causing an error in par.txt usage. So for example:

q)key$":s3://app-id-89167-dep-id-64668-uu-id-zgviythhnjyt/" 
s#cleanBK_2021.04.15fx-priceecnhdb-fx-price-ecnsym-files
q)key$":s3://app-id-89167-dep-id-64668-uu-id-zgviythhnjyt/hdb-fx-price-ecn/" 
s#``2017.12.06
q)key$":s3://app-id-89167-dep-id-64668-uu-id-zgviythhnjyt/hdb-fx-price-ecn/2017.12.06" 
,priceECN

Notice the hdb-fx-price-ecn directory has a null as the first element. The fix eliminates the null folder.

q)key$":s3://app-id-89167-dep-id-64668-uu-id-zgviythhnjyt/fx-hdb/" 
s#priceECN 
q)key`$":s3://app-id-89167-dep-id-64668-uu-id-zgviythhnjyt/fx-hdb/priceECN/" 
`s#2017.12.06
q)key$":s3://app-id-89167-dep-id-64668-uu-id-zgviythhnjyt/fx-hdb/priceECN/2017.12.06" 
s#``priceECN

Logging

[FIX] Better handling when KXI_LOG_CONFIG is set to the wrong value

[FIX] System wide logging configuration added

qpacker

[NEW] Update Kdb+ 4.0 2021-05-07

[FIX] Several build improvements (cleaning, validation, shared object sharing)

[FIX] qpacker qpk search name should match qpk name. When searching for a qpk for comparison in is_unclean qp should use the same naming convention for the qpk as the create_qpk function

[FIX] qpacker now checks for changes in dependencies when rebuilding

[FIX] Allow users to add content (such as proxy settings) to dockerfiles produced by q-packer without manually editing files

[FIX] Update to allow correct loading when qp python pathlib isn't accessible.

[FIX] Add //dnc for qpacker dnc option

[FIX] Allow qp push to release from qpbuild subdirs

[FIX] qpacker now checks if application directories contain at least a startq.q file and report failure if they do not. Previously this condition was not picked up

[FIX] qpacker doctor now lists available apps for qp run if an app named default cannot be found

[FIX] qpacker no longer prints license text when not using tty

[FIX] qp installer now checks if installed in non-default location

[FIX] build and use qpacker on OSX

[FIX] zconf and alpine-openssl added

[FIX] is_unclean was failing in certain circumstances. As a result if applications would not have been built correctly.

[FIX] qp warning added to notify the user if image contents are the same

[FIX] qp warning added if invalid dep layout detected

[FIX] Extra handling added to fund ssl certificates in default locations on different OS

This is where qpacler looks for public root certificates:
"/etc/ssl/certs/ca-certificates.crt",                // Debian/Ubuntu/Gentoo etc.
"/etc/pki/tls/certs/ca-bundle.crt",                  // Fedora/RHEL 6
"/etc/ssl/ca-bundle.pem",                            // OpenSUSE
"/etc/pki/tls/cacert.pem",                           // OpenELEC
"/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem", // CentOS/RHEL 7
"/etc/ssl/cert.pem",                                 // Alpine Linux

Also:

"/etc/ssl/certs",               // SLES10/SLES11, https://golang.org/issue/12139
"/system/etc/security/cacerts", // Android
"/usr/local/share/certs",       // FreeBSD
"/etc/pki/tls/certs",           // Fedora/RHEL
"/etc/openssl/certs",           // NetBSD
"/var/ssl/certs",               // AIX


libcurl (and thus kurl) always respect CURL_CA_BUNDLE thus

export CURL_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt

[FIX] qp now presents users with image sizes docker images --no-trunc -f "dangling=true" --format "{{.ID}}: {{.Size}}" | grep ${tp} | awk '{print $2}'

[FIX] qp optimised so that docker will symlink several libs in one docker build layer

[FIX] qp now used qpbuild as shadow dir

[FIX] qpk tool added to help manage qpk files

qpk -xd [appname]

opens qp.json in the current directory, and unzip each dependency of appname into qpbuild/appname/ respecting e.g. weird-dep sample

[FIX] Error now reported from qp push when registry fails to update

[FIX] Allow ctrl-z when using qshell

[FIX] p.q now treated as a load-instruction in the startq.q

[FIX] qp no longer runs build step as root user