Introduction¶
Information about the KX Refinery Releases
| Release | Features | Release Date |
|---|---|---|
| 5.15.7 | RefineryCore Fixed an issue where .pmc.regInfo.processes was not updated correctly. Fixed an issue that prevented stale hosts and ports from being cleared when a pipeline shut down. |
24th April 2026 |
| 5.15.6 | RefineryCore Fixed an issue where getStats API calls for named analytics failed when run on single processes. |
17th April 2026 |
| 5.15.5 | RefineryCore Resolved an issue where named analytics did not work as intended. Resolved an issue where tables with no rows were incorrectly queued for clearing. Improved the accuracy of spanBucket calculations. |
9th April 2026 |
| 5.15.4 | RefineryCore Resolved an issue where an incorrect table was selected during HDB startup Resolved an issue where gateways contained null hostPort values for pipelines Added is-reference-data as a new table YAML configuration option Removed the dependency on overBoundary features when using HDB-only pipelines with is-reference-data tables |
16th March 2026 |
| 5.15.3 | RefineryCore Resolved an issue where RTEs would error when using the limit parameter Resolved an issue where partition tables were getting saved as rootsplay tables Resolved an issue that occurred when attempting to write from splay to HDB when the corresponding table was missing on EPDB |
10th February 2026 |
| 5.15.2 | RefineryCore Resolved an issue where processes did not receive updated process information from the (Process Manager) PM Resolved an issue causing increased memory usage during HDB startup. Fixed an issue with the compatibility of certain table yamls on the startup of HDB, including year/month partition, non-timeseries, root-splay, etc. |
16th January 2026 |
| 5.15.1 | RefineryCore Refinery has been upgraded to Delta Platform version 4.12.1. Fixed an issue where byCol and idCol wouldn't work with granularity Added the table format combination of intra-persist-type: splay and end-persist-type: root-splay. |
12th December 2025 |
| 5.15.0 | RefineryCore Refinery has been upgraded to Delta Platform version 4.12.0. Added the limit parameter to the getTicks API. Removed the Refinery foreign key implementation. Fixed an issue where schemas failed when the table pipeline had intrapersisttype=none and end-persist-type=root-splay. Resolved an issue where an overboundary value in HDB caused errors during startup. Fixed a handle issue that caused the EPDB process to hang while waiting for the HDB to unlock. Addressed an issue where an empty boolean value occurred when retrieving RDB & HDB overboundary data. |
14th November 2025 |
| 5.14.0 | RefineryCore Fixed an issue where processes failed to register after being brought back online. Fixed an issue that affected the bucketing functionality with the IDB. Corrected bucketing behavior on non-IDB setups where the End of Day (EOD) was configured to a time other than midnight. |
6th October 2025 |
| 5.13.2 | RefineryCore Fixed an issue where some user queries wouldn't show in the GwQueryStatus table |
5th September 2025 |
| 5.13.1 | RefineryCore Resolved an issue where triggering two pipelines simultaneously prevented the second pipeline from starting as expected. Granted the refProcadmin user the necessary SELECT permission on the upd process within the Process Manager for each pipeline. Added the missing SELECT permission for the refProcadmin user on the client registration process manager. |
18th July 2025 |
| 5.13.0 | RefineryCore Secure deployment. Delta Refinery Sandbox can now be deployed without using the skip-secure-deploy flag, enhancing security by default. Note that this feature is currently not compatible with Monitoring environments. refProcadmin user permission update. The refProcadmin user role has been updated to include select access for all APIs within Delta Refinery, improving visibility and administrative control. Refinery has been upgraded to Delta Platform version 4.11.0. |
30th June 2025 |
| 5.12.0 | RefineryCore Delta Refinery has been updated to support the following security features: Pipeline permissions. Pipelines now support access control, allowing you to restrict access and API usage to authorized users only. Secure deployment. Delta Refinery can now be deployed without using the skip-secure-deploy flag. (Note: this is currently not compatible with Sandbox or Monitoring environments). Improved authentication. The previously hardcoded Administrator credentials have been removed from Refinery libraries. They have been replaced with a generated RefProcadmin user. Changing the Administrator password no longer disrupts communication between Refinery pipelines. |
30th May 2025 |
| 5.11.3 | RefineryCore Improved the ingestion of YAML files by the Refinery Process Manager to optimize startup efficiency. Upgraded Refinery to Delta Platform version 4.10.2. Fixed an issue where the IPDB failed to write yesterday's data when the 'exclude today' option was configured. Resolved an issue where Sandbox client environments failed to initialize when on the same host as the Sandbox server. |
9th May 2025 |
| 5.11.2 | RefineryCore Fixed an issue where the ipdb, epdb, and rdb would enter a loop waiting for each other during late write when "exclude today" was configured. Fixed an issue where timeouts were not being disabled in the RDB during late write. Fixed an issue where empty date directories were not deleted in the late data directory after late write when "exclude today" was configured. |
14th April 2025 |
| 5.11.1 | RefineryCore Added rolloverExcludeToday, a pipeline feature that excludes today's data during EOD rollover. Upgraded Refinery to Delta Platform v4.10.1. Fixed an issue where the rollover.complete event wasn't triggered during the first rollover for month and year partitions. Resolved an error that occurred when unregistered processes failed to connect before applying rerouting logic. Fixed an issue where late data writes to the HDB caused it to reload before clearing the RDB data, resulting in duplicate query results. RefineryDomainFinance Resolved an issue where certain packages weren't properly included in the Finance-Domain bundle |
7th March 2025 |
| 5.11.0 | RefineryCore Enhanced get* APIs to support more complex applyFilter parameters. applyFilter may now contain nested conditions. Disabled query timeouts on the HDB when blocked for late data writes. Upgraded Refinery to Delta v4.10. Fixed an issue where sending get* API calls as strings wouldn't evaluate the date arithmetic. Resolved an issue where query timeouts were not re-enabled after a rollover in HDB and RDB. |
17th February 2025 |
| 5.10.4 | RefineryCore Improved performance efficiency when querying one day's worth of data with byCol and granularityUnit set to day. |
17th January 2025 |
| 5.10.3 | RefineryCore Fixed an issue where the layouts of certain multi-environment pipelines were failing due to gw-reroute-procs. |
29th November 2024 |
| 5.10.2 | RefineryCore Fixed an issue causing errors when using underlyingStatsTab. Fixed an issue where an IPDB error message wasn't logging correctly. |
8th November 2024 |
| 5.10.1 | RefineryCore Added an enhancement that allows 'gw-reroute-procs' to work with UDFs and the Multi Environment Setting. RefineryCLI Fixed an issue where Refinery pipeline --layout CLI didn't support hosts that weren't available. |
11th October 2024 |
| 5.10.0 | RefineryCore Upgraded Refinery to Delta v4.9.1. Integration of InsightsCore & PyKX to Refinery. Fixed an issue where the IDB and LDIDB would fail when empty. |
27th September 2024 |
| 5.9.4 | RefineryCore Added a pipeline YAML configuration gw-reroute-procs that reroutes gateway queries if an RDB (unsharded), HDB or RTE instance fails. Fixed an issue where the RTE was missing a variable. RefineryCLI Added Refinery pipeline CLI --layout that displays the pipeline's processes, host and port, and status. |
13th September 2024 |
| 5.9.3 | RefineryCore&CLI Fixed an issue where the refinery udf --info CLI failed when combined with --funcName Fixed an issue where the refinery udf --modify CLI failed due to a missing variable Fixed an issue where the refinery udf --delete CLI failed due to a missing function |
29th August 2024 |
| 5.9.2 | RefineryCore Fixed an issue where HDBs could become indefinitely blocked when an error occurred in the EPDB. RefineryCLI Fixed an issue where the Refinery install CLI did not support the new Delta install script |
16th August 2024 |
| 5.9.1 | RefineryCore Fixed an issue where staticUDF queries weren't reloaded when there was a comment in the q file. Fixed an issue where staticUDF queries weren't routed correctly. RefineryCLI Added an enhancement that enables UDF reloads to use sync command line responses. |
12th July 2024 |
| 5.9.0 | RefineryCore Upgraded Refinery to include Delta v4.8.2 and kdb+ 4.1 . Fixed an issue where the Monitoring Feedhandler tried to load a library that didn't exist. Fixed an issue where the Monitoring Feedhandler tried to flatten a dict with null values. Fixed an issue where the IDB wasn't reloading its tables properly. |
24th June 2024 |
| 5.8.5 | RefineryCore Fixed an issue where the getStats API would fail when you used KDB foreign keys within the byCol parameter and granularity that spanned across the RDB and HDB Added back the functionality of being able to use par.txt files with Refinery |
7th June 2024 |
| 5.8.4 | RefineryCore Fixed an issue where if there was a gateway routing error occur the correct error message wasn't displaying correctly Added an enhancement which improves the performance of time zone adjustments across extremely large datasets Refinery CLI Added an enhancement where you can config the location of the failover.csv file |
24th May 2024 |
| 5.8.3 | RefineryDomainFinance Fixed a bug where the sbxClient.finance.q file wouldn't load Added an enhancement that allows applyFilter to work with getRef |
10th May 2024 |
| 5.8.2 | Refinery Core Fixed an issue where API function wasn't getting pushed to the GwQueryStatus table on a failed API query Fixed an issue where the wrong time zone was getting assigned to a Monitoring schedule Added additional Monitoring hooks that allows for the ability to modify the GwQueryStatus table Refinery Monitoring Fixed an issue where type errors were appearing in the monFH and mon TP |
28th March 2024 |
| 5.8.1 | Refinery Core Added enhancement that allows the Monitoring Pipeline to function within the Finance-domain Refinery without "subscribe-from-delta-messaging: true" Added enhancement that allows client pipeline HDBs to be seen by the Monitoring Dashboard's 'HDB Max Date Check' table Added enhancement to allow foreign keys comprised of compound keys to be queried through getTicks and getStats |
13th March 2024 |
| 5.8.0 | Refinery CLI Fixed a bug where the CLI returned a message saying the PM was ready before it had fully initialised Refinery Core Added enhancement that allows for flexibility in deploying HDBs across multiple hosts in a pipeline Added enhancement that allows the ability for custom client code to modify the GwQueryStatus table Fixed an issue where multiple to one idMapping symbology configuration wasn't working as intended Fixed issue where TP rollover wasn't taking the pipeline's timezone |
27th February 2024 |
| 5.7.7 | Core Fixed issue where getStats buckets were creating inaccurate bucket counts Fixed issue where timestamp columns weren't getting converted |
2nd February 2024 |
| 5.7.6 | Core Fixed an issue where the analytics parameter wouldn't accept a dictionary Fixed issue where getStats analytic timestamp aggregation results (last; `writeTime) weren't getting time zone converted |
26th January 2024 |
| 5.7.5 | Core Updated convertOnDiskTZtoOutboundTZ function to include Refinery 5 configuration Fixed an issue where disableValidation for APIs weren't working with custom libraries Refinery Domain Finance Added a getBars query shortcut when working with 1-min bar aggregation Refinery Monitoring Added Documentation on how to install Refinery Monitoring using tgz files |
12th January 2024 |
| 5.7.4P1 | Core Fixed issue where temporality wasn't working with getBars |
10th January 2024 |
| 5.7.4 | Refinery Core Fixed issue where not all timestamp columns weren't getting converted to specified timezone Fixed issue where timeRack buckets weren't being updated to the pipeline's timezone Fixed issue when TP would restart between 00:00 UTC and 00:00 local and not reset TP rollover to 00:00:01 local Fixed issue when the spanBucket calculation included the final time bucket data point |
19th December 2023 |
| 5.7.3 | Refinery Domain Finance Fixed scheduling errors on RefineryFinance Startup |
1st December 2023 |
| 5.7.2 | Core Enhancement for API calls using cache metadata for partitioned schemas Enhancement to disable individual query validations at GW and DB level Bugfix for Reference fKeys getting caught in functional clause Bugfix for filtering char columns with getTicks Bugfix for port parsing on non-environment based pipelines Refinery Domain Finance Enhancement for API calls using cache metadata for partitioned schemas Enhancement to disable individual query validations at GW and DB level |
17th November 2023 |
| 5.7.1 | Core Bugfixes for API calls across daylight savings time and time column being omitted from getStats when granularity&granularityUnits are used Refinery Domain Finance Re-enabled API calls of peach on database processes Refinery CLI Added support to start individual pipeline processes and list service classes via process command |
3rd November 2023 |
| 5.7.0P1 | Core Fixed issues in environment yaml definition |
25th October 2023 |
| 5.7.0 | Core Added environment proc-layout to pipeline YAML config Added environment process settings to pipeline YAML config Added KDB foreign keys to Refinery APIs Ability to peach across getTicks Refinery Domain Finance Added the ability to query on-disk taq table through Refinery APIs Refinery CLI Bugfix for return code passed back to shell from interactive Refinery CLI |
20th October 2023 |
| 5.6.3P1 | Core Fixed non-pipeline process boot bug |
12th October 2023 |
| 5.6.3 | Core timezone per pipeline custom tpClient upd hook |
8th September 2023 |
| 5.6.2P1 | Core Implementation of year-partitions Bugfix rdb wipe edge case |
29th August 2023 |
| 5.6.2 | Core Implementation of month-partitions Bugfix for byCol interaction Refinery Domain Finance Bug Fixes for statsGen & other processes not booting up |
24th August 2023 |
| 5.6.1P1 | Core Bug Fixes for RefineryFinance startup, YAML-Schemas & byCol |
28th July 2023 |
| 5.6.1 | Core Integration of Foreign Keys and byCol(getStats parameter) along with supporting documentation |
3rd July 2023 |
| 5.6.0 | Core Integration of Non-Timeseries Data along with supporting documentation |
19th May 2023 |
| 5.5.7 | Core udf_daemon length error and booting fixes |
6th April 2023 |
| 5.5.6 | Core Late data fixes |
2nd March 2023 |
| 5.5.5 | Core python UDF usability fixes minor bug fixes |
10th November 2022 |
| 5.5.4 | Core getUDF Bug Fixes How To Guides for Pipeline Creation and RealtimeUDFs |
13th October 2022 |
| 5.5.3 | Core New function getUDFDescription with Documentation EOD Rollover Bug Fixes Refinery Domain Finance Updated Watchlist Management Dashboard |
30th September 2022 |
| 5.5.2 | Core EOD Rollover Bug Fixes Additional Data Type Support within getTicks API with Additional Documentation |
1st September 2022 |
| 5.5.1 | Core Cross pipeline query Upgrading to R5 FAQ documentation Refinery CLI Manual rollover of late data |
18th August 2022 |
| 5.5.0 | Core Late data support Refinery Domain Finance Corporate Actions enhancements Refinery CLI Intraday-write |
7th July 2022 |
| 5.4.3 | Core IPDB/IDB performance enchancement Error dictionary documentation |
29th April 2022 |
| 5.4.2 | Core HDB busy status fix How-to guide updates |
17th March 2022 |
| 5.4.1 | Core IDB and UDF bugfixes |
18th February 2022 |
| 5.4.0 | Core EPDB and IPDB root-splay persistence |
9th November 2021 |
| 5.3.0 | Core Sandbox integration Refinery Sandbox Enhanced Sandbox for Refinery 5 |
2nd August 2021 |
| 5.2.1 | Core UDF: Python library management |
30th June 2021 |
| 5.2.0 | Core Enchanced GW and process failover Multi instance port specification Refinery CLI Datacopy |
10th May 2021 |
| 5.1.0 | Core IDB Platform 4.6 par.txt support |
3rd March 2021 |
| 5.0.0 | Core Dynamic Pipelines Process Manager Refinery CLI Pipeline Commands |
30th October 2020 |