Previous KDB.AI Release Notes
This section documents previous updates to KDB.AI Cloud UI and KDB.AI Server. Bookmark it to set yourself up for continued success while using KDB.AI.
KDB.AI Cloud UI
v1.2.4
Release date 2024.08.15
Fixes and improvements
- This update includes several bug fixes and enhancements to improve KDB.AI performance and stability.
- v1.2.2 and v1.2.3 introduced a series of internal changes that significantly enhance KDB.AI reliability and performance.
New
- Request new database button is now available to new users who haven't created a table within 7 days of creating their KDB.AI account.
v1.2.1
Release date 2024.07.02
Fixes and improvements
- KDB.AI Cloud UI 1.2.1 includes bug fixes and internal improvements.
v1.2.0
Release date 2024.06.27
The KDB.AI Cloud UI 1.2.0 release contains all the new functionalities and performance improvements introduced in the KDB.AI Server 1.2.0 release.
v1.1.2
Release date 2024.05.23
Fixes and improvements
- KDB.AI sample notebooks can be run from the UI directly in Google Colab. No need to switch windows or install the required libraries on local laptop/environment anymore.
v1.1.1
Release date 2024.05.09
Fixes and improvements
- During the sign-up process, personal details are now entered after login, rather than on the signup page.
- You can use Google SSO to sign up and login.
v1.1.0
Release date 2024.03.27
New
- The KDB.AI Cloud UI 1.1.0 release contains all the latest search capabilities and integrations introduced in the KDB.AI Server 1.1.0 release.
v1.0.3
Release date 2024.03.13
Fixes and improvements
- KDB.AI Cloud UI 1.0.3 includes internal improvements.
v1.0.2
Release date 2024.01.30
New
KDB.AI Cloud UI now provides three sections:
- Overview: view Database Capacity and a Quickstart Guide with embedded cope snippets.
- Connection Details: view instance endpoint URL and manage API keys for your environment. In addition, a Connection Guide is provided with embedded code snippets.
- Tables: view list of Tables and schemas in your database and delete tables from the UI directly. The delete functionality only allows for deletion of complete tables, not row level data. See Delete table for details. In addition, a Tables Creation Guide is provided with embedded code snippets.
v1.0.0
Release date 2023.12.04
New
- Introducing REST API support, including
insert
andtrain
functions.
v0.2.0
Release date 2023.11.03
Fixes and improvements
- Minor fixes and performance improvements
v0.1.1
Release date 2023.09.27
Fixes and improvements
-
Fixed issues with training functionality surrounding CPU instructions on certain machines.
-
Improved behavior surrounding synchronous API calls, including
create
anddrop
. -
Improved responses from similarity search API by removing unneeded empty rows.
v0.1.0
Release date 2023.09.12
New
Introducing the first public release of KDB.AI Cloud UI.
- Supported by Python clients with version less than or equal to
0.1.1
KDB.AI Server
v1.2.4 release notes
Release date 2024.08.15
Fixes and improvements
- This update includes several bug fixes and enhancements to improve KDB.AI performance and stability.
- v1.2.2 and v1.2.3 introduced a series of internal changes that significantly enhance KDB.AI reliability and performance.
v1.2.0
Release Date 2024.06.27
Welcome to the KDB.AI Server 1.2.0 release! Let's look at the highlights:
- Higher performance – launching a series of significant performance enhancements.
- On disk indexes: qFlat – a Flat index that's not memory bound, leading to major infrastructure savings.
Now check out what's in store for each:
1. Higher performance (Improvement)
KDB.AI Server 1.2.0 brings considerable speed-ups, demonstrating KDB.AI’s ability to help you build fast, efficient, accurate, cost-predictable, and scalable solutions for your organization’s projects.
2. On-disk indexes: qFlat (New)
Managing indexes on-disk, as opposed to in-memory, provides a low-memory solution for working with large datasets of vector embeddings. That's why the 1.2.0 release introduces an on-disk alternative to the in-memory Flat index.
Labelled qFlat, this index supports all the API create and search capabilities. The only difference is that you need to specify qFlat
instead of flat
if you prefer the on-disk index to the in-memory one.
Tip
Pick qFlat over Flat if you prioritize capacity over speed. Keep in mind that on-disk is slower but cost-effective, while in-memory is faster but more expensive.
Read more about the differences between in-memory vs. on-disk indexes, then learn how to use the qFlat index.
Note
Please ensure that your data explicitly matches the data type required by your table schema. Not doing this may result in a type
error. The example below ensures the correct data type for the StockPrice
column.
import numpy as np
table_schema = {
"columns": [
{"name": "StockPrice", "pytype": "float32"},
# rest of schema
]}
df = pd.DataFrame()
df = ReadStockData('stock_price_data.csv')
# Ensure correct stock price type
df['StockPrice'] = [np.float32(x) for x in df.StockPrice]
Summary
We hope you'll make the best of the v1.2.0 performance improvements and the new qFlat index. Now feel free to try them out. If you need any help, email our Support Team at support@kdb.ai or join our Slack channel.
For a full list of features and improvements we rolled out in the past, check out the previous KDB.AI Server release notes.
Download the latest KDB.AI Server version!
Thanks for reading. Stay tuned for the next release!
The KDB.AI team
v1.1.0
Release date 2024.03.13
The KDB.AI Server 1.1.0 release is here! This time we focused on enhancing your KDB.AI toolset with three new searches and an integration. Here are the highlights:
1. Hybrid search – combines a sparse vector search with a dense vector search.
2. Transformed TSS – temporal similarity search for transformed data.
3. Non-transformed TSS – temporal similarity search for non-transformed data.
4. LlamaIndex integration – you can now find KDB.AI in the LlamaIndex library.
5. Azure ML integration - includes the latest OpenAI release 1.17.0 and more notebooks to run tests on.
Now let's see what's in store for each new addition:
1. Hybrid search (NEW)
KDB.AI Server 1.1.0 brings a specialized vector search that increases the result relevancy across your applications. It's called a hybrid search and it’s a mix of two powerful search methods:
-
The precision of keyword-based sparse vector search.
-
The contextual understanding of semantic dense vector search.
This means that with KDB.AI, you can now combine and re-rank the results based on a user-set alpha value that weighs the importance of each search type.
Tip
Hybrid search is particularly useful in content recommendation systems, customer support automation, legal document search or human resources and recruitment.
Discover more uses cases on our Learning hub, head to our docs to understand the concepts behind this search method, or even better, learn how to conduct a hybrid search.
2. Transformed temporal similarity search (NEW)
Looking for a compression model that dimensionally reduces time series windows by over 99%, while faithfully preserving the original data’s shape? Using the Transformed TSS method, KDB.AI can store and perform lightning-fast vector searches on time-series data.
This breakthrough enables rapid and profound analytical insights, based on the following:
-
1% of embedding size, 10x increase in search performance.
-
Memory and disk storage can be 1/100th of the original size.
-
Embeddings are auto generated at ingestion; no need for an external model/LLM.
-
When low latency results are more important than low latency data availability.
Leveraging windowed time series data compressed with Transformed TSS on KDB.AI enables the deciphering of emerging trends.
Tip
By providing fast comparison between current data and vast historical datasets, Transformed TSS is a game changer for financial and market predictions; online advertisement optimization, or retail customer understanding.
Head to the KDB.AI Learning hub for detailed use cases, read the docs to understand the main concepts behind this search method, then learn how to perform a Transformed TSS search.
3. Non-transformed temporal similarity search (NEW)
KDB.AI Non-Transformed TSS is a groundbreaking algorithm for near real-time similarity searches across fast-moving time series data. This new feature provides:
-
A precise and efficient method to analyse patterns and trends in time series data.
-
No need to embed, extract, or store time series vectors in the database.
-
The ability to re-configure search without requiring the overhead of re-indexing.
Tip
By enabling pattern matching, outlier detection, and near real-time analysis of datasets, you can count on Non-Transformed TSS for financial market analysis, sensor monitoring, cybersecurity threat detection and prevention, and healthcare monitoring.
Explore more use cases on the KDB.AI Learning hub, read our docs to learn the key terms, and learn how to execute a Non-Transformed TSS search.
4. LlamaIndex integration (NEW)
We're thrilled to introduce the integration of KDB.AI on LlamaIndex, a platform that simplifies the storage and retrieval of public and private datasets for RAG-enabled applications. With LlamaIndex and KDB.AI, developers can easily build popular RAG-enabled applications quickly and at scale, without worrying about the technical details and complexities.
The KDB.AI and LlamaIndex integration:
-
Enables LLMs to return dynamic and timely information.
-
Helps reduce memory requirements.
-
Enhances accessibility when contrasted with processing searches via raw embeddings.
-
Augments the LLM’s native output, resulting in a more precise and contextually relevant response to the user’s question.
Tip
You can combine LlamaIndex and KDB.AI to improve variety of applications, such as: document Q&A, data-augmented chatbots, knowledge base, FAQs, workflows, procedures, structured analytics, and content generation (blogs, articles, books, etc.).
Read more details on our LlamaIndex integration page and try our Advanced RAG with temporal filters using LlamaIndex and KDB.AI vector store notebook.
5. Azure ML integration (Improvement)
The Azure Marketplace package allows you to deploy an Azure ML studio, with an integrated KDB.AI Server 1.1.0. This includes the following third party dependencies:
-
KDB.AI client 1.1.0
-
LangChain OpenAI 0.1.1
-
OpenAI 1.17.0
Discover 6 new example notebooks, together with a much richer and extended set of data you can leverage to run your notebook tests on.
Read more about the Azure setup.
Summary
We hope you’re as excited as we are about the new KDB.AI Server searches and the LlamaIndex integration. Try them out and email our Support Team at support@kdb.ai or join our Slack channel if you need any help.
Download the latest KDB.AI Server version!
Thanks for reading. Stay tuned for the next release!
The KDB.AI team
v1.0.0
Release date 2023.11.27
New
- Introducing REST API support, including
insert
andtrain
functions.
v0.2.0
Release date 2023.11.03
Fixes and improvements
- Minor fixes and performance improvements
v0.1.2
Release date 2023.10.17
Fixes and improvements
- For KDB.AI Server instances it is no longer required to specify a hostname with an ordinal parameter (-h). If a hostname does have an ordinal parameter then the environment variable
RT_NO_ORDINAL
must be set to0
.
v0.1.1
Release date 2023.09.27
Fixes and improvements
-
Fixed issues with training functionality surrounding CPU instructions on certain machines.
-
Improved behavior surrounding synchronous API calls, including
create
anddrop
. -
Improved responses from similarity search API by removing unneeded empty rows.
v0.1.0
Release date 2023.09.12
New
Introducing the first public release of KDB.AI.
- Supported by Python clients with version less than or equal to
0.1.1