Skip to content

Database administration

This section describes how to configure and manage a database using the kdb Insights Enterprise UI.

kdb Insights databases are distributed time-series databases built upon kdb+. They enable you to manage and retrieve data through a tiered approach and leverage faster access mechanisms for real-time, recent data, while employing slower, cost-effective methods for historical data.

The following database setup and configuration options are available through the UI:

  1. View an index of databases
  2. Create and configure a database
  3. Save a database
  4. Deploy a database
  5. Other Actions

To view a list of all databases, go to the index.

To view a summary of your database, go to the Overview tab.

View index of databases

Click on Databases in the left-hand menu to view a list of all your databases and their current status as well as information on the health and age of each database.

Databases index

The following details are displayed:

Item Description
NAME The database name. Click on the name to go the Overview tab for the named database.
STATUS The current status of your database. Hover over the status value for additional information. Refer to database status values for detailed explanations of these values.
HEALTH This column displays the health status of the deployed database. A value of Healthy indicates there are no reported issues with the database and is shown for status of Ready, Upgrading, and Getting Ready. When an error has been encountered a warning message is displayed indicating that attention is required. Refer to warnings and remediation actions for details about these errors and how they can be resolved. This column is blank if the database is not deployed.
AGE The time since the database was last deployed.
TASKS Click the three dots under Tasks to view a list of database actions. These are similar to those displayed under Other Actions.

Database status values

Each database has one of the following status values:

Status Description
Draft The database is stored locally but has not been saved.
Inactive The database is not deployed.
Getting Ready The database is running but is not in a Ready state.
Initializing The database is deployed and is starting up.
Ready The database is deployed and ready to query.
Upgrading The database is being upgraded.
Errored The database deployment has encountered errors. Hover over the status icon to see the error.
Warning The database has some health warnings. Review the health status for the database on the index page.

Filter listings

The list of databases can be filtered by clicking one of the tiles above the listings. For example, click on Warnings Detected to refine the list to display only databases that have warnings. Click an additional tile to combine filters. For example click Warnings Detected and Errors Detected to get all databases with errors and warnings.

You can also filter the listing using the Status Filter drop-down located above the listing. The drop-down displays the statuses associated with the databases listed. All statuses are checked by default.

Create a new database

To create a new database:

  1. Use one of the following methods to open the Schema Settings tab.

    • In the databases index page click Create Database
    • Click [+] next to the database name in the left-hand menu, or
    • Select Database from the menu displayed when you click + on the ribbon menu, or
    • Click Build a Database on the Overview page.

    Database wizard

  2. The Databases screen is displayed with the Schema Settings tab selected by default.

    Schema overview

  3. The top of the Databases screen displays the following:

    item description
    Encryption status icon The encryption status of the database. Encrypted or Not Encrypted. This is only available when a database is deployed. Refer to Encryption for further details.
    Name The name of the database. When you create a new database a system generated name is displayed. Select this and rename it as required.
    Status icon This shows the current status of your database. Refer to database status values for more information.
    Pipelines The name of any pipelines associated with this database. Click Create Pipeline to create a new pipeline and associate it with this database.
    Save Click to save the database without deploying it.
    Deploy Click to deploy the database.
    Other Actions Click to open a menu of other options.

    The main part of the screen is laid out in a set of tabs:

    • Overview - View a summary of your database configuration and metrics.
    • Schema Settings - Configure your database schema. It's recommended that you start here.
    • Database Settings - Configure your database settings.
    • Stream Settings - Configure stream settings for your database.
    • Resources - Configure resources for your database.
  4. Configure the schema, database, stream, and resources settings using the tabs above.

  5. Click Save.
  6. Once saved the database can be deployed to activate it.

Database Overview

The Overview tab provides an overview of the configuration and status of your database along with metrics which help you monitor the resources being used by your database.

Databases Overview

This screen has the following sections, highlighted in the screenshot above.

  1. Database component status - This is only displayed for deployed databases.
  2. Database and Pipeline Issues - Summary of database and pipeline issues.
  3. Database metrics - Metrics on your database.
  4. Schema Tables - An overview of your schema tables.
  5. Associated Pipeline Instances. Information on associated pipelines including details about their status, input and output rate.

Database component status

For any deployed database the top section of the Overview tab displays the status of the database components.

Refer to Deploying a database for details on each of the components.

Database and Pipeline Issues

This section of the Database Overview tab gives an overall view of the system health for both pipelines and the database.

  • Database Issues - Provides links to Application Logs for your database. Click View all Logs for an unfiltered list of logs, otherwise click to Fatal, Error or Warning to view logs filtered by these issue types.
  • Pipeline Issues - Provides links to Application Logs for your pipeline. Click View all Logs for an unfiltered list of logs, otherwise click Fatal, Error, or Warning to view logs filtered by these issue types.

Database metrics

This section of the Database Overview tab provides metrics about your database. This information alerts you if the database is reaching its limit so that you can take action.

  • Query - This section contains metrics for RAM, CPU and Replicas as well as the number of restarts and the date and time of the last start for the query process. Refer to query resources for further details.
  • Writedown - This section contains metrics for Disk, RAM and CPU as well as the number of restarts and the date and time of the last start for the writedown process. Refer to writedown resources for further details.
  • Stream - This section contains metrics for RAM, CPU and Replicas as well as the number of restarts and the date and time of the last start for the stream process. Refer to stream resources for further details.

Save a database

To save a database, rename the default name if required and click Save. Your database is saved but not deployed. You must deploy your database to activate it.

Deploy a database

To activate a database it must be deployed. An active database is used to store data and is a requirement for working with data outside of testing. An active database shows a green circle with a tick next to its name in the left-hand entity tree list under Databases and it has a status of Ready.

Other Actions

The Other Action menu has the following options:

Export button

The Other Actions options displayed vary depending on the status of the database

Export a database

To export a database:

  1. Click Export Configuration on the Other Actions menu.

Export converts databases created in the UI to a YAML configuration file.

Delete a database

To delete a database:

  1. Click Delete on the Other Actions menu.
  2. Confirm the delete request:
    • For an inactive database click Delete on the confirmation message displayed.
    • For a deployed database it must be torn-down before it can be deleted. In this case you must click Teardown and delete database if you want to proceed.

Further Reading