Skip to content

Diagnostics

This page describes how to troubleshoot database, pipeline and system errors with Diagnostics, accessed through the kdb Insights Enterprise Web INterface.

Diagnostics help you to monitor system health, diagnose issues, and maintaining optimal performance of kdb Insights Enterprise deployments.

Access Diagnostics

There are a few ways to access diagnostics information.

  1. Click Diagnostics, under MANAGE, in the left-hand-side bar to open the Diagnostics screen.

    Diagnostics is accessible from the left-hand menu.

    Permissions

    Ensure you have the appropriate Keycloak role permissions, otherwise the Diagnostics option is not displayed.

    This screen has a search box and 2 dropdowns. Use these to select a database or pipeline that you want to troubleshoot.

    Expand either the Databases or Pipelines dropdowns and select a database or pipeline. Alternatively, type the name in the search box. This opens the diagnostics for that entity.

  2. You can access Database diagnostics from the Overview tab of the Database screen. You can do one of the following:

    • Click the button corresponding to the reported event (Fatal, Error, Warning)

    • Click View all Logs

    Access diagnostics from the database view.

  3. You can access Pipeline diagnostics by clicking the View Diagnostics icon for a selected Pipeline in the Running Pipelines of the Overview page.

From the Diagnostics screen, you can now view Application Logs and/or Diagnostic Events for the selected Database or Pipeline.

Application Logs

The Application Logs tab displays logs generated by a database or pipeline deployment. Results are paged and can be exported, refreshed, searched, and sorted.

  • The logs can be filtered by ticking one of the event options:

    • Fatal
    • Error
    • Warnings

  • When you access these logs from the Database screen, by clicking the event icon, the logs are filtered based on the event selected.

  • Reset the filters by clicking the Reset Column Filters icon.

  • The time since last update is displayed next to the refresh icon for both events and logs.

  • Download a '.json' report of events or logs by clicking the Download Table icon.

  • Refine your results based on a value entered in the Quick Search box.

Application Logs

Diagnostic Events

The Diagnostic Events tab displays reported events generated by a database or pipeline deployment.

  • Results are paged.
  • Successful events are identified with a green tick.
  • Warnings are identified with a yellow tick.

  • The time since last update is displayed next to the refresh icon for both events and logs.

  • Click on a header column to sort and filter.

  • Download a '.json' report of events or logs by clicking the Download Table icon.

  • Refine your results based on a value entered in the Quick Search box.

Diagnostic data is cached; click the refresh icon to update. Alternatively, close and re-open the current tab from the ribbon menu.

Diagnostic Events

Batch Ingest

The Batch Ingest tab, is displayed when you select a database from the list under Diagnostics. This tab is updated when data has been directly written to the HDB. This is done when a pipeline contains a node that writes directly to the database, see kdb Insights Database writer node for details.

Batch ingest

The information displayed is described in the following table.

Column Description
Pipeline The name of the pipeline that is ingesting data into the database.
Status The current status of the ingest. The values are:
- Queued
- Pending
- Processed
- Completed
- Error
Progress This column indicates the progress of the data ingest. The options are:
- Preparing for HDB
- Awaiting for HDB
- % written to HDB
- Ingest complete
- Ingest error
Destination The name of the table in this database that the data has been ingested into.

Information about data ingest is retained, in this tab, for 30 days. If the table has no data then a message is displayed saying there has been no batch ingest to the last 30 days.

No batch ingest

System Notifications

To view system notifications:

  • Click the System Notifications icon in the ribbon menu for real-time notifications of events in the current session as shown below.

    Click the system notifications icon in the ribbon menu to view real-time notifications of the current session.

  • A slider panel of system notifications is displayed. You can filter results with a text search.

    A live view of event messaging for the current session.

  • Click the new tab link for an expanded view of notifications.

    Click the new tab icon for an expanded notifications view.

    Expanded notifications view.

Next steps

For further assistance contact Support.