Observability is a critical feature of any application. It allows system operators visibility on how the application is performing and provides the ability to investigate and resolve issues. kdb Insights Enterprise provides observability through metrics and logging.
Logging is an important tool to understand what's occurring in an application by keeping track of those events with log messages. kdb Insights Enterprise follows best practice when it comes to logging. It emits structured log messages to STDOUT to be consumed by standard logging stacks. This allows you to deploy your own logging stack, centralise the application logs, and easily troubleshoot issues.
It does not ship with a built-in logging stack but there are many available solutions. You can choose to deploy your preferred one or if running in the cloud, there may be an out of the box one integrated with the Kubernetes stack.
Metrics are another key component of observability. They allow you to capture information about how your application is performing. In comparison to logging, they provide a more aggregated, numerical view of the system state.
kdb Insights Enterprise generates metrics to allow you to quickly identify the system performance and potential issues. This allows you to monitor data flows, component errors, and a variety of other metrics. The application is designed to work with the Prometheus stack. In order to use metrics, please deploy Prometheus.