Prometheus remote write enables the capability to send metrics to a remote Prometheus storage server. This is primarily intended for long term storage. By default, Prometheus remote write sends all metrics stored in local Prometheus to a remote server. There’s a high likely chance you don’t need to send every…

After reading the above title you maybe thinking why though? Moving the complete worker node fleet into single Availability Zone (AZ) is not a good solution when it comes to high availability of your Kubernetes cluster workload. There’s a reason at least why I had this requirement, Cost optimization in…

Push vs Pull Prometheus is by far the best OSS you can get in 2022 for self-hosted / SaaS monitoring. There are other solutions that grew out of Prometheus for example, Thanos or Cortex. I believe the reason for this is the simplicity that Prometheus offers for querying the metrics and the way…

What are Apps of Apps or Cluster bootstrapping? The App of Apps Pattern helps us define a root Application. So, rather than point to an application manifest fort every application creation, the Root App points to a folder which contains the Application yaml definition for each child App. …

Grafana (Unified) Alerting allows you to learn about problems in your systems moments after they occur. It's a new alerting mechanism built into Grafana so that alerting and observability can be carried out at one sacred place. It also doesn't have any dependency over Alertmanager. Since it's a new alerting…

Fluent Bit is a Fast and Lightweight Logs and Metrics Processor and Forwarder for Linux, OSX, Windows and BSD family operating systems. It has been made with a strong focus on performance to allow the collection of events from different sources without complexity. In this article, we’ll get started with…

OAuth2 Proxy is a reverse proxy that provides authentication using Providers such as Google, GitHub, and others to validate accounts by email, domain or group. In this article, we’ll set up and configure OAuth2 Proxy to enable Google SSO for Kibana in Kubernetes. Prerequisite Kibana running in Kubernetes Nginx Ingress Setup Google Credentials In…

In this article, let’s go over some common metric sources and how to prevent the explosion of the metrics over time from them in Prometheus. 1. Node exporter: Node exporter by default exposes ~ 977 different metrics per node. …

Keeping your Prometheus optimized can be a tedious task over time, but it’s essential in order to maintain the stability of it and also to keep the cardinality under control. Identifying the unnecessary metrics at source, deleting the existing unneeded metrics from your TSDB regularly will keep your Prometheus storage…