Creating some notes on what I learned from T412447 OpenSearch on K8s: Monitor and rotate TLS certificates

How to activate Blackbox Monitoring for K8s-hosted services

1. Define the service in Puppet's service.yaml . Services in service_setup status will get added to the Prometheus blackbox config found in /etc/prometheus/blackbox.yml on Prometheus hosts.

2. Move the service to "production" status. Once your Puppet change is merged, Puppet will create a scrape job on the ops prometheus instances. As of this writing, you can find the job in the file /srv/prometheus/ops/targets/probes-service_catalog_private.yaml .