From Wikitech
Jump to navigation Jump to search


This happens when the prometheus host is not able to do an https request to the harbor instance.

The procedures in this runbook require admin permissions to complete.

Error / Incident

This usually comes in the form of an alert in alertmanager.

There you will get which project (tools, toolsbeta, ...) is the one it's failing for, and the url of the harbor instance that fails.

Note that this request goes through the proxies and it might be an issue there instead of just harbor.


You can ssh to the harbor instance directly and check there how/if it's running (use the instance of the project the alert is from):

$ wm-ssh tools-harbor-1.tools.eqaid1.wikimedia.org
tools-harbor-1$ sudo -i
root@tools-harbor-1:~# cd /srv/ops/harbor/
root@tools-harbor-1:/srv/ops/harbor# docker-compose ps
      Name                     Command                  State                          Ports                    
harbor-core         /harbor/entrypoint.sh            Up (healthy)                                               
harbor-exporter     /harbor/entrypoint.sh            Up                                                         
harbor-jobservice   /harbor/entrypoint.sh            Up (healthy)                                               
harbor-log          /bin/sh -c /usr/local/bin/ ...   Up (healthy)>10514/tcp                   
harbor-portal       nginx -g daemon off;             Up (healthy)                                               
nginx               nginx -g daemon off;             Up (healthy)>8080/tcp,>9090/tcp
redis               redis-server /etc/redis.conf     Up (healthy)                                               
registry            /home/harbor/entrypoint.sh       Up (healthy)                                               
registryctl         /home/harbor/start.sh            Up (healthy)

You can try to restart/start it again, with docker-compose restart and docker-compose up -d.

You can also check the logs of each component with docker logs harbor-portal, where harbor-portal is the name of the component.

Common issues

Add new issues here when you encounter them!

Issue 1


Related information

Old incidents

Add any incident tasks here!