|Node name:||cloudweb1003.wikimedia.org (fingerprint)|
|Icinga?:||host status services status|
cloudweb1003 and cloudweb1004 host Wikitech, Horizon and toolsadmin (Striker).
As wiki hosts they are fairly non-standard: code is deployed the usual way, but X-Wikimedia-Debug does not work, login uses the developer account (LDAP) credentials, and various things might be less reliable (e.g. logging).
Connect to cloudweb1003 over ssh by proxying through a bastion (e.g.
bast1003.wikimedia.org). As with other hosts, ensure you have
ProxyJump configured in
.ssh/config (see Production shell access). Then connect as follows:
user@laptop:~$ ssh cloudweb1003.wikimedia.org
Note that the domain name is
cloudweb1003 and cloudweb1004 are load-balanced and redundant, using LVS. To take one of them out of service for maintenance, log in and run
cloudweb1003:~$ sudo depool
After maintenance, put the host back into service:
cloudweb1003:~$ sudo pool
Horizon logs are at
/var/log/apache2/horizon_*, which can be scanned for failed user logins, etc. Make sure you check both cloudweb1003 and cloudweb1003.