08:36 taavi: configure metricsinfra jobs to scrape prometheus nginx exporter
2022-09-08
19:58 taavi: deployed some 'global' rate limiting rules
2022-09-03
11:02 taavi: hard reboot proxy-03
2022-07-29
15:55 taavi: updated neutron firewall rules to allow traffic to the api from 208.80.152.0/22 (all of eqiad + codfw) instead of individual per-cloud-host rules T314152
2022-06-01
15:00 taavi: update warper.wmflabs.org mapping per irc request
2022-02-14
21:49 andrewbogott: replacing maps-01 and maps-02 with maps-03 and maps-04 for bullseye upgrades. Active traffic is now on maps-03.
09:06 arturo: cleanup horizon hiera that is applied to both 'proxy' prefix and project-level (leave the project-level one)
2020-09-08
10:05 arturo: remove /var/lib/acme-chief/certs/* to force acme-chief generating new certs instead of renewing them (T262237)
09:35 arturo: refresh some hiera settings in the `project-proxy-acme-chief` puppet tab
09:23 arturo: cleanup old apt sources.list entries referencing mitaka-jessie that prevents clean package upgrades in proxy-01
09:18 arturo: upgrading acme-chief deb package from 0.25-1 to 0.28-1 on project-proxy-acme-chief-01 (T262237)
09:18 arturo: upgrading acme-chief deb package from 0.25-1 to 0.28-1 on project-proxy-acme-chief-01 (T26223
09:10 arturo: restart acme-chief service in roject-proxy-acme-chief-01 (T262237)
2020-07-06
14:44 andrewbogott: switching proxy-01 and proxy-02 to use an acme-chief cert for *.wmflabs.org and *.wmcloud.org via "profile::wmcs::novaproxy::acme_certname: wmflabs"
14:38 andrewbogott: moving proxy-01 and proxy-02 to the project-local puppetmaster via the hiera setting "puppetmaster: project-proxy-puppetmaster-01.project-proxy.eqiad.wmflabs"
2020-06-16
21:33 bstorm_: setting "profile::wmcs::nfsclient::mode: soft" on the project T102369T127559
2020-04-15
20:25 bd808: Forced puppet run on proxy-02
20:23 bd808: Forced puppet run on proxy-01
20:22 bd808: Added google-api-proxy.wmflabs.org & googlevision-api-proxy.wmflabs.org to profile::wmcs::novaproxy::xff_fqdns (T135046, T250312)
09:53 arturo: replacing SSL cert for star.wmflabs.org - for real this time (T237066)
2019-11-06
09:57 arturo: replacing SSL cert for star.wmflabs.org (T237066)
2019-07-24
10:15 arturo: reallocating proxy-02 from cloudvirt1027 to cloudvirt1028 (T227539)
2019-06-05
22:50 Krenair: Added cloudcontrol1004 IP to match cloudcontrol1003 rule in 'proxy' security group rules for port 5668 T225168
22:44 Krenair: Updating 'proxy' security group rules for port 5668 to remove decommissioned IP - 208.80.154.147 californium T189921
22:36 Krenair: Updating 'proxy' security group rules for port 5668 to remove decommissioned IPs - 208.80.154.136 silver, 208.80.155.117 labs-ns0, 208.80.152.32 virt0 (!), 208.80.153.48 labtestservices2001, 208.80.154.92 labcontrol1001
22:14 Krenair: Per jeh's investigation, added cloudservices1004 IP to match cloudservices1003 rule in 'proxy' security group rules for port 5668
2019-03-12
03:46 bd808: Restarted uwsgi-invisible-unicorn on proxy-01
03:21 bd808: Removed redis sets with no record in the backing database (T133554)
03:00 bd808: Fixed domains with trailing dot (T218064)
01:13 bd808: Deleted dangling backend records in /etc/dynamicproxy-api/data.db (T218064)
2019-01-29
17:21 arturo: add myself as projectadmin to be able to debug some stuff
2019-01-23
19:41 andrewbogott: deleting old eqiad-region proxy nodes novaproxy-01 and novaproxy-02
2019-01-16
14:21 andrewbogott: stopping old VPS proxies in eqiad — T213540
2018-12-21
14:59 bstorm_: Added 172.16.0.0/21 to the one-off port listed by those proxy hosts' security group
2018-11-27
20:14 andrewbogott: moving traffic back to novaproxy-01
19:57 andrewbogott: moving novaproxy-01 to labvirt1001
19:55 andrewbogott: moving traffic to novaproxy-02
2018-11-02
18:22 arturo: T206223 certificate renewal for *.wmflabs.org by manual copy of private key to /etc/ for nginx
2018-10-23
13:23 gtirloni: Added gtirloni to the project
2018-06-06
17:56 andrewbogott: switching primary proxy to novaproxy-01
17:41 andrewbogott: switching primary proxy to novaproxy-02
2018-03-20
21:42 chasemp: novaproxy-01:/var/log# rm -f *\.gz
21:42 chasemp: novaproxy-01:/var# aptitude clean
2018-02-12
22:07 andrewbogott: opened up port 5668 to labweb1001 and 1002 in the 'proxy' security group
2018-02-09
01:05 bd808: Removed inactive users Ryan Lane and Coren
01:04 bd808: Removed Yuvipanda at user request (T186289)
2017-11-16
15:19 chasemp: disable puppet
2017-08-31
21:12 madhuvishy: Updated star.wmflabs.org cert, ran puppet and restarted nginx in novaproxy-01 and 02 (Copied the private key manually to /etc/ssl/private) T174611
2017-08-03
14:48 chasemp: remove openstack::clientlib from novaproxy-02 it is not on novaproxy-01. no one is sure why it is there atm. hopefully this doesn't explode.
2017-07-13
17:15 bd808: Upgraded nginx-common
2017-06-21
17:05 andrewbogott: moving novaproxy ip back to nova-proxy-01
16:59 andrewbogott: moving the active proxy IP to novaproxy-02
