Jump to content
Nova Resource : Tools.sal/SAL
2025-01-13
20:32 wmbot~lucaswerkmeister@tools-bastion-13: webservice restart
2024-11-14
16:41 wmbot~bd808@tools-bastion-12: Restored service.template; changed health check to hit a PHP page
09:00 wmbot~urbanecm@tools-bastion-13: $ webservice restart # tool was down
09:00 wmbot~urbanecm@tools-bastion-13: $ mv service.template service.template.bak # seemingly invalid file, argument ACTION: invalid choice
2024-10-31
09:59 wmbot~aborrero@tools-bastion-12: webservice restart # webservice seems down. Logs mention all handlers for index.php are down
2024-10-14
14:11 wmbot~lucaswerkmeister@tools-bastion-13: webservice restart # responded with 404 Not Found from fourohfour tool o_O
2024-10-07
08:01 wmbot~fnegri@tools-bastion-13: webservice restart
2024-10-02
08:31 wmbot~aborrero@tools-bastion-12: webservice restart
2024-09-28
11:47 wmbot~lucaswerkmeister@tools-bastion-13: webservice restart
2024-09-23
12:28 wmbot~urbanecm@tools-bastion-13: webservice restart # user reported outage
2024-09-13
16:32 wmbot~lucaswerkmeister@tools-bastion-13: webservice restart # kubectl get events has messages about failed liveness probes, “will be restarted”, but it doesn’t seem to help 😔
2024-09-11
17:06 wmbot~lucaswerkmeister@tools-bastion-13: added health-check-path: /toolinfo.json to service.template (probably the cheapest endpoint of the tool?), which should hopefully reduce the need for manual restarts; also removed canonical: True which hasn’t been needed for a while now
2024-09-10
12:31 wmbot~lucaswerkmeister@tools-bastion-13: webservice restart
2024-08-24
17:08 wmbot~urbanecm@tools-bastion-13: webservice restart
2024-08-14
15:05 wmbot~fnegri@tools-bastion-13: webservice restart after a user reported the web page was down
2024-07-29
02:08 wmbot~bd808@tools-bastion-12: webservice restart after report of downtie on irc
2024-07-15
07:30 wmbot~aborrero@tools-bastion-13: webservice restart
2024-06-30
16:14 wmbot~lucaswerkmeister@tools-bastion-13: webservice restart
2024-06-24
10:12 dhinus: webservice restart
2024-06-03
18:19 wmbot~urbanecm@tools-bastion-13: webservice restart
2024-05-27
09:04 wmbot~lucaswerkmeister@tools-bastion-13: webservice restart
2024-05-20
07:37 wmbot~urbanecm@tools-bastion-13: webservice restart
2024-05-11
12:49 wmbot~lucaswerkmeister@tools-sgebastion-10: webservice restart
2024-04-27
18:40 wmbot~lucaswerkmeister@tools-bastion-13: webservice restart
2024-04-11
11:54 wmbot~taavi@tools-bastion-12: toolforge webservice restart
2024-04-03
13:54 wmbot~taavi@tools-bastion-12: toolforge webservice restart
2024-03-26
09:55 wmbot~lucaswerkmeister@tools-sgebastion-10: webservice restart # "server stopped by UID = 0 PID = 0" at 9:53:26 according to error.log, with plenty of /tmp/lighttpd-php.sock connection errors in the log before then
09:53 wmbot~taavi@tools-bastion-12: toolforge webservice restart
2024-03-14
19:57 wmbot~bd808@tools-sgebastion-10: Hard stop/start cycle. Pod was running, but somehow the proxy layer was no longer seeing the webservice as active.
2024-03-07
15:19 wmbot~urbanecm@tools-sgebastion-10: webservice restart # 503 Service Unavailable
2024-02-29
15:23 wmbot~bd808@tools-sgebastion-11: Hard restart to pick up new default TCP healthcheck.
2024-02-23
15:02 wmbot~lucaswerkmeister@tools-sgebastion-10: webservice restart # 503 Service Unavailable, lots of socket errors in error.log
2024-02-19
09:43 wmbot~dcaro@tools-sgebastion-10: webservice restart # 500 errors
2024-01-31
17:38 wmbot~lucaswerkmeister@tools-sgebastion-10: webservice restart # 500 errors
2024-01-23
10:13 wmbot~lucaswerkmeister@tools-sgebastion-10: restart to fix 5xx errors
2023-12-23
17:08 wm-bot: <root> restart to fix 5xx errors
2023-07-14
14:56 wm-bot: <lucaswerkmeister> restart to fix 5xx errors
2023-06-09
15:40 wm-bot: <lucaswerkmeister> (restarts were by lucaswerkmeister and TheresNoTime ftr ^^)
15:39 wm-bot: <root> webservice restart
15:39 wm-bot: <root> restart to fix 5xx errors
2023-05-06
12:44 wm-bot: <lucaswerkmeister> restarted webservice, 500s reported and strange php socket errors in error.log
2023-03-06
07:55 wm-bot: <urbanecm> Restart to fix 5xx errors
2023-01-23
15:52 wm-bot: <urbanecm> Restart to fix 5xx errors
2022-12-21
2022-12-13
00:11 bd808: Rotated elasticsearch password (T324637 )
2022-11-29
16:19 wm-bot: <urbanecm> restart, tool was not responding
2022-11-03
18:47 wm-bot: <bd808> restarted for 500 errors
2022-09-27
14:11 wm-bot: <lucaswerkmeister> restarted for 500 errors
2022-08-18
21:55 bd808: Added urbanecm as co-maintainer
21:05 wm-bot: <bd808> Restarted for 500 errors like "response not received, request sent" for lighttpd<->PHP.
2022-07-28
01:02 wm-bot: <root> restarted webservice, was throwing HTTP 500
2022-07-18
14:26 wm-bot: <root> Restart to clear errors reported on irc
2022-05-22
2022-04-11
12:10 arturo: restarting webservice per IRC reports of it showing some 500's
2022-03-26
01:01 wm-bot: <bd808> Restarted after reports of errors on irc.
2022-02-26
15:28 wm-bot: <bd808> Restarted to clear fcgi resource leak
2022-02-08
23:31 wm-bot: <bd808> Restart hung webservice
2022-01-23
14:50 wm-bot: <bd808> Update to php7.4 runtime; downgrade elasticsearch client to ^6.2.0
13:58 taavi: restarted webservice
2022-01-07
19:04 balloons: restarted webservice.
2021-12-06
22:24 wm-bot: <bd808> Restarted webservice, $HOME/error.log showed fcgi resource exhaustion.
2021-11-19
15:30 wm-bot: <bd808> Hard restart to ensure Kubernetes annotations are up to date.
2021-10-20
2021-09-11
19:13 wm-bot: <bd808> Restart for fcgi container crash
2021-02-16
20:37 wm-bot: <bd808> Restarting service after irc reports of a brief 500 error storm. Logs show lighttpd<->php communication errors.
2020-09-30
11:26 arturo: trying a simple `webservice restart`
11:24 arturo: tool webservice detected to be misbehaving, several uncaught exceptions in the source code
2020-08-04
05:45 wm-bot: <root> restarted webservice (T259560 )
2020-05-01
21:59 wm-bot: <bd808> Udpated to c4ad4bf
21:58 wm-bot: <bd808> Updated $HOME/.lighttpd.conf for sal.toolforge.org routing
2020-04-12
02:58 bd808: Set --canonical to force redirect to sal.toolforge.org and added service.template to make this all easier in the future
02:52 wm-bot: <bd808> Updated to 49015bb T247715 )
00:11 bd808: Everything broken at the moment because of elasticsearch7 migration not going as hoped.
2020-04-11
23:17 wm-bot: <bd808> Updated config to point to es7 cluster (T247715 )
2020-01-06
22:31 bd808: Update to 9298e99; new features: 'firehose' view, show project for each log entry
22:01 bd808: Migrating to new Kubernetes cluster
2019-10-07
17:16 bd808: kubectl delete po/sal-1981382867-71k6j
2019-02-14
21:28 bd808: Updated config to point to tools-elastic-01 and restarted
2019-01-17
16:28 gtirloni: restarted tool
2018-09-19
23:01 bd808: Update to 78b36ac
2017-07-13
23:08 bd808: Updated to 1d4d39c
2016-11-27
05:29 bd808: Fixed long standing pagination bug and upgraded PHP libraries
2016-10-14
15:18 bd808: Cleaned up !log spam from serial IRC griefer
2016-04-14
03:04 bd808: Updated to ba29ca1
2016-04-05
21:29 bd808: Missing data since 2016-04-04T16:36
2016-02-19
01:48 bd808: Restarted webservice; things were slow
2016-02-15
03:14 bd808: Cleaned up junk data from before project validation was in place
2016-02-10
