Jump to content

Nova Resource:Tools.cdnjs/SAL

From Wikitech

2025-07-27

  • 17:54 lucaswerkmeister: … https://grafana.wmcloud.org/goto/5KVdHvwHR though now the data seems to be gone from there?)
  • 17:54 lucaswerkmeister: refreshed the GitHub token in cdnjs-index/tokenfile (now expires 2026-07-27 because GitHub refuses to hand out tokens that are valid for longer); also stopped update-index-29222177 job because Grafana indicated the job usually finishes quickly but this copy had been running for 3d13h (seen at

2024-08-03

  • 15:09 wmbot~lucaswerkmeister@tools-bastion-13: FTR, the manual update-index job completed 23m ago, so about 2½ hours of runtime apparently
  • 12:17 wmbot~lucaswerkmeister@tools-bastion-13: kubectl create job --from=cronjob/update-index update-index # manual run to see if it works better now
  • 12:05 wmbot~lucaswerkmeister@tools-bastion-13: rotated + compressed update-index.err again
  • 12:04 wmbot~lucaswerkmeister@tools-bastion-13: kubectl delete pod update-index-28687937-tqlqw # was apparently stuck for 16 days
  • 10:54 wmbot~lucaswerkmeister@tools-bastion-13: regenerated GitHub token (cdnjs-index/tokenfile)

2023-08-27

  • 11:14 wm-bot: <lucaswerkmeister> toolforge-jobs run --image bookworm --command 'zstd --rm update-index.err.1 update-index.err.2 update-index.err.3' --wait compress-err # T342519, compressed each file by about a factor of ten
  • 11:11 wm-bot: <lucaswerkmeister> removed -v from update-index.sh again (T342519, previous message was also for that task but I forgor mention)
  • 11:11 wm-bot: <lucaswerkmeister> rotated update-index.err one more time

2023-08-26

  • 11:19 wm-bot: <lucaswerkmeister> rotated update-index.err again to have clean logs for the next run (T342519), if it works I’ll remove -v from update-index.sh again
  • 11:18 wm-bot: <lucaswerkmeister> updated code from fe85853af5 to a526d723b7, try once more to include old versions (T342519)
  • 11:10 wm-bot: <lucaswerkmeister> mv ~tools.cdnjs/.netrc{,.disabled-2023-08-26-T342519}

2023-08-12

  • 20:40 wm-bot: <lucaswerkmeister> rolled back code from a526d723b7 to fe85853af5 (T342519)
  • 20:35 wm-bot: <lucaswerkmeister> replaced tokenfile with a fine-grained one generated for my account, hoping to get a higher rate limit (T342519)
  • 15:59 wm-bot: <lucaswerkmeister> kubectl delete job update-index-28196897 # job for T342519 is running too long, abort

2023-08-11

2023-08-10

  • 18:12 wm-bot: <lucaswerkmeister> set up venv-py311, changed update-index.sh to use it over py39, recreated job using python3.11 image (T342519)

2023-08-09

  • 18:37 wm-bot: <lucaswerkmeister> added -v option to update-index.sh, next output should be more verbose (T342519)
  • 18:36 wm-bot: <lucaswerkmeister> rotated + compressed update-index.err to update-index.err.1.zst, old file is now empty (T342519)
  • 18:32 wm-bot: <lucaswerkmeister> added self to maintainers, I need to do some more investigation for T342519 and it feels weird to keep using sudo for that; it seems to be a very low-maintenance tool overall and I don’t mind being on the list of maintainers

2023-08-04

  • 15:22 wm-bot: <lucaswerkmeister> kubectl delete job.batch/update-index-28183937 # job for T342519 is running too long, abort – next cronjob schedule should use the old code again
  • 15:21 wm-bot: <lucaswerkmeister> rolled ~/cdnjs-index back to fe85853af5, the changes for T342519 aren’t properly working yet

2023-08-02

  • 19:25 wm-bot: <lucaswerkmeister> pulled a526d723b7 (T342519), should take effect with next daily run

2022-02-17

  • 07:53 taavi: migrated update-index cron job to kubernetes, jobs framework and python 3.9

2022-01-21

  • 15:32 bd808: Manually running update job with `-mem 4096m` to see if that is enough space to generate the ridiculous index file (T299723)

2020-05-04

  • 16:05 bstorm_: restarting the service as "canonical"

2020-03-18

  • 16:34 bstorm_: hacked in a possible workaround with extra logging T246096

2020-03-17

  • 15:12 bstorm_: running jsub -l h_vmem=3145728k /data/project/cdnjs/update-index.sh T246096
  • 15:11 bstorm_: cleared the logs T246096
  • 15:09 bstorm_: rebuilding the venv on a bastion T246096

2020-02-25

  • 21:08 wm-bot: <root> Migrated to 2020 Kubernetes cluster

2019-08-13

  • 22:27 bstorm_: truncated the log files -- they were getting long

2018-09-16

  • 05:01 legoktm: switch to PHP 7.2 webservice

2018-08-11

  • 11:46 zhuyifei1999_: Updated git 942ff92..bdb9f72 and running ~/update-index.sh T201735

2018-04-09