Jump to content

Data Platform/Systems/OpenSearch-on-K8s/TTMServer

From Wikitech

This is operations documentation for Translation memory OpenSearch cluster on Kubernetes for Translate plugin. For local deployment, see MW-Docker/Translate.

Historically, indices were hosted on the production CirrusSearch opensearch cluster, until its migration to a small K8S cluster, task T425377.

Monitorings

Layout

  • service proxy dnslb ep for read
  • https://opensearch-ttmserver.svc.eqiad.wmnet:30443/ttmserver
  • https://opensearch-ttmserver.svc.codfw.wmnet:30443/ttmserver
  • service proxy dnslb ep for read for test cluster
  • https://opensearch-ttmserver-test.svc.eqiad.wmnet:30443/ttmserver-test (only serves testwiki)
  • https://opensearch-ttmserver-test.svc.codfw.wmnet:30443/ttmserver-test (only serves testwiki)

Verification

Maintenance

For regenerating test indices

mwscript-k8s --attach -- extensions/Translate/scripts/ttmserver-export.php --wiki testwiki --ttmserver eqiad-test

For regenerating the index for all wikis except where it is disabled:

SERVER=...
expanddblist translate | grep -v -e otrs_wikiwiki -e collabwiki -e officewiki -e ptwikisource > translate.list
cp translate.list translate.list-${SERVER}
mwscript-k8s --sal --comment "populating translation memory (ttmserver-export.php) on ${SERVER}" --local_dblist ./translate.list-${SERVER} --attach -- extensions/Translate/scripts/ttmserver-export.php --ttmserver ${SERVER}