Event Platform/Beta Deployments

Event Platform services are deployed to k8s via Deployment pipeline. All services are available in staging, and that's where we usually test.

Sometime you might find it useful run integration tests in the Beta cluster . For this use case, services should follow Deployment prep practices.

While MediaWiki code is synced automagically Nova Resource:Deployment-prep/How code is updated#How do I get my code on the beta cluster?,

Event Platform services require a couple of manual steps.

tl;dr: version bump the image to deploy in the Horizon UI (do not submit a CR to the cloud infra git repo), ssh to the cloud vps box, run sudo puppet agent -t to pull changes and eventually redeploy the docker image.

To be able to deploy to Beta you need to:

• Have a valid Cloud vps account with a Generate an SSH Key. Deployment prep hosts run docker containers on cloud infra (*not* k8s), so generate a dedicated key.
• Have an ssh config that with cloudvps bastion hops. See Help:Accessing Cloud VPS instances#Setup
• Make sure you are part of the deployment-prep project in https://horizon.wikimedia.org/project/.
• Make sure you are a project member of the service you want to deploy.
  • You need this to be able to make config changes.
  • If the puppet config tab to horizon does not show an "Edit" button, you are not a project memebr. Ping Event Platform/Maintainers if you think you should.

As an example, let's say you want to test changes to Event Platform/EventStreams. The workflow would look something like this:

1. Get patches merged to the service Gerrit repo
2. On merge a new docker image will be created and pushed to Docker-registry.
3. Go to the Deployment prep instance (Compute -> Instances -> Filter by name = event) page in Horizon
   1. Right now this would point to deployment-eventstreams-2
4. Click on the Puppet Configuration tab
5. Click on the "Edit" button and version bump the service docker image .
6. Apply changes. Horizon should auto merge to the cloud instances gerrit repo.
7. Login to the cloudvps host (assumes you have provided a pub key and configured bastion hops):

   ssh deployment-eventstreams-2.deployment-prep.eqiad1.wikimedia.cloud

   Where
   1. deployment-eventstreams-2: is the clouvps integration test instance
   2. deployment-prep.eqiad1.wikimedia.cloud: is the clouvps deployment-prep net
8. Deploy the changes with puppet:

   sudo puppet agent -t

9. You can edit https://simple.wikipedia.beta.wmflabs.org/ to test changes.