Portal:Toolforge/Admin/Toolsbeta

This page contains specific information about Toolsbeta, which is the Toolforge mirror deployment for staging/testing/development.

Is a Cloud VPS project with basically the same components as in tools, barring some differences, which are described in this page.

Access

Some notes on accessing toolsbeta.

ssh

SSH access to Toolsbeta VMs is like for any other Cloud VPS project.

Make sure you are in the toolsbeta.admin LDAP unix group, or you wont be able to ssh to worker nodes.

user@mwmaint2002:~ $ sudo modify-ldap-group toolsbeta.admin
0 cn=toolsbeta.admin,ou=servicegroups,dc=wikimedia,dc=org
objectClass: groupOfNames
objectClass: posixGroup
objectClass: top
cn: toolsbeta.admin
gidNumber: 51594
member: uid=aborrero,ou=people,dc=wikimedia,dc=org
member: uid=andrew,ou=people,dc=wikimedia,dc=org
member: uid=bd808,ou=people,dc=wikimedia,dc=org
member: uid=bstorm,ou=people,dc=wikimedia,dc=org
member: uid=chicocvenancio,ou=people,dc=wikimedia,dc=org
member: uid=dcaro,ou=people,dc=wikimedia,dc=org
member: uid=fnegri,ou=people,dc=wikimedia,dc=org
member: uid=krenair,ou=people,dc=wikimedia,dc=org
member: uid=legoktm,ou=people,dc=wikimedia,dc=org
member: uid=raymond-ndibe,ou=people,dc=wikimedia,dc=org
member: uid=sstefanova,ou=people,dc=wikimedia,dc=org
member: uid=taavi,ou=people,dc=wikimedia,dc=org
member: uid=valhallasw,ou=people,dc=wikimedia,dc=org
member: uid=zhuyifei1999,ou=people,dc=wikimedia,dc=org
[..]

web

Access to Toolsbeta webservices (tools webservices) needs to use a special URL, a mirror of toolforge.org. This URL is beta.toolforge.org which is a FQDN that points to a front-proxy VM internal IPv4 address.

You can run this kind of queries from inside the cloud virtual network:

toolsbeta.test@toolsbeta-sgebastion-05:~$ curl -I https://test.beta.toolforge.org | head -1
HTTP/2 200

Operational notes

Some operational notes.

tool accounts in toolsbeta

There are several pre-defined tool account in toolsbeta, most of them set up for testing purposes, examples:

root@toolsbeta-sgebastion-05:~# become test
toolsbeta.test@toolsbeta-sgebastion-05:~$ qstat
toolsbeta.test@toolsbeta-sgebastion-05:~$ kubectl get all
No resources found in tool-test namespace.

A quick way to detect such accounts is:

root@toolsbeta-sgebastion-05:~# ls /data/project
admin  fourohfour  grafana  herald  paws  pvs  test  test2  test3  test4  test6  test7  test8  toolschecker

create a tool account in toolsbeta

Should you need to create another account, follow these steps.

First, create a LDAP file with content:

dn: cn=toolsbeta.mytool,ou=servicegroups,dc=wikimedia,dc=org
objectClass: top
objectClass: posixGroup
objectClass: groupOfNames
gidNumber: YYYYY
cn: toolsbeta.mytool
member: uid=aborrero,ou=people,dc=wikimedia,dc=org
member: uid=andrew,ou=people,dc=wikimedia,dc=org
member: uid=bd808,ou=people,dc=wikimedia,dc=org
member: uid=dcaro,ou=people,dc=wikimedia,dc=org
member: uid=mdipietro,ou=people,dc=wikimedia,dc=org

dn: uid=toolsbeta.mytool,ou=people,ou=servicegroups,dc=wikimedia,dc=org
objectClass: shadowAccount
objectClass: posixAccount
objectClass: person
objectClass: top
cn: toolsbeta.mytool
uidNumber: XXXXX
gidNumber: YYYYY
homeDirectory: /data/project/mytool
loginShell: /bin/bash
sn: toolsbeta.mytool
uid: toolsbeta.mytool

Where uidNumber and gidNumber have values that you will need to figure out on your own, some non-perfect method is:

root@toolsbeta-sgebastion-05:~# id -g 54870
54870
root@toolsbeta-sgebastion-05:~# id -g 54871
54871
root@toolsbeta-sgebastion-05:~# id -g 54872
id: ‘54872’: no such user

That means 54872 is empty, and you should be fine to use it in your LDIF file. Update the file and then load it:

root@mwmaint1002:~# ldapadd -x -h serpens.wikimedia.org -p 389  -D "cn=admin,dc=wikimedia,dc=org" -W -f myfile.ldif
Enter LDAP Password:
adding new entry "cn=toolsbeta.mytool,ou=servicegroups,dc=wikimedia,dc=org"
adding new entry "uid=toolsbeta.mytool,ou=people,ou=servicegroups,dc=wikimedia,dc=org"

The prompted password is openldap-labs from Pwstore.

You can check that everything worked with:

root@toolsbeta-sgebastion-05:~# id toolsbeta.mytool
uid=54872(toolsbeta.mytool) gid=54872 groups=54872
root@toolsbeta-sgebastion-05:~# id myuser
uid=18194(aborrero) gid=500(wikidev) groups=500(wikidev),700(ops),50062(project-bastion),50610(project-toolsbeta),53280(toolsbeta.mytool),[..]
                                                                                                                        ^^^^^^^^^^^^^^^^

TODO: https://github.com/toolforge/toolsctl

See also

TODO.