User:BryanDavis/Sandbox/Help:Toolforge/Web

webservice

$ become my_cool_tool
$ webservice start

 -m MEMORY, --mem MEMORY
                       Set higher Kubernetes memory limit
 -c CPU, --cpu CPU     Set a higher Kubernetes cpu limit
 -r REPLICAS, --replicas REPLICAS
                       Set the number of pod replicas to use

 webservice --backend=gridengine stop
 webservice --backend=kubernetes <type> start

webservice --backend=kubernetes stop
webservice --backend=gridengine start

[Default]
--backend=kubernetes

[Default]
--backend=gridengine

import os

from django.core.wsgi import get_wsgi_application

os.environ.setdefault("DJANGO_SETTINGS_MODULE", "<YOUR-TOOL-NAME>.settings")

app = get_wsgi_application()

[uwsgi]
check-static = /data/project/<YOUR-TOOL-NAME>/www/python

STATIC_URL = '/<YOUR-TOOL-NAME>/static/'
STATIC_ROOT = os.path.join(BASE_DIR, 'static')

var http = require('http');
var port = parseInt(process.env.PORT, 10) ; // IMPORTANT!! You HAVE to use this environment variable as port!

http.createServer(function (req, res) {
	res.writeHead(200, {'Content-Type': 'text/plain'});
	res.end('Hello World\n');
}).listen(port);

{
    "scripts": {
        "start": "node server.js"
    }
}

# Secret key
# ~~~~~
# The secret key is used to secure cryptographics functions.
# If you deploy your application to several instances be sure to use the same key!
# On Toolforge, we will make a startup script that specifies play.crypto.secret
# using a command line option reading from a private file.
play.crypto.secret="changeme"

# Port
# ~~~~~
# On WMF Toolforge, the port used by kubernetes webservice is 8000/TCP
http.port=8000

# HTTP context
# ~~~~~
# Your tool will be available at https://tools.wmflabs.org/$TOOLNAME/.
# Play usually expects to be operating at the root of a domain, so this setting is
# required for routes to work properly.
play.http.context="/$TOOLNAME/"

$ webservice --backend=gridengine generic start /data/project/toolname/code/server.bash

#!/usr/bin/env bash
# Run an HHVM webservice
#
# usage: webservice --backend=gridengine generic start hhvm-webservice.sh
set -e

TOOLNAME=${USER#tools.}

if [[ -z $PORT ]]; then
 echo "PORT environment variable not set." >&2
 echo "usage: webservice --backend=gridengine generic start $0" >&2
 exit 1
fi

/bin/cat << EOF > ${HOME}/hhvm-webservice.ini
; Do not edit this file directly! Edit hhvm-webservice.sh instead.
date.timezone = UTC
hhvm.enable_obj_destruct_call = true
hhvm.enable_zend_compat = true
hhvm.error_handling.call_user_handler_on_fatals = true
hhvm.hack.lang.iconv_ignore_correct = true
hhvm.jit = true
hhvm.log.always_log_unhandled_exceptions = true
hhvm.log.native_stack_trace = false
hhvm.log.runtime_error_reporting_level = "HPHP_ALL ^ E_NOTICE"
hhvm.log.use_syslog = false
hhvm.pcre_cache_type = lru
hhvm.pid_file =
hhvm.repo.central.path = /tmp/hhvm-webservice.${TOOLNAME}/hhvm.hhbc
hhvm.server.apc.expire_on_sets = true
hhvm.server.apc.expire_on_sets = true
hhvm.server.apc.purge_frequency = 4096
hhvm.server.apc.table_type = concurrent
hhvm.server.apc.ttl_limit = 172800
hhvm.server.dns_cache.enable = true
hhvm.server.dns_cache.ttl = 300
hhvm.server.exit_on_bind_fail = true
hhvm.server.port = ${PORT}
hhvm.server.source_root = ${HOME}/public_html
hhvm.server.stat_cache = true
hhvm.server.thread_count = 4
hhvm.server.type = proxygen
hhvm.virtual_host[default][rewrite_rules][0][pattern] = "^/${TOOLNAME}(.*)\$"
hhvm.virtual_host[default][rewrite_rules][0][qsa] = true
hhvm.virtual_host[default][rewrite_rules][0][to] = "\$1"
hhvm.log.file=${HOME}/hhvm-webservice.log
error_log=${HOME}/hhvm-webservice-error.log
hhvm.hack.lang.look_for_typechecker = false

; Tweakable configuration
max_execution_time = 60
memory_limit = 128M
hhvm.log.use_log_file = true
hhvm.log.level = Warning

; Repo Authoritative is disabled by default. Uncomment the following if you want to use it (don't forget to actually generate and deploy it!)
;hhvm.repo.authoritative = true

; Uncomment the following if you decided to use the .hh extension instead of .php
;hhvm.server.default_document = index.hh

EOF

exec /usr/bin/hhvm -m server -c ${HOME}/hhvm-webservice.ini

hh_client

	Connect	Best for
Phabricator Workboard	#Cloud-Services	Task tracking and bug reporting
IRC Channel	#wikimedia-cloud ^connect	General discussion and support
Mailing List	cloud@	Information about ongoing initiatives, general discussion and support
Announcement emails	cloud-announce@	Information about critical changes (all messages mirrored to cloud@)
News wiki page	News	Information about major near-term plans
Cloud Services Blog	Clouds & Unicorns	Learning more details about some of our work
Wikimedia Technology Blog	techblog.wikimedia.org	News and stories from the Wikimedia technical movement

User:BryanDavis/Sandbox/Help:Toolforge/Web

Overview

Web Service Introduction

Using webservice command

Common issues

Static file server

External assets

Using HTTP cookies

Default tool memory limits for Web service jobs

Requesting additional tool memory

Response buffering

Grid Engine and Kubernetes backends

Processes Grid Engine and Kubernetes share

Grid Engine

Kubernetes

User visible differences from GridEngine based Web services

Switching between GridEngine and Kubernetes

From GridEngine to Kubernetes

From Kubernetes to GridEngine

Configuring a default backend

Default web server (lighttpd + PHP)

PHP

Python (uWSGI)

Default uwsgi configuration

python3.7 (Python3 + Kubernetes)

Using virtualenv with webservice shell

For new projects

Moving an existing project

Installing numpy / scipy / things with binary dependencies

Python/Python3.5 (Python3 + Kubernetes)

Python2 (Python2 + Kubernetes)

uwsgi-python (Python2 + Grid Engine)

uwsgi-plain (Python3 + Grid Engine)

Using a uwsgi app with a default entry point that is not app.py

Making a Django app work

Setting up

Logs

node.js web services

Running npm with webservice shell

Troubleshooting

Java

Tomcat

Troubleshooting

Play and similar JVM-based frameworks

Other / generic web servers

HHVM (experimental)

Running Hack-coded files

Further information

References

Communication and support

See also

Navigation menu

Search

Using a uwsgi app with a default entry point that is not `app.py`