Nova Resource:Mwoffliner

From Wikitech
Jump to navigation Jump to search
Project Name mwoffliner
Details,
admins/members
openstack-browser
Monitoring

Mwoffliner

Description

Create, one time a month, ZIM files (snapshots for offline usage) of all our projects.

Purpose

Create, one time a month, ZIM files (snapshots for offline usage) of all our projects.

Anticipated time span

indefinite

Project status

currently running

Contact address

contact@kiwix.org Projects used in production


Details

This farm of VMs runs:

  • mwoffliner, a Node.js software able to make a snapshot of a Mediawiki instance on the local filesystem.
  • zimwriterfs, a c++ coded binary, responsible for transforming a local directory with HTML content in a highly compressed ZIM file
  • rsync as a daemon, to allow Kiwix mirror master to download the created ZIM files.

This VMs strongly rely on Wikimedia projects standart & Parsoid APIs.

Setup

The setup procedure of a MWoffliner VM is explain here.

Monitoring

Edit documentation

Server admin log

2020-06-04

  • 09:13 arturo: refresh project quotas: 52 vCPUs (typo/wrong math in previous quota) (T253836)
  • 09:10 arturo: refresh project quotas: 56 vCPUs (from 44) 96GB RAM (from 88) and 1 floating IP (from 3) (T253836)

2020-01-14

  • 02:24 andrewbogott: rebooting wp1 to resolve hangs associated with an old NFS failure

2019-06-20

  • 14:16 andrewbogott: moving mwoffliner3 to a new cloudvirt
  • 13:58 andrewbogott: moving mwoffliner1 to a new cloudvirt

2018-12-12

  • 13:27 andrewbogott: migrating project to eqiad1

=== 2015-09-15 ==... (more)