Nova Resource:Math

From Wikitech
Jump to navigation Jump to search
Project Name math
Details,
admins/members
openstack-browser
Monitoring

Math

Description

Test to render TeX to MathML within the MW Framework

Purpose

Improve Math rendering and MathSearch

Anticipated traffic level

100-1000 hits per day

Anticipated time span

indefinite

Project status

currently running

Contact address

wiki@physikerwelt.de

Willing to take contributors or not

willing

Subject area narrow or broad

broad Math, Wikidata, MathML, HTML5, W3C


This project has the following purposes:

  1. Improve the rendering quality of math
  2. Make math searchable
  3. Add semantic information to the mathematical content

data-set

As a test data-set we use the subsection of the English wikipedia that contains math tags. The size of the dataset is about 28k Articles with about 450k tags, and about 280k unique tags.

Overview

The public entry point for a demo is

The enabled plugins are visible at http://math2.beta.wmflabs.org/wiki/Special:Version

Comparision of rendering methods

A comparison of the rendering methods can be seen at

info about math2

Setup

  • Wait until first successful puppet run
  • Reboot
  • enable labs::vagrant puppet module
  • create localhome for vagrant user
  • run sudo labs-vagrant provision
  • run sudo labs-vagrent enable-role mathsearch
  • provision again
  • import Wikipedia articles that contain math from http://demo.formulasearchengine.com/images/enwikimath.xml.bz2
  • move mysql data directory
    • enable role::labs::lvm::mnt puppet module
    • shutdown mysql
    • move /var/lib/mysql to /mnt/mysql
    • update /etc/mysql/my.conf and /etc/apparmor.d/usr.sbin.mysqld
    • start mysql

Todo

  • move mysql directory to a place with sufficient space
physikerwelt@math2:/etc/mysql$ df -h
Filesystem                                      Size  Used Avail Use% Mounted on
/dev/vda1                                       7.6G  1.9G  5.3G  26% /
udev                                            2.0G  8.0K  2.0G   1% /dev
tmpfs                                           792M  256K  791M   1% /run
none                                            5.0M     0  5.0M   0% /run/lock
none                                            2.0G     0  2.0G   0% /run/shm
/dev/vda2                                       1.9G  577M  1.3G  32% /var
labstore.svc.eqiad.wmnet:/dumps                 9.1T  8.0T  1.2T  88% /public/dumps
labstore.svc.eqiad.wmnet:/scratch               7.3T  871M  7.3T   1% /data/scratch
labstore.svc.eqiad.wmnet:/keys                  960M   30M  930M   4% /public/keys
labstore.svc.eqiad.wmnet:/project/math/project   30T   14T   17T  46% /data/project
labstore.svc.eqiad.wmnet:/backups                20T     0   20T   0% /public/backups
labstore.svc.eqiad.wmnet:/project/math/home      30T   14T   17T  46% /home
  • make mysql database accessible from within the math test cluster i.e. for stratosphere
  • evaluate performance metrics again

DRMF

The purpose of the NIST Digital Repository of Mathematical Formulae (DRMF) is to create a digital compendium of mathematical formulae for orthogonal polynomials and special functions (OPSF) and of associated mathematical data. The DRMF provides a platform for publication and interaction with OPSF formulae on the web. Using MediaWiki extensions and other existing technology (such as software and macro collections developed for the NIST Digital Library of Mathematical Functions), the DRMF acts as an interactive web domain for OPSF formulae. Whereas Wikipedia and other web authoring tools manifest notions or descriptions as first class objects, the DRMF does that with mathematical formulae.

This project has many goals which are directly in line with important goals of MediaWiki. In order to develop this resource we are adding features to the MediaWiki math extension and in conjunction with these, building MediaWiki extensions specific to DRMF. By using these features we will add accessibility to the math extension. The use of semantic macros will lead to improved capabilities for search and accessibility. Not only that, we are developing formula search which have the potential to add to the future capabilities of MediaWiki for large databases such as Wikipedia.

Users of instances

drmf-ecf
Yusuf
drmf2015
Akash
drmf
hcohl
drmf-beta
physikerwelt
drmf-test
unassigned
mlp
jimmy, norman, alexey
mathosphere
physikerwelt
Edit documentation

Server admin log

2019-03-14

  • 23:13 bd808: Deleted drmf, math-ru, mathoid2 (T204509)

2019-03-01

  • 10:39 arturo: shut down drmft instance again (was active by mistake due to workload reallocation) Will be deleted soon anyway

2019-02-05

  • 17:23 arturo: make myself projectadmin for better view of internal project logs
  • 17:18 arturo: T204509 shutting down again drmf-beta and drmf

2019-01-31

  • 12:05 arturo: VM instances drmf,drmf-beta,math-docker, were stopped briefly due to issue in hypervisor (T215012)

2019-01-21