User:emijrp
Welcome to my user page! Here you can see all my tools available in Wikimedia Labs with a brief description about them. I like to develop statistics/visualization tools and recommendation systems, both to analyse and help others to find tasks to do.
I mostly use Python, a bit of PHP, MySQL, JavaScript, HTML+CSS and publish the code with open-source licenses. If you find any bug or want to send me a suggestion, please use the talk page. I have a user page in English Wikipedia too.
My tools
| Tool | Code | Description | Screenshot |
|---|---|---|---|
| commons-coverage | GitHub | A map for Wikimedia Commons coverage. | 
|
| currentevents | GitHub | Analysis of current events articles in several Wikipedias. | - |
| imagesforbio | GitHub | Recommendation tool of images for biographies. Inactive. | - |
| wikiradio | GitHub | A wikiradio for audio files from Wikimedia Commons. | 
|
| wikitweets | GitHub | Twitter bots about Wikipedia, Wikimedia Commons and other wikis. | - |
| wlm-maps | GitHub | A map for the Wiki Loves Monuments photograph contest. | 
|
| wlm-stats | GitHub | Statistics and graphs about the Wiki Loves Monuments photograph contest. Metadata files available, download and create your own statistics! | 
|
| wmcharts | GitHub | A collection of charts about Wikimedia projects, including activity on recent changes, new pages, deletions, blocks, protections, file uploads, reverts and more. | 
|
| wmcounter | GitHub | A near real-time counter for all Wikimedia projects together. Pretty amazing to see, perfect for background in wiki conferences. The 1 billionth edit took place on April 16, 2010. | 
|
Stuff to do
- Fix dead links in enwiki and all (is there a tool to cross-wiki search links or launch a sql query?)
- Understand this and this and make my own Wikidata bots
- Maps and coordinates [1] [2]
- Do some maps like this for missing images
- Do some tools about:
- Write some tutorials:
- Interesting projects I would like to help to:
Help pages
- Help:Getting Started
- Nova Resource:Tools/Help
- User:Magnus Manske/Migrating from toolserver
- Leaflet Tips and Tricks
- Array jobs in grid
- News/2019 Toolforge Trusty deprecation
- Help:Toolforge/Pywikibot
Basic commands
| Command | Example | Description |
|---|---|---|
| become | become wmcounter |
Login as tool user (for exit write 'logout' or press Ctrl+D) |
| chmod | chmod -R g+w /data/project/alicetools |
Make directory writable for group |
| jsub | jsub -N enwiki1 -mem 1G /usr/bin/python /data/project/mytool/script.py enwiki-20140509-pages-meta-history1.xml.7z |
Submit a job named enwiki1 to a queue for running the script.py over a chunk of an English Wikipedia dump.
|
| jsub (pywikibot) |
jsub -N bot22 -mem 1G bot.sh |
Submit a pywikibot job to queue.
|
| pip | pip install mediawiki-utilities |
Install the Python module mediawiki-utilities |
| scp | scp wmcounter.py yourusername@tools-login.wmflabs.org:/data/project/wmcounter |
Upload a single file from your local to the target machine |
scp -r lib/ yourusername@tools-login.wmflabs.org:/data/project/wmcharts |
Upload a directory recursively | |
| sql | sql enwiki |
Enter in MariaDB console (#Database Servers) |
sql metaSELECT * FROM wiki WHERE 1; |
Display all available databases. You can filter by language (lang='xx'), family (family='wikibooks'), etc. | |
sql localuse s51138__heritage_p; |
Enter in erfgoed database | |
| ssh | ssh -A yourusername@tools-login.wmflabs.org |
Connect to tools-login.wmflabs.org. Recommended tools-dev.wmflabs.org
|
mosh -a yourusername@tools-login.wmflabs.org |
Recommended for connections from Europe when lag appears | |
| virtualenv | virtualenv -p python3 name |
Create a virtual environment with Python 3 with the name name |
cd name;source bin/activate |
Move inside the virtualenv name and launch it | |
python -m pip install "requests>=2.20.1" "mwparserfromhell>=0.5.0" "wikitextparser>=0.47.5" pywikibot |
Install pywikibot and dependencies (mw:Manual:Pywikibot/Installation) | |
deactivate |
Exit of virtualenv | |
| webservice | webservice start |
Tool is reachable throught public URL (webservice stop to stop)
|
Processing dumps
| Babel user information |
|---|
- Framework: mediawiki-utilities
- Install: pip install mediawiki-utilities
Other stuff
- morebits.js - Edit Wikipedia with JS
- ResourceLoader
- mw.Api
- Manual:Interface/JavaScript
- Wikipedia:User scripts
- Quarry - SQL queries from web browser