wikiteam is a free, open source documentation & knowledge base project written in Python and released under GPL-3.0. It has 876 GitHub stars, 177 forks and 171 open issues, and was last pushed 10 months ago. On this registry it ranks #79 of 100 tracked projects in Documentation & Knowledge Base, with 5 head-to-head comparisons available. It gained 5 stars over the last 30 tracked days.

What is wikiteam?

WikiTeam is a GPL-3.0-licensed set of Python tools for downloading and preserving MediaWiki wikis, built for archivists, wiki operators, and volunteers who want to capture a wiki before it disappears.

What it is

WikiTeam is a collection of command-line Python tools for archiving wikis. It works against MediaWiki, the engine behind Wikipedia, and the project intends to expand to other wiki engines over time. It operates as the Archive Team subcommittee on wikis, and it was founded and originally developed by Emilio J. Rodríguez-Posada, a Wikipedia veteran editor and amateur archivist. As of 2026, WikiTeam has preserved more than 600,000 wikis, several wikifarms, regular Wikipedia dumps, and 34 TB of Wikimedia Commons images.

The concrete problem is disappearance. Thousands of wikis exist on the internet, most of them under free licenses, and every day some of them stop being publicly available and are lost forever because nobody kept a backup. Millions of people download media files as a form of distributed backup, but wikis rarely get the same treatment. WikiTeam replaces the absence of that discipline: it stands in for the ad hoc, manual saving of individual pages, or for no preservation attempt at all. The main tool, dumpgenerator.py, replaces page-by-page copying with a single command that walks a wiki's API and writes complete XML page histories and media files to disk.

Key capabilities

  • dumpgenerator.py downloads complete XML histories and images from any MediaWiki wiki with python dumpgenerator.py http://wiki.domain.org --xml --images.
  • Scope is adjustable: --xml captures histories only, --images captures media only, and --xml --curonly captures just the current version of every page.
  • When the script cannot discover the API or index.php paths itself, they can be supplied explicitly with --api= and --index=.
  • Interrupted downloads resume with --resume --path=/path/to/incomplete-dump.
  • wikipediadownloader.py downloads Wikimedia XML dumps covering Wikipedia, Wikibooks, Wikinews, and other Wikimedia projects.
  • Wikimedia Commons image tarballs are published on the Internet Archive, where reseeding the existing torrents is more useful than regenerating them with the script.
  • The test suite runs through the tox command, which requires version 1.6.

Who uses it and how

  • Volunteer archivists operating under Archive Team, who collectively preserve collections of wikis rather than single sites.
  • Individual wiki operators and community members who want a local backup of a live wiki before it is shut down or goes offline.
  • Large-scale preservation efforts that have accumulated more than 600,000 wikis, with the resulting backups catalogued in the project wiki.
  • People who need Wikimedia XML dumps and prefer the regular dump pipeline that wikipediadownloader.py provides.
  • Contributors who send suggestions, report bugs through GitHub issues, write documentation on the wiki, or ask questions on the wikiteam-discuss mailing list.

Getting started

The tools require Python 2.7, and dependencies are installed with pip install --upgrade -r requirements.txt, or pip install --user --upgrade -r requirements.txt when permissions are insufficient. After that, a wiki is archived by running python dumpgenerator.py http://wiki.domain.org --xml --images.

How it compares

This registry's facts name no comparable wiki downloader or preservation tool, so WikiTeam stands alone here rather than being measured against direct alternatives.

When to use it — and when not to

The clearest trade-off is the hard Python 2.7 requirement, an end-of-life interpreter that means a self-hoster has to maintain a dedicated legacy environment just to run the tools. The repository also carries 171 open issues and a README that is deliberately quick rather than complete, pointing users to the wiki tutorial for anything beyond the most common flags. Support for wiki engines other than MediaWiki is a stated goal rather than a delivered feature, so anyone archiving a non-MediaWiki wiki should not expect the current tools to cover it.

project readme (upstream, from github) — read inline

WikiTeam

We archive wikis, from Wikipedia to tiniest wikis

WikiTeam software is a set of tools for archiving wikis. They work on MediaWiki wikis, but we want to expand to other wiki engines. As of 2026, WikiTeam has preserved more than 600,000 wikis, several wikifarms, regular Wikipedia dumps and 34 TB of Wikimedia Commons images.

There are thousands of wikis in the Internet. Every day some of them are no longer publicly available and, due to lack of backups, lost forever. Millions of people download tons of media files (movies, music, books, etc) from the Internet, serving as a kind of distributed backup. Wikis, most of them under free licenses, disappear from time to time because nobody grabbed a copy of them. That is a shame that we would like to solve.

WikiTeam is the Archive Team (GitHub) subcommittee on wikis. It was founded and originally developed by Emilio J. Rodríguez-Posada, a Wikipedia veteran editor and amateur archivist. Many people have helped by sending suggestions, reporting bugs, writing documentation, providing help in the mailing list and making wiki backups. Thanks to all, especially to: Federico Leva, Alex Buie, Scott Boyd, Hydriz, Platonides, Ian McEwen, Mike Dupont, balr0g and PiRSquared17.

Documentation Source code Download available backups Community Follow us on Twitter

Quick guide

This is a very quick guide for the most used features of WikiTeam tools. For further information, read the tutorial and the rest of the documentation. You can also ask in the mailing list.

Requirements

Requires Python 2.7.

Confirm you satisfy the requirements:

pip install --upgrade -r requirements.txt

or, if you don't have enough permissions for the above,

pip install --user --upgrade -r requirements.txt

Download any wiki

To download any wiki, use one of the following options:

python dumpgenerator.py http://wiki.domain.org --xml --images (complete XML histories and images)

If the script can't find itself the API and/or index.php paths, then you can provide them:

python dumpgenerator.py --api=http://wiki.domain.org/w/api.php --xml --images

python dumpgenerator.py --api=http://wiki.domain.org/w/api.php --index=http://wiki.domain.org/w/index.php --xml --images

If you only want the XML histories, just use --xml. For only the images, just --images. For only the current version of every page, --xml --curonly.

You can resume an aborted download:

python dumpgenerator.py --api=http://wiki.domain.org/w/api.php --xml --images --resume --path=/path/to/incomplete-dump

See more options:

python dumpgenerator.py --help

Download Wikimedia dumps

To download Wikimedia XML dumps (Wikipedia, Wikibooks, Wikinews, etc) you can run:

python wikipediadownloader.py (download all projects)

See more options:

python wikipediadownloader.py --help

Download Wikimedia Commons images

There is a script for this, but we have uploaded the tarballs to Internet Archive, so it's more useful to reseed their torrents than to re-generate old ones with the script.

Developers

Build Status

You can run tests easily by using the tox command. It is probably already present in your operating system, you would need version 1.6. If it is not, you can download it from pypi with: pip install tox.

Example usage:

$ tox
py27 runtests: commands[0] | nosetests --nocapture --nologcapture
Checking http://wiki.annotation.jp/api.php
Trying to parse かずさアノテーション - ソーシャル・ゲノム・アノテーション.jpg from API
Retrieving image filenames
.    Found 266 images
.
-------------------------------------------
Ran 1 test in 2.253s

OK
_________________ summary _________________
  py27: commands succeeded
  congratulations :)
$

This use of GitHub is not an endorsement

This project is currently hosted by GitHub for legacy reasons. GitHub is not recommended as it's a service running on proprietary software and does not respect copyleft.

Free software needs free tools: support the campaign Give up GitHub from the Software Freedom Conservancy.

(This section is released under CC-0.)

Logo of the GiveUpGitHub campaign

Frequently asked questions

Is wikiteam free to use?

wikiteam is open source under the GPL-3.0 licence. There is no licence fee and no seat count — you can self-host it or, where the project offers one, pay a vendor for a managed version instead.

What does wikiteam do?

Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2026, WikiTeam has preserved more than 600,000 wikis.

What is wikiteam written in?

wikiteam is primarily written in Python. Its source is publicly available at https://github.com/WikiTeam/wikiteam, and it has 876 GitHub stars.