wp-mirror - Summary

This group is not part of the GNU Project.

The Wikimedia Foundation offers wikipedias in nearly 300 languages. In addition, the WMF has several other projects (e.g. wikibooks, wiktionary, etc.) for a total of around 1000 wikis.
 
Wp-mirror is a free utility for mirroring any desired set of these wikis. That is, it builds a wiki farm that the user can browse locally.  Many users need such off-line access, often for reasons of mobility, availability, and privacy.  Wp-mirror builds a complete mirror with original size images. Wp-mirror is robust and uses check-pointing to resume after interruption.

Wp-mirror by default mirrors the `simple wikipedia', the `simple wiktionary' (Simple English means shorter sentences), and the `wikidata wiki' (a centralized collection of facts usable by all other wikis).  The default should work `out-of-the-box' with no user configuration.  It should build in 200ks (two days), occupy 150G of disk space, be served locally by virtual hosts <http://simple.wikipedia.site/>, <http://simple.wiktionary.site>, and <http://www.wikidata.site/>, and update automatically every week.  The default should be suitable for anyone who learned English as a second language (ESL).

The top ten wikipedias are: en, de, nl, fr, it, ru, es, sv, pl, and ja. Because wp-mirror uses original size image files, the top ten are too large to fit on a laptop with a single 500G disk, unless the user does not need the images (and this is configurable). The `en wikipedia' is the most demanding case.  It should build in 1Ms (twelve days), occupy 3T of disk space, be served locally by virtual host <http://en.wikipedia.site/>, and update automatically every month.

Registration Date: Sat 24 Dec 2011 05:15:58 AM UTC
License: GNU General Public License v3 or later
Development Status: 4 - Beta