Mediawiki back up and restore steps - Revision history

Ted: /* Overview */ - add TODO regarding need to capture netstat -ntulp and ports.conf amendment.

2024-02-24T06:34:17Z

Overview: - add TODO regarding need to capture netstat -ntulp and ports.conf amendment.

Ted: /* Overview and Purpose */

2024-02-24T06:29:06Z

Overview and Purpose

Ted: remove email

2024-02-13T14:41:50Z

remove email

Ted: formatting

2024-02-13T14:41:17Z

formatting

Ted at 18:33, 16 March 2021

2021-03-16T18:33:44Z

Ted at 03:03, 1 December 2017

2017-12-01T03:03:00Z

Ted: /* Overview and Purpose */

2017-12-01T02:37:54Z

Overview and Purpose

Ted at 14:31, 10 October 2017

2017-10-10T14:31:05Z

Ted: 2017-07-31 somvaar - Ted starting personal notes article on Mediawiki back-up and restoration.

2017-07-31T22:05:33Z

2017-07-31 somvaar - Ted starting personal notes article on Mediawiki back-up and restoration.

New page

<center>
Alta Wiki Back-up Process 
Contributors: [[User:Ted|Ted Havelka]] <ted@cs.pdx.edu> 
Started: 2016-04-12 Tuesday 
    This article in progress    
</center>

__TOC__

== Overview and Purpose ==

Note: this article is in progress!

Ted writing this article to cover the back-up and recovery steps of a personal or small-scale Mediawiki site. Once the back-up and restore steps are tested to work and well-understood, a further purpose of this article is to automate as far as possible these steps.

This article describes the situation where the wiki to restore is supported by and running on a Linux based host, and the target host to support the back up copy of the wiki is also a Linux based host.

* Install the latest stable MYSQL server and client on the computer which will host the wiki back up,

* Create a database for the wiki and a MYSQL user with password and privileges to the new database,

* Download and uncompress latest stable release of mediawiki,

* Rename uncompressed mediawiki top directory to short name such as 'wiki',

* For remote configuration via browser move this renamed mediawiki file set to <code>/var/www/html</code>,

* Complete the seven to ten steps via Mediawiki's web interface found in the <code>mw-config</code> subdirectory,

* Copy media files from the original wiki to the path defined in $wgUploadPath,

* Use a web browser and navigate through several pages of the restored wiki on the newer target host.

The question now is how many of these steps can be automated in a shell script? . . . - TMH



== Creating Wiki Database And Wiki User ==

<pre>

ted@back-up-server:/var/www/wiki$ mysql -u root -p
Enter password:
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 7
Server version: 5.7.13-0ubuntu0.16.04.2 (Ubuntu)

Copyright (c) 2000, 2016, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| mysql |
| performance_schema |
| sys |
+--------------------+
4 rows in set (0.04 sec)

mysql> CREATE DATABASE wikidb;
Query OK, 1 row affected (0.03 sec)

mysql> grant all privileges on wikidb.* to 'wikiuser'@'localhost' identified by 'wiki_pass_phrase';
Query OK, 0 rows affected, 1 warning (0.03 sec)

</pre>







== Wiki Database Back Up ==

<pre>

$ mysqldump -h localhost -u wikiuser -p --default-character-set=utf8 wikidb >> /home/ted/alta-wiki-database-backup-2016-05-03.sql

</pre>

This file may be gzip'd or otherwise compressed. In the case of the Alta wiki, compression reduces database file size from 148 MB to 36 MB, about a four fold reduction in file size.





== Wiki Database Restoration ==

At least some of the time the MYSQL database dump file will have in the first several lines a comment expressing the database which is backed up by the given file. There may not, however, be any MYSQL statement to create a database by that name, or to use a database by that name. One of these MYSQL directives will likely need be added manually to the file before invoking the MYSQL client to run the statements contained in the back up file.

Figure x - first twenty lines of a MYSQL database back up file:

<pre>

veris@alta-spare-2u:~/archive$ cat alta-wiki-database-backup-2016-12-28.sql | head -n 20

-- MySQL dump 10.13 Distrib 5.1.54, for debian-linux-gnu (x86_64)
--
-- Host: localhost Database: wikidb
-- ------------------------------------------------------
-- Server version 5.1.54-1ubuntu4

/*!40101 SET @OLD_CHARACTER_SET_CLIENT=@@CHARACTER_SET_CLIENT */;
/*!40101 SET @OLD_CHARACTER_SET_RESULTS=@@CHARACTER_SET_RESULTS */;
/*!40101 SET @OLD_COLLATION_CONNECTION=@@COLLATION_CONNECTION */;
/*!40101 SET NAMES utf8 */;
/*!40103 SET @OLD_TIME_ZONE=@@TIME_ZONE */;
/*!40103 SET TIME_ZONE='+00:00' */;
/*!40014 SET @OLD_UNIQUE_CHECKS=@@UNIQUE_CHECKS, UNIQUE_CHECKS=0 */;
/*!40014 SET @OLD_FOREIGN_KEY_CHECKS=@@FOREIGN_KEY_CHECKS, FOREIGN_KEY_CHECKS=0 */;
/*!40101 SET @OLD_SQL_MODE=@@SQL_MODE, SQL_MODE='NO_AUTO_VALUE_ON_ZERO' */;
/*!40111 SET @OLD_SQL_NOTES=@@SQL_NOTES, SQL_NOTES=0 */;

--
-- Table structure for table `archive`
--

</pre>

Database dumps can be redirected at the shell prompt to the MYSQL client:

$ mysql [database_name] < database-back-up.sql


http://dev.mysql.com/doc/refman/5.5/en/mysql-batch-commands.html





== Restoring Media Files ==

While the wiki database may be large on the order of tens or hundreds of megabytes, the media files such as PDFs, images, videos and audio clips are not embedded in the database. These files are organized in a wiki directory defined by the <code>LocalSettings.php</code> variable named <code>$wgUploadPath</code>.

As of 2017-10-04 WED the third and final command below is sufficient to copy media files from the wiki to be backed up and restored to the new target wiki:

Figure x - using rsync to back up and restore media files of a wiki site:

<pre>

ted@back-up-server:/var/www/html/wiki/images$ date
Tue Jan 3 18:45:40 PST 2017

ted@back-up-server:/var/www/html/wiki/images$ pwd
/var/www/html/alta-wiki/images

ted@back-up-server:/var/www/html/wiki/images$ rsync -avzpt ted@original-server:/var/www/wiki/images/* .

</pre>



==References==

<ul>
* http://www.mediawiki.org/wiki/Manual:Backing_up_a_wiki 

* http://www.mediawiki.org/wiki/Manual:Configuring_file_uploads 
</ul>

<center>
[[#top|- top of page -]]
</center>

← Older revision		Revision as of 06:34, 24 February 2024
Line 36:		Line 36:

	* Create an index.html or index.php file in `/var/www/sandbox-website.local/public_html`		* Create an index.html or index.php file in `/var/www/sandbox-website.local/public_html`
		+
		+
		+	TODO:
		+
		+	(1) note test `netstat -ntulp` to confirm at least one service listening on SSL port 443
		+
		+	(2) note amendment to /etc/apache2/ports.conf to enable localhost apache2 server to listen on port 8000

← Older revision		Revision as of 14:41, 13 February 2024
Line 1:		Line 1:
	<font size="4">MediaWiki Back-up Process</font><br />		<font size="4">MediaWiki Back-up Process</font><br />
−	~~Contributors: [[User:Ted\|Ted Havelka]] <ted@cs.pdx.edu><br />~~
	Started: 2016-04-12 Tuesday<br />		Started: 2016-04-12 Tuesday<br />

@@ Line 1: / Line 1: @@
 <font size="4">MediaWiki Back-up Process</font><br />
 Contributors:  [[User:Ted|Ted Havelka]] &lt;ted@cs.pdx.edu&gt;<br />
 Started: 2016-04-12 Tuesday<br />
@@ Line 20: / Line 15: @@
 This article describes the situation where the wiki to restore is supported by and running on a Linux based host, and the target host to support the back up copy of the wiki is also a Linux based host.
@@ Line 38: / Line 32: @@
 *  Use a web browser and navigate through several pages of the restored wiki on the newer target host.
@@ Line 44: / Line 37: @@
 The question now is how many of these steps can be automated in a shell script? . . . - TMH
 <!-- comment -->
@@ Line 93: / Line 83: @@
 ==MediaWiki Restoration==
 -->
 <!-- comment -->
@@ Line 101: / Line 89: @@
 == Wiki Database Back Up ==
 <pre>
@@ Line 110: / Line 97: @@
 This file may be gzip'd or otherwise compressed.  In the case of our example wiki, compression reduces database file size from 148 MB to 36 MB, about a four fold reduction in file size.
 <!-- comment -->
@@ Line 128: / Line 113: @@
     /etc/apache2/sites-available/given-site.conf
     /etc/apache2/sites-enabled/000-given-site.conf --> ../sites-available/given-site.conf
 <!-- comment -->
@@ Line 136: / Line 119: @@
 == Wiki Database Restoration ==
 At least some of the time the MYSQL database dump file will have in the first several lines a comment expressing the database which is backed up by the given file.  There may not, however, be any MYSQL statement to create a database by that name, or to use a database by that name.  One of these MYSQL directives will likely need be added manually to the file before invoking the MYSQL client to run the statements contained in the back up file.
@@ Line 206: / Line 188: @@
 </pre>
 <!-- comment -->

@@ Line 1: / Line 1: @@
 <center>
-<font size="4"><MediaWiki Back-up Process</font><br />
+<font size="4">MediaWiki Back-up Process</font><br />
 Contributors:  [[User:Ted|Ted Havelka]] &lt;ted@cs.pdx.edu&gt;<br />
 Started: 2016-04-12 Tuesday<br />

← Older revision		Revision as of 03:03, 1 December 2017
Line 110:		Line 110:

	This file may be gzip'd or otherwise compressed. In the case of our example wiki, compression reduces database file size from 148 MB to 36 MB, about a four fold reduction in file size.		This file may be gzip'd or otherwise compressed. In the case of our example wiki, compression reduces database file size from 148 MB to 36 MB, about a four fold reduction in file size.
		+
		+
		+
		+	<!-- comment -->
		+
		+	<!-- SECTION - MediaWiki download, verify and install -->
		+
		+	== MediaWiki download, verify and install ==
		+
		+	It is a good idea to download the latest stable release of MediaWiki from MediaWiki's downloads page, and to verify that your downloaded instances of this software pass GNU php signature / key checks. [https://help.ubuntu.com/community/GnuPrivacyGuardHowto GNU Privacy Guard how-to] page has some good tutorial info on how to verify gpg-signed files.
		+
		+	Once MediaWiki version x is downloaded and uncompressed, there is a single parent directory of our MediaWiki instance which at this point we may rename and move into its web root directory. A generic name for a MediaWiki installation on a webserver might be something like "wiki". We may rename, for example, the later 2017 release candidate <i>mediawiki-1.30.0-rc.0 --> wiki</i>, and move this file then to a typical web directory like /var/www/html. At this point the local web server apache2 or nginx doesn't know anything about the newly downloaded, verified, uncompressed and unarchived MediaWiki software. We must add a couple of config files belonging to the web server.
		+
		+	For apache2 web server, a simple way to inform the web server of the new page we want to provide to the world wide web ( or local area network ) is to create a configuration file per apache2's understood file formats. The locations of the text file for a web domain or web site, and a conventional symlink to enable the given website are:
		+
		+
		+	/etc/apache2/sites-available/given-site.conf
		+	/etc/apache2/sites-enabled/000-given-site.conf --> ../sites-available/given-site.conf

@@ Line 7: / Line 7: @@
-== Overview and Purpose ==
+== Overview ==
 <i>Note:  this article is in progress!</i>
-Ted writing this article to cover the back-up and recovery steps of a personal or small-scale Mediawiki site.  Once the back-up and restore steps are tested to work and well-understood, a further purpose of this article is to automate as far as possible these steps.
+This article describes the situation where the wiki to restore is supported by and running on a Linux based host, and the target host to support the back up copy of the wiki is also a Linux based host.
 *  Install the latest stable MYSQL server and client on the computer which will host the wiki back up,

← Older revision		Revision as of 02:37, 1 December 2017
Line 40:		Line 40:


		+
		+	When downloading MediaWiki, use GNU Privacy Guard or gpg utility to confirm that the downloaded files are integral. See [https://www.mediawiki.org/keys/keys.html MediaWiki public keys] page for command to issue to obtain public gpg keys.

	The question now is how many of these steps can be automated in a shell script? . . . - TMH		The question now is how many of these steps can be automated in a shell script? . . . - TMH

@@ Line 1: / Line 1: @@
 <center>
-<font size="4">Alta Wiki Back-up Process</font><br />
+<font size="4"><MediaWiki Back-up Process</font><br />
 Contributors:  [[User:Ted|Ted Havelka]] &lt;ted@cs.pdx.edu&gt;<br />
 Started: 2016-04-12 Tuesday<br />
@@ Line 103: / Line 103: @@
 <pre>
-$ mysqldump -h localhost -u wikiuser -p --default-character-set=utf8 wikidb >> /home/ted/alta-wiki-database-backup-2016-05-03.sql
+$ mysqldump -h localhost -u wikiuser -p --default-character-set=utf8 wikidb >> /home/ted/local-wiki-database-backup-2016-05-03.sql
 </pre>
-This file may be gzip'd or otherwise compressed.  In the case of the Alta wiki, compression reduces database file size from 148 MB to 36 MB, about a four fold reduction in file size.
+This file may be gzip'd or otherwise compressed.  In the case of our example wiki, compression reduces database file size from 148 MB to 36 MB, about a four fold reduction in file size.
@@ Line 125: / Line 125: @@
 <pre>
-veris@alta-spare-2u:~/archive$ cat alta-wiki-database-backup-2016-12-28.sql | head -n 20
+user@localhost:~/archive$ cat local-wiki-database-backup-2016-12-28.sql | head -n 20
 -- MySQL dump 10.13  Distrib 5.1.54, for debian-linux-gnu (x86_64)
@@ Line 181: / Line 181: @@
 ted@back-up-server:/var/www/html/wiki/images$ pwd
-/var/www/html/alta-wiki/images
+/var/www/html/local-wiki/images
 ted@back-up-server:/var/www/html/wiki/images$ rsync -avzpt ted@original-server:/var/www/wiki/images/* .