Difference between revisions of "Service/backup"

From Sugar Labs
Jump to navigation Jump to search
Line 1: Line 1:
 
== Locations ==
 
== Locations ==
  
* /backup on [[Machine/treehouse|Machine/justice]]: daily filesystem backups for [[Machine/jita|Machine/freedom]]
+
* /backup on [[Machine/justice]]: daily filesystem backups for [[Machine/freedom]]
* /backup on [[Machine/housetree|Machine/freedom]]: daily filesystem backups for [[Machine/sunjammer|Machine/justice]]
+
* /backup on [[Machine/freedom]]: daily filesystem backups for [[Machine/justice]]
 
* /backup on [[Machine/housetree]]: daily filesystem backups for [[Machine/sunjammer]]
 
* /backup on [[Machine/housetree]]: daily filesystem backups for [[Machine/sunjammer]]
 
* /backup on sunjammer.sugarlabs.org: daily database dumps (ldap, mysql and pgsql) for [[Machine/sunjammer]]
 
* /backup on sunjammer.sugarlabs.org: daily database dumps (ldap, mysql and pgsql) for [[Machine/sunjammer]]
Line 8: Line 8:
 
== Administrative contact ==
 
== Administrative contact ==
  
bernie AT sugarlabs DOT org
+
* Bernie Innocenti <bernie AT sugarlabs DOT org>
  
 
== Sysadmins ==
 
== Sysadmins ==
Line 16: Line 16:
 
* [[User:Bernie|Bernie Innocenti]]
 
* [[User:Bernie|Bernie Innocenti]]
  
== backup.sugarlabs.org ==
+
== wizbackup ==
  
This is the main backup server for all [[Machine|Sugarlabs Machines]]. The hostname backup.sugarlabs.org is an alias for owl.laptop.org, a machine hosted at OLPC.
+
* [[http://codewiz.org/gitweb/wizbackup.git|Source code]]
 +
* [[http://codewiz.org/gitweb/wizbackup.git/blob/HEAD:/INSTALL|Installation instructions]]
  
Backup account:
+
This is the main backup script for all [[Machine|Sugar Labs Machines]]. It's a minimalist script based on rsync and keeps a history of N days using hard-links. While it's very very simple, wizbackup gets the job done and has the added benefit of not requiring any tools to read or restore a backup. The advantage over similar backup solution is that backups are just plain filesystem snapashots of the source machines; the main disadvantage is poor performance with large files which change often, such as logs or databases (my solution is to exclude these and backup the data using ad-hoc methods, such as SQL dumps).
 
+
The `wizbackup-driver` script runs daily on the backup servers from `/etc/cron.daily/wizbackup`.
sugarbackup@backup.sugarlabs.org:/home/sugarbackup/
+
It reads a list of hostnames to backup from `/backup/HOSTS/<machine-group-name>` and an optional list of files exclusions from `/backup/EXCLUDES`.
 
 
We use the script system-full-backup to perform the daily backups with duplicity. Each machine backup is encrypted with a different password. If you need a password, ask [[User:Bernie]].
 
  
 
== Sunjammer ==
 
== Sunjammer ==

Revision as of 19:35, 5 April 2015

Locations

Administrative contact

* Bernie Innocenti <bernie AT sugarlabs DOT org>

Sysadmins

For non-emergency calls, preferably send email to the administrative contact.

wizbackup

* [code]
* [instructions]

This is the main backup script for all Sugar Labs Machines. It's a minimalist script based on rsync and keeps a history of N days using hard-links. While it's very very simple, wizbackup gets the job done and has the added benefit of not requiring any tools to read or restore a backup. The advantage over similar backup solution is that backups are just plain filesystem snapashots of the source machines; the main disadvantage is poor performance with large files which change often, such as logs or databases (my solution is to exclude these and backup the data using ad-hoc methods, such as SQL dumps). The `wizbackup-driver` script runs daily on the backup servers from `/etc/cron.daily/wizbackup`. It reads a list of hostnames to backup from `/backup/HOSTS/<machine-group-name>` and an optional list of files exclusions from `/backup/EXCLUDES`.

Sunjammer

Machine/sunjammer's filesystem is being backed up on Machine/treehouse using rsync + 7 days of history with hard links.

The MySQL, PostgreSQL and LDAP databases are being backed up daily on backup.sugarlabs.org, encrypted with gpg. TODO: at the moment, we don't have a script to cleanup old backups.

Restoring files from duplicity backups

To restore a backup try something like:

  duplicity restore -t 7D --file-to-restore <source/path/to/restore/from>  scp://sugarbackup@backup.sugarlabs.org/backup/<machine.sugarlabs.org>  </destination/path/to/restore/to>
  • Replace <> with your values


Example:

  duplicity restore -t 7D --file-to-restore var/lib/mysql/wordpress  scp://sugarbackup@backup.sugarlabs.org/backup/sunjammer.sugarlabs.org  /home/bernie/restore/wordpress

See Also