How to install the BackupPC application: Difference between revisions
No edit summary |
(No difference)
|
Revision as of 21:49, 31 October 2013
BackupPC on QNAP
This page describes how to install BackupPC on a QNAP NAS (Originally targeted for a QNAP TS-439 Pro NAS, but with some modifications it should not be difficult to adapt it for other models). This article initially started to document a solution to create automatic backups (full/incremental) for an office with 4 windows PC clients.
It is known that BackupPC has been installed successfully at least on following QNAP models.
- QNAP TS-210
- QNAP TS-219P
- QNAP TS-269 Pro
- QNAP TS-412U
- QNAP TS-419P+
- QNAP TS-419P II
- QNAP TS-439 Pro
- QNAP TS-459 Pro
- QNAP TS-459 Pro+
- QNAP TS-659
- QNAP TS-659 Pro II
- QNAP TS 859 Pro (Configuration: 12TB-Raid6)
- QNAP TS 809 Pro (Configuration: 12TB-Raid6)
Please add your model to the list above if it is running BackupPC and not listed over here.
Exemplary device QNAP TS-439 Pro NAS
The QNAP TS-439 Pro, an exemplary device from the list from above, inhibited for example the following features:
- It had a relatively fast i386 compatible processor and in a test (in ct' magazine) it proved to have very fast cifs file sharing transfer speeds.
- With a system booting and running from the internal disk-on-chip, the system would not be dependent on any of it's hot swappable and easy to remove/insert hard disks.
- Four hot swappable bays would give enough future expansion possibilities.
- With file compression set to zero the performance for backing up a windows machine with the rsync protocol is about 25 MB/s. The single core processor at the QNAP (An Intel Atom N270 processor, with hyperthreading) is running then at 100% load. When 3 computers, running a mixture of windows xp and 7, are backed up simultaneously the speed divides over the 3 computers, each transfering about 8 MB/s.
Webserver lighttpd with BackupPC
BackupPC was installed with webserver lighttpd. Although it has apache already installed, I considered that with a secondary installed webserver, it would not interfere with apache and apache would then be still 'free' to experiment with without interfering with BackupPC's webinterface.
Further system specifications
- QNAP system software v3.4.2 Build0331
- Storage: 3×2TB Hard Disk Western Digital RE4 WDC WD2003FYYS ( 2.0 TB 64MB 3.5IN S-ATA II 7200RPM), configured in Raid 5, giving a total of 3.6 TB of storage.
Please note that some hard disk models, like the Western Digital WD20EARS are not suitable for raid configuration. Read more about this: here
Installation tips
- When copy/pasting commands from below into a shell into an editor like nano, make sure that single lines remain on one line. Nano may not recognize text wrap correctly. When your nano window is too narrow, commands which were originally on a single line, become fragmented which caused some unexpected behavior. Certainly not something what you want and easy to overlook with large blocks of text. Another fix is using the editor joe, especially with the file /share/MD0_DATA/custom/autorunmaster.sh, containing long lines
- Although not relevant for this installation manual because the webserver lighttpd is being used rather than apache, at the QNAP TS-439 PRO the apache configuration settings are in: /etc/config/apache/apache.conf
- When following this guide, installing of BackupPC should be finished in about 40 minutes.
Basic configuration
Enter at least following information on the QNAP web-based interface:
- Factory default username and password is: admin
- Server Name: BACKUPNAS (In my situation identical to IP-address 192.168.2.115)
- User: admin
- Password: (figure out yourself)
- Network Services
- Enable file service for Microsoft networking
- Server Description: NAS Backup Server
- Workgroup: (figure out yourself)
- Raid 5 configuration with 3 x 2.0 TB hard disk WD2003FYYS
Presuming that your computer has ssh installed and configured and you have some affinity with what ssh is and how to use it, append your public key on your computer, which probably is in ~/.ssh/id_dsa.pub to the .ssh/authorized_keys file at the NAS. If the file authorized_keys is not present at the NAS, just copy:
scp ~/.ssh/id_dsa.pub admin@192.168.2.115:.ssh/authorized_keys
Otherwise do (See also: How_To_Set_Up_Authorized_Keys):
scp ~/.ssh/id_dsa.pub admin@192.168.2.115:.ssh/keytemp ssh admin@192.168.2.115 cd .ssh cat keytemp >> authorized_keys rm keytemp
Now you should be able to connect safely to the NAS. For a more convenient ssh connection, add a file with the filename "config" in your local .ssh directory and add the following lines:
Host nas HostName 192.168.2.115 User admin
Now you should be able to connect with ssh with the following command:
ssh nas
The nas server can ask for a passphrase if you had one. In Ubuntu 9.04 there is an issue with the ssh-agent (or maybe it is the gnome-keyring), which should be able to store your passphrase, preventing the need to retype it each time it is being requested. The issue concerns that the passphrase is not being stored properly.
Step 1. Installation part from within the webbrowser
- Use IP address in web browser or just type: http://BACKUPNAS
- Download Optware QPKG (Applications->QPKG Plugins->Get QPKG->Optware IPKG (Itsy Package Management System) (Version 0.99.163)
- Extract Optware_0.99.163_X86.qpkg in this zip archive
- Install Optware QPKG by clicking on tab Installation->Browse to Optware_0.99.163_X86.qpkg -> Install
- Enable Optware QPKG in tab QPKG Installer->Icon Optware->Enable->Close
Step 2. Installation part from within a terminal
Since we have setup ssh access properly, we can go on now from within a terminal. Log in with ssh to the TS-439Pro
ssh nas
Then check free memory space with
free
Check mounted partitions with
mount
Check free disk size with command:
df -h
(Notice the /dev/md0, which is in my case the mirrored raid device.) Since /opt is an symlink to /share/MD0_DATA/.qpkg/Optware/ the size of the /opt directory will be large enough for BackupPC (Here 1GB is advised: backuppc-lighttpd-dd-wrt)
Update ipkg and install the editor nano:
ipkg update ipkg install nano
BackupPC dependencies
The documentation for BackupPC is available at http://backuppc.sourceforge.net/faq/BackupPC.html . We need to install BackupPC dependencies as mentioned on that page. Although most dependencies are installed while setting up Optware as explained above, we still need to Install following packages on which BackupPC further relies:
ipkg install perl samba2 tar rsync par2cmdline
Intermezzo - openssh
The default SSH client provided by QNAP (at /usr/bin/ssh) might not be very useful to use with BackupPC because of its limited set of options and security issues. Therefore we install the openssh package which should install the OpenSSH client at /opt/bin/ssh.
ipkg-opt install openssh
But it should be noted that this package will also install the OpenSSH server. This has to be disabled so that it does not conflict with the default SSH server provided. Therefore in /opt/etc/default/openssh, change
SSHD_ENABLE=yes
to
SSHD_ENABLE=no
This should prevent OpenSSH server from starting at boot time.
Perl modules
Apart from the above utilities, BackupPC has the following perl modules as dependencies - Compress::Zlib, Archive::Zip, File::RsyncP and XML::RSS .
Compress::Zlib can be installed directly from the optware repository.
ipkg install perl-compress-zlib
Similarly, Archive::Zip can be installed directly from the optware repository.
ipkg install perl-archive-zip
Making Perl-File-RsyncP
- TIP: On the TS-412U there is not enough space for the step as described. I had to move the /root/.cpan directory to /share/MD0_DATA/root/ and then link to that. After that all went smoothly.
Since the ipkg package perl-file-rsyncp is not available, we have to build this manually instead. Do the following:
ipkg install optware-devel
For CPAN module File::RsyncP, first we set up the build environment. This build environment will also be useful for installing other perl modules. Then we download the source from Perl CPAN and install it. Move to a directory with enough space. I cd'ed to /share/MD0_DATA/, created a directory installtemp there and worked from there:
mkdir /share/MD0_DATA/installtemp cd /share/MD0_DATA/installtemp wget http://search.cpan.org/CPAN/authors/id/C/CB/CBARRATT/File-RsyncP-0.70.tar.gz tar zxvf File-RsyncP-0.70.tar.gz cd File-RsyncP-0.70 perl Makefile.PL make LD=ld LINKTYPE=dynamic LDDLFLAGS="-shared -O2" make LD=ld LINKTYPE=dynamic LDDLFLAGS="-shared -O2" test make LD=ld LINKTYPE=dynamic LDDLFLAGS="-shared -O2" install
Continue with installing other perl modules. Start the CPAN and when it asks, set all space directories to begin with: /share/MD0_DATA/installtemp.
perl -MCPAN -e shell cpan>
Upgrade the CPAN module and restart it:
cpan> install Bundle::CPAN cpan> reload cpan
CPAN configuration can be checked with the following command:
cpan> o conf
CPAN configuration can be modified with the following command:
cpan> o conf init
This will guide you through all settings and offer default settings which are fine. Again, make sure all space taking directories are set to begin with: /share/MD0_DATA/installtemp
Install the CPAN module File::Listing:
cpan> install File::Listing cpan> exit
Our last CPAN module, XML::RSS, has a lot of dependencies (this can be seen clearly in here). Therefore, following the steps similar to those mentioned in http://www.livejournal.com/doc/server/lj.install.perl_setup.modules.html. In theory is is possible to install from CPAN directly. Please note that the XML::RSS module is necessary only if you plan to use BackupPC RSS feed. As I was not planning to use the RSS feed and the installation with the method below failed, I chose to ignore this dependency. The error it threw was: "no space left on device". If the memory problem is solved, the command to install the XML::RSS CPAN module is:
cpan> install XML::RSS cpan> exit
Installing BackupPC
To run BackupPC, it is recommended that there is a user specifically for this program. We create the user backuppc for this:
/usr/local/bin/useradd -m -d /share/MD0_DATA/backuppc backuppc
This will create a home profile in a 'safe' area, a user backuppc. cd to the home folder from backuppc
cd /share/MD0_DATA/backuppc
Download from this directory the sources of BackupPC:
wget http://sourceforge.net/projects/backuppc/files/backuppc/3.2.1/BackupPC-3.2.1.tar.gz/download
Extract the archive, cd into it:
tar zxvf BackupPC-3.2.1.tar.gz cd BackupPC-3.2.1
In this directory, execute the perl configure script and enter custom data as written down here (scroll down!):
perl configure.pl --config-dir=/opt/etc/backuppc --log-dir=/opt/var/log/backuppc Is this a new installation or upgrade for BackupPC? If this is an upgrade please tell me the full path of the existing BackupPC configuration file (eg: /etc/BackupPC/config.pl). Otherwise, just hit return. --> Full path to existing main config.pl []? I found the following locations for these programs: bzip2 => /bin/bzip2 cat => /bin/cat df => /bin/df gtar/tar => /bin/tar gzip => /bin/gzip hostname => /bin/hostname nmblookup => /opt/bin/nmblookup par2 => /opt/bin/par2 perl => /opt/bin/perl ping => /bin/ping rsync => /usr/bin/rsync sendmail => /usr/sbin/sendmail smbclient => /opt/bin/smbclient split => /usr/bin/split ssh/ssh2 => /usr/bin/ssh --> Are these paths correct? [y]? Please tell me the hostname of the machine that BackupPC will run on. --> BackupPC will run on host [BACKUPNAS]? BackupPC should run as a dedicated user with limited privileges. You need to create a user. This user will need read/write permission on the main data directory and read/execute permission on the install directory (these directories will be setup shortly). The primary group for this user should also be chosen carefully. The data directories and files will have group read permission, so group members can access backup files. --> BackupPC should run as user [backuppc]? Please specify an install directory for BackupPC. This is where the BackupPC scripts, library and documentation will be installed. --> Install directory (full path) [/usr/local/BackupPC]? /opt/local/backuppc Please specify a data directory for BackupPC. This is where all the PC backup data is stored. This file system needs to be big enough to accommodate all the PCs you expect to backup (eg: at least several GB per machine). --> Data directory (full path) [/data/BackupPC]? /share/MD0_DATA/BackupPC BackupPC can compress pool files, providing around a 40% reduction in pool size (your mileage may vary). Specify the compression level (0 turns off compression, and 1 to 9 represent good/fastest to best/slowest). The recommended values are 0 (off) or 3 (reasonable compression and speed). Increasing the compression level to 5 will use around 20% more cpu time and give perhaps 2-3% more compression. --> Compression level [3]? BackupPC has a powerful CGI perl interface that runs under Apache. A single executable needs to be installed in a cgi-bin directory. This executable needs to run as set-uid backuppc, or it can be run under mod_perl with Apache running as user backuppc. Leave this path empty if you don't want to install the CGI interface. --> CGI bin directory (full path) []? /share/MD0_DATA/www/cgi-bin BackupPC's CGI script needs to display various PNG/GIF images that should be stored where Apache can serve them. They should be placed somewhere under Apache's DocumentRoot. BackupPC also needs to know the URL to access these images. Example: Apache image directory: /var/www/htdocs/BackupPC URL for image directory: /BackupPC The URL for the image directory should start with a slash. --> Apache image directory (full path) []? /share/MD0_DATA/www/BackupPC --> URL for image directory (omit http://host; starts with '/') []? /BackupPC Ok, we're about to: - install the binaries, lib and docs in /opt/local/backuppc, - create the data directory /share/MD0_DATA/BackupPC, - create/update the config.pl file /opt/etc/backuppc/config.pl, - optionally install the cgi-bin interface. --> Do you want to continue? [y]? Created /opt/local/backuppc/bin Created /opt/local/backuppc/doc Created /opt/local/backuppc/lib/BackupPC/CGI Created /opt/local/backuppc/lib/BackupPC/Config Created /opt/local/backuppc/lib/BackupPC/Lang Created /opt/local/backuppc/lib/BackupPC/Storage Created /opt/local/backuppc/lib/BackupPC/Xfer Created /opt/local/backuppc/lib/BackupPC/Zip Created /opt/local/backuppc/lib/Net/FTP Created /share/MD0_DATA/www/BackupPC Created /share/MD0_DATA/BackupPC Created /share/MD0_DATA/BackupPC/pool Created /share/MD0_DATA/BackupPC/cpool Created /share/MD0_DATA/BackupPC/pc Created /share/MD0_DATA/BackupPC/trash Created /opt/etc/backuppc Created /opt/var/log/backuppc Installing binaries in /opt/local/backuppc/bin Installing library in /opt/local/backuppc/lib Installing images in /share/MD0_DATA/www/BackupPC Making init.d scripts Making Apache configuration file for suid-perl Installing docs in /opt/local/backuppc/doc Installing config.pl and hosts in /opt/etc/backuppc BusyBox v1.01 (2010.03.14-18:22+0000) multi-call binary Usage: ping [OPTION]... host Send ICMP ECHO_REQUEST packets to network hosts. Options: -c COUNT Send only COUNT pings. -s SIZE Send SIZE data bytes in packets (default=56). -q Quiet mode, only displays output at start and when finished. Installing cgi script BackupPC_Admin in /share/MD0_DATA/www/cgi-bin Ok, it looks like we are finished. There are several more things you will need to do: - Browse through the config file, /opt/etc/backuppc/config.pl, and make sure all the settings are correct. In particular, you will need to set $Conf{CgiAdminUsers} so you have administration privileges in the CGI interface. - Edit the list of hosts to backup in /opt/etc/backuppc/hosts. - Read the documentation in /opt/local/backuppc/doc/BackupPC.html. Please pay special attention to the security section. - Verify that the CGI script BackupPC_Admin runs correctly. You might need to change the permissions or group ownership of BackupPC_Admin. If this is an upgrade and you are using mod_perl, you will need to restart Apache. Otherwise it will have stale code. - BackupPC should be ready to start. Don't forget to run it as user backuppc! The installation also contains an init.d/backuppc script that can be copied to /etc/init.d so that BackupPC can auto-start on boot. This will also enable administrative users to start the server from the CGI interface. See init.d/README. Enjoy!
Ping command
Without setting proper rights to the ping command, BackupPC will not be able to issue a ping and check whether a client is alive. To set the proper rights do:
ipkg install sudo
Instead of directly editing /opt/etc/sudoers, use the command visudo to edit this file in a safe manner:
visudo
You should add the /bin/ping command to the admin user. Search for following text:
## ## User privilege specification ## root ALL=(ALL) ALL
Add below the line beginning with root ALL= the following:
backuppc ALL=(admin) NOPASSWD: /bin/ping
Then change the line in the "/opt/etc/backuppc/config.pl" file to
$Conf{PingCmd} = '/opt/bin/sudo -u admin $pingPath -c 1 -w 3 $host';
With these arguments it should send one ping with a maximum waiting time of 3 seconds before deciding whether a host did not reply. Depnding on which ping version is being used, the arguments may differ slightly. Some computers use -t or -W as argument for timeout. So when in doubt check the arguments.
Intermezzo - Managing Users
To find out the currently logged on user:
whoami
Initial BackupPC test
On the TS-412U you will need to add the user backuppc to the group administrators and change the permissions in /opt/var/log as below:
administrators:x:0:admin,backuppc
chmod 775 /opt/var/log/backuppc
You should now be able to test the installation of BackupPC. Start BackupPC manually with:
su backuppc /opt/local/backuppc/bin/BackupPC -d
Then test status:
ps ax | grep "BackupPC -d" | grep perl
If BackupPC is running, you should see some output. In case of the following error message
No language setting BackupPC::Lib->new failed
a possible cause is that the previously existing /opt/etc/backuppc/config.pl specified in the course of the installation process is not loaded. If the access rights to the file are okay, check whether the variable $useFHS is set to 1 at:
/opt/local/backuppc/lib/BackupPC/Lib.pm:87: my $useFHS = 1;
It not, the config.pl is assumed to be located relative to $topDir.
backuppc {start|restart|stop|status}script
If you are not working as admin, return to user admin:
su admin
Copy the following lines to the file /opt/sbin/backuppc (user rights should be admin):
#!/bin/sh # PROVIDE: backuppc # REQUIRE: DAEMON # BEFORE: LOGIN name="backuppc" USER="backuppc" MYSELF=$0 case "$1" in start) /opt/bin/su backuppc -s /bin/sh -c '/opt/local/backuppc/bin/BackupPC -d' echo "${name} started" ;; restart) if [ "`ps ax | grep "BackupPC -d" | grep perl`" != "" ] ; then "$MYSELF" stop sleep 1 fi "$MYSELF" start ;; stop) killall BackupPC echo "${name} stopped" ;; status) if [ "`ps ax | grep "BackupPC -d" | grep perl`" = "" ] ; then echo "${name} not running" else echo "${name} running" fi ;; *) printf "Usage: %q {start|stop|restart|status}\n" "$0" >&2 exit 1 ;; esac exit 0
Then make backuppc executable:
chmod u+x /opt/sbin/backuppc
Now you can find running status with:
/opt/sbin/backuppc status
Start backuppc with
/opt/sbin/backuppc start
Stop backuppc with
/opt/sbin/backuppc stop
Restart backuppc with
/opt/sbin/backuppc restart
Intermezzo - autorun.sh
IMPORTANT: If your device is on firmware 3.8.3 or higher you will want to follow this tutorial here that utilizes QPKG to run autorun.sh as mounting ramblock method below is no longer the best way to do it. After your done with the steps you may pick up below where it says "Restart your NAS and check if BackupPC is running" and after it has restarted you may proceed with installing light web server.
autorun.sh contents should look like this when done installing backuppc server and light web server. autorun.sh should be located in /share/MD0_DATA/.qpkg/autorun/ . You will need to create the autorun directory and make sure autorun.sh is executible.
#!/bin/sh "/opt/sbin/backuppc" start /opt/etc/init.d/S80lighttpd exit 0
Depending on where you write files on the NAS, please note that configuration settings, files and directories may be installed on a RAM-disk. Anything added there will disappear at reboot. A simple way to check a directory you are unsure about is to run df <DIR> . That command returns information about what file system the given directory is located on. (If the output is empty then it is on the RAM-disk). The pwd command gives you your current directory. Because default config files are reset after each startup (see here:), QNAP supplies a method to execute a bash script at each startup to perform specific initialization tasks. The file autorun.sh, which should be stored on the internal disk-on-chip, is executed at each startup. Editing this file can be done with mounting the config ramblock first, create/editing its contents, (make sure it is executable) and unmounting the device when finished. This ramblock is device/model dependent. You can use the following command to find your model:
/sbin/getcfg System "Internal Model"
This will give for example a string like: TS-459. If anyone wants to make a universal script in order to retrieve the correct ramblock, I think getcfg in combination with using a table to find it will be the preferred method:
QNAP Model | ramblock | Mount command . . . . . . . . . . . . . . . . . . . . . | Comment |
---|---|---|---|
TS-210 |
/dev/mtdblock5 | mount -t ext2 /dev/mtdblock5 /tmp/config |
|
TS-439Pro | /dev/sdx6 | mount -t ext2 /dev/sdx6 /tmp/config |
Inside is a 128 MB Apacer ATA Disk Module 44 pin, prod. nr. t9aj01, accessible and replaceable via the front, without voiding your warranty. |
TS-459Pro TS-459Pro+ |
/dev/sdx6 | mount -t ext2 /dev/sdx6 /tmp/config |
Inside is a 512 MB Apacer USB Disk Module 8 pin header, prod. nr. 79700-m512-028-RS(MF34011), resembles the Apacer AP-UM512MC10CG, accessible and replaceable via the front, without voiding your warranty. |
Create/Edit /tmp/config/autorun.sh
nano /tmp/config/autorun.sh
From here you could add code which will be executed during the boot process. See below for an implementation of this.
When finished, ensure that /tmp/config/autorun.sh is executable:
chmod 755 /tmp/config/autorun.sh
IMPORTANT: Unmount the mounted flash partition:
umount /tmp/config
Alternatively to find the unmounted ramblock (including all other devices):
/sbin/fdisk -l
On a QNAP TS-439Pro and 459 Pro, this results for example in six devices: /dev/sdx1 .. /dev/sdx6 This will not exactly reveal which of the six devices should be used.
Add startup script to /opt/etc/init.d
For more standardized behaviour, we create a startup (Do not try to start BackupPC from /tmp/config/autorun.sh, because Optware is not correctly setup yet at that moment) script /opt/etc/init.d/S81backuppc :
nano /opt/etc/init.d/S81backuppc
Copy/paste the code below:
#!/bin/sh "/opt/sbin/backuppc" start exit 0
Then make it executable:
chmod u+x /opt/etc/init.d/S81backuppc
Automatic startup of BackupPC when system boots
To start BackupPC automatically each time the system boots, basically create or modify the file autorun.sh . However, simply adding the command /opt/etc/init.d/S81backuppc does not work well, because autorun.sh is started early in the bootprocess and Optware is not properly configured yet at that moment. A working two-stage-solution is to first configure Optware and then start S81backuppc . This is done with the autorun.sh which starts another script, autorunmaster.sh which resides in /share/MD0_DATA/custom/ :
Stage 1 - Mount the internal disk-on-chip
QNAP Model | Command . . . . . . . . . . . . . . . . . . . . . . . . . . . |
---|---|
TS-210 |
mount -t ext2 /dev/mtdblock5 /tmp/config |
TS-439Pro TS-459Pro TS-459Pro+ |
mount -t ext2 /dev/sdx6 /tmp/config |
Stage 1 - Create or modify /tmp/config/autorun.sh
nano /tmp/config/autorun.sh
Stage 1 - Add the following code:
#!/bin/sh # To solve a problem with scripts which depend on Optware and # therefore cannot be executed because autorun.sh is executed # early in the bootprocess and Optware is still uninitialized # we follow the ideas of http://forum.qnap.com/viewtopic.php?f=85&t=18977&start=0 # start a single script /share/MD0_DATA/custom/autorunmaster.sh # finish
Stage 1 - Ensure that /tmp/config/autorun.sh is executable by root:
chmod +x /tmp/config/autorun.sh
Stage 1 - IMPORTANT: Unmount the mounted flash partition:
umount /tmp/config
Stage 2 - Create the directory /share/MD0_DATA/custom/
mkdir /share/MD0_DATA/custom/
Stage 2 - create the file autorunmaster.sh
nano /share/MD0_DATA/custom/autorunmaster.sh
Stage 2 - Copy/paste following text into it.
#!/bin/sh # Scriptname autorunmaster.sh # This script is called by autorun.sh which is executed at every startup of the system # (See: http://forum.qnap.com/phpbb2/viewtopic.php?t=1168) # You will find the reboot log at: /share/..._DATA/custom/log/autorun.log # Define Target HDA_DATA or MD0_DATA export TARG=MD0_DATA # FIRST start Optware and delete the /etc/rcS.d/QS100...sh # echo `date` >> /share/$TARG/custom/log/autorun.log echo "start autorunmaster to begin with Optware" >> /share/$TARG/custom/log/autorun.log /etc/init.d/Optware.sh start rm -f /etc/rcS.d/QS100Optware # echo "Optware started" >> /share/$TARG/custom/log/autorun.log # echo "Now launching custom scripts which need Optware initialization first" >> /share/$TARG/custom/log/autorun.log # #echo "starting BackupPC script " >> /share/$TARG/custom/log/autorun.log /opt/etc/init.d/S81backuppc
Stage 2 - Ensure that /share/MD0_DATA/custom/autorunmaster.sh is executable by root:
chmod +x /share/MD0_DATA/custom/autorunmaster.sh
Stage 2 - create a log directory in which autorunmaster.sh can add information:
mkdir /share/MD0_DATA/custom/log
Restart your NAS and check if BackupPC is running:
/opt/sbin/backuppc restart /opt/sbin/backuppc status
It should say: backuppc running
lighttpd installation and configuration
Install lighttpd from the Optware package:
ipkg update ipkg install lighttpd
The configuration file lighttpd.conf is at /opt/etc/lighttpd/lighttpd.conf (Symbolic linked to /share/MD0_DATA/.qpkg/Optware/etc/lighttpd) . (For more easy setup, maybe one could write a specific file in the directory /opt/etc/lighttpd/conf.d/backuppc.conf which holds all custom settings for backuppc) For now edit backuppc.conf:
nano /opt/etc/lighttpd/lighttpd.conf
In the ”## modules to load” section uncomment the following lines:
## modules to load server.modules = ( "mod_access", "mod_cgi", "mod_acesslog" )
Then change:
server.document-root = "/share/MD0_DATA/www/"
BackupPC is installed as user backuppc. The easiest way for the webserver to being able to execute the BackupPC webinterface is to start lighttpd as well as user backuppc. Since lighttpd is exclusively used for BackupPC this seems reasonable:
## change uid to <uid> (default: don't care) #server.username = "nobody" server.username = "backuppc" ## change uid to <uid> (default: don't care) #server.groupname = "nobody" server.groupname = "backuppc"
Under $HTTP["url"] =~ "\.pdf$" { ... } add the following:
## >>>>>>>>>>>> ADDED FOR BACKUPPC $HTTP["url"] =~ "/cgi-bin/" { cgi.assign = ( ".pl" => "/opt/bin/perl" ) }
Remove the "lighttpd/index.html" from the following:
# files to check for if .../ is requested index-file.names = ( "index.php", "index.html", "index.htm", "default.htm" )
Give ownership of lighttpd log dir to user backuppc so it can read and write to it:
chown -R backuppc:backuppc /opt/var/log/lighttpd
You can now save your lighttpd configuration file. Restart lighttpd web server:
/opt/etc/init.d/S80lighttpd restart
Check if lighttpd is running:
ps ax | grep lighttpd | grep conf
You should see some output if it is running.
To start lighttpd automatically when the system boots, add the following lines to the file /share/MD0_DATA/custom/autorunmaster.sh just below the entry for BackupPC
#echo "starting lighttpd" >> /share/$TARG/custom/log/autorun.log /opt/etc/init.d/S80lighttpd
Restart your NAS and check whether lighttpd is running.
BackupPC webinterface
Enable administrative rights in the webinterface for every user:
nano /opt/etc/backuppc/config.pl
Change
$Conf{CgiAdminUsers} = '';
into
$Conf{CgiAdminUsers} = '*';
When lighttpd is configured as written above, it expects a perl script to have a .pl extension. Therefore create a symbolic link to the BackupPC perl script with that extension:
ln -s /share/MD0_DATA/www/cgi-bin/BackupPC_Admin /share/MD0_DATA/www/cgi-bin/BackupPC_Admin.pl
The BackupPC webinterface is now ready. A webpage should appear if you browse to: http://192.168.2.115:8081/cgi-bin/BackupPC_Admin.pl
NOTE: If you have broken images (e.g. logo.gif) you will need to copy the images directory or create symbolic links to the /images directory. Substitute BackupPC-3.2.1 for your correct directory.
ln -s /share/MD0_DATA/backuppc/BackupPC-3.2.1/images /share/MD0_DATA/www/images
You also need to edit config.pl typically located in /share/MD0_DATA/.qpkg/Optware/etc/backuppc/. Search for $Conf{CgiImageDirURL} = '/BackupPC' and change it to $Conf{CgiImageDirURL} = '/images';
NOTE: If css seems to be broke you will need to create a file in the images directory called BackupPC_stnd.css and add the following code to the css file then save it. Restart light web server and backup pc admin page should look great now.
body { background-color: #FFFFFF; font-family: tahoma,arial,sans-serif,helvetica; font-size: 10pt; height: 100%; margin: 2px 5px 0 2px; } table { border-collapse: collapse; color: #000000; padding: 2px; } h1 { color: #000000; font-family: Trebuchet MS,Trebuchet,tahoma,arial,sans-serif,helvetica; font-size: 16pt; } h2 { color: #000000; font-family: Trebuchet MS,Trebuchet,tahoma,arial,sans-serif,helvetica; font-size: 12pt; } a { color: #3333FF; font-family: tahoma,arial,sans-serif,helvetica; } dt { color: #3333FF; } a:hover { color: #CC0000; text-decoration: none; } a.NavCurrent { font-weight: bold; } a.navbar { padding-left: 5px; padding-right: 5px; } .h1 { background-color: #95B8DB; color: #000000; font-family: Trebuchet MS,Trebuchet,tahoma,arial,sans-serif,helvetica; font-size: 16pt; font-weight: bold; margin-bottom: 5px; padding: 3px 3px 3px 6px; } .h2 { background-color: #EEEEEE; color: #000000; font-family: Trebuchet MS,Trebuchet,tahoma,arial,sans-serif,helvetica; font-size: 12pt; font-weight: bold; margin-bottom: 1px; margin-top: 3px; padding: 3px 3px 3px 6px; } .tableStnd { font-size: 10pt; } .tableheader { background-color: #EEEEEE; font-size: 10pt; font-weight: bold; } table.sortable a.sortheader { background-color: #EEEEEE; display: block; font-weight: bold; text-decoration: none; } .border { font-size: 10pt; } .editHeader { background-color: #95B8DB; color: #000000; font-family: arial,sans-serif; font-size: 12pt; font-weight: bold; } .editTabSel { background-color: #95B8DB; color: #000000; font-family: arial,sans-serif; font-size: 14pt; font-weight: bold; margin-bottom: 5px; padding: 3px 3px 3px 6px; } .editTabNoSel { color: #000000; font-family: arial,sans-serif; font-size: 14pt; font-weight: bold; margin-bottom: 5px; padding: 3px 3px 3px 6px; } .editSaveButton { color: #C0C0C0; font-size: 14pt; font-weight: bold; } .editError { color: #FF0000; font-weight: bold; } .editComment { font-size: 10pt; } .editTextInput { font-family: courier; font-size: 10pt; } .fviewheader { background-color: #999999; color: #FFFFFF; font-size: 9pt; font-weight: bold; } .fviewborder { background-color: #EEEEEE; border-bottom: 1px solid #000000; border-left: 1px solid #666666; border-right: 1px solid #666666; font-size: 9pt; } .fviewon { background-color: #CCCCCC; } .fviewoff { background-color: #FFFFFF; } .fview { font-family: tahoma,arial,sans-serif,helvetica; font-size: 9pt; line-height: 15px; text-decoration: none; } .fviewbold { font-family: tahoma,arial,sans-serif,helvetica; font-size: 9pt; font-weight: bold; line-height: 15px; text-decoration: none; } .histView { background-color: #EEEEEE; border-bottom: 1px solid #000000; border-left: 1px solid #000000; font-size: 10pt; } .histViewMis { background-color: #FFDDDD; border-bottom: 1px solid #000000; border-left: 1px solid #000000; } div.NavMenu { background-color: #EEEEEE; font-size: 9pt; margin: 0; width: 18%; } div.NavMenu a { display: block; font-family: arial,sans-serif; font-size: 9pt; margin-left: 8px; padding: 2px; } div.NavTitle { background-color: #95B8DB; color: #000000; font-family: Trebuchet MS,Trebuchet,tahoma,arial,sans-serif,helvetica; font-size: 12pt; font-weight: bold; margin-bottom: 2px; padding-left: 10px; } #Content { float: right; left: 20%; position: absolute; right: 10px; top: 10px; width: 79%; }
Step 3. Configuring BackupPC
BackupPC has a tremendous amount of settings, to get more information just read the <a href="http://backuppc.sourceforge.net/faq/BackupPC.html">documentation</a> carefully. Happily the default main settings configuration file (/opt/etc/backuppc/config.pl) should be set correctly for the most part already.
Most settings can be done webbased. Browse to:
http://192.168.2.115:8081/cgi-bin/BackupPC_Admin.pl
Check following steps:
Edit Host-> Add Host
Enter the IP-address of the client pc in the host field and type root in the user field:
<Host: IP-address> <dhcp: unchecked> <user: root> <moreUsers: leave empty>
Then select this computer, Edit config:
XFerMethod: rsyncd Further settings: RsyncShareName: docs RsyncdUserName: AdminBackupPC RsyncdPasswd: (Figure out yourself)
Following lines are optional but helps get rid of transfer errors in your log files while backing up in addition to not backing up some unnecessary temp and cache files: (Please note: If there are more computers on the network which should be backed up and share the same exclusion list, it may be easier to configure this as global setting)
BackupFilesExclude->enter for key: *
then in this group, create an entry for each item:
*parent.lock *UsrClass.dat* *Firefox*Cache* *Local Settings/Temp* NTUSER.DAT ntuser.dat.LOG
BackupPC should be ready to backup <IP-address>, but we need to prepare computer1 with a client rsyncd now that you've edited the hosts file, you need to restart the BackupPC service:
/opt/sbin/backuppc restart
Change Schedule -> BlackoutGoodCnt -> -1
And:
Change Schedule -> BlackoutPeriods enable Override
Step 3.1 Configuring e-mail notifications
QNAP sends e-mail via "ssmtp". The program '/usr/sbin/sendmail' is actually a link to 'ssmtp'. Unfortunately, 'sendmail' and 'ssmtp' have different argument lists. This can be solved using the following script (you can create it in '/opt/local/bin'):
#!/bin/bash # from="" while [ "$#" -gt 0 ]; do case "$1" in -f) shift from="$1" ;; *) ;; esac shift done msg=$(cat) to=$(echo "$msg" | /opt/bin/head -1 | grep "^To: ") to=${to#To: } ( echo "From: $from" ; echo "$msg" ) | /usr/sbin/ssmtp $to
Make it executable with:
chmod 755 /opt/local/bin/mymail
and change the parameter "SendmailPath" in '/opt/etc/backuppc/config.pl' so that it points to '/opt/local/bin/mymail'. This can also be done via the Web interface in the E-mail configuration panel. You can test the e-mail function with:
su - backuppc -c "/opt/local/backuppc/bin/BackupPC_sendEmail -u your@email.adress
Step 4. Configuring a Host for Backup
When using Microsoft Windows, use either option 1 or option 2 from below to install and configure rsyncd.
Option 1 - installing using the rsyncd from BackupPC
Download rsyncd (cygwin-rsyncd-2.6.8_0.zip) for Windows from the BackupPC website (hosted by SourceForge). Unzip the files to c:\rsyncd
Edit the rsyncd.conf file and edit the docs section to your liking, such as:
[docs]path = c:/Documents and Settings comment = Documents and Settings strict modes = false auth users = USERNAME #this USERNAME comes from the computer1.pl file that we edited before secrets file = c:/rsyncd/rsyncd.secrets read only = true list = false
Now edit rsyncd.secrets and change UUU:PPP to the username and password that we entered above in the computer1.pl file:
USERNAME:PASSWORD
Edit the service.bat file (Instead of notepad, you should use an editor which can handle the line breaks, like wordpad, gvim, notepad++, etc… )
You only need to edit this file if you need to remove the “rem ” from the last three lines to allow it to punch through the windows firewall.
So after editing it, run service.bat to set up rsyncd service. This method does not work on windows 7. Instead enter the following at a command console:
cd \rsyncd cygrunsrv.exe -I rsyncd -e CYGWIN=nontsec -p c:/rsyncd/rsync.exe -a ” –config=c:/rsyncd/rsyncd.conf –daemon – -no-detach”
Check the service with the following command and search for rsyncd. It should state started:
services.msc
It is necessary to open tcp port 873 at the firewall to allow trafic from the rsyncd daemon. In the firewall configure the following exception:
- Name: rsyncd
- Type: TCP
- Port: 873
Option 2 - installing rsyncd using cwRsync
Go to http://rsync.samba.org/download.html
Go to "cwRsync" is a packaging of rsync for MS Windows.
Which will take you to: http://sourceforge.net/projects/sereds/files/cwRsync/4.0.6/
Download the cwRsyncServer_4.0.6_Installer.zip file (or newer) and install.
Troubleshooting
To check whether a certain computer can be found on the network, type:
perl -e 'print(gethostbyname("myhost") ? "ok\n" : "not found\n")'
Enter for myhost the hostname of that certain computer.
perl module File::Listing
If an error occurs with a missing perl module File::Listing, compile this:
cd /share/MD0_DATA/installtemp wget http://www.auditeon.com/xyz/File-List-0.3.1.tar.gz tar zxvf File-List-0.3.1.tar.gz cd List perl Makefile.PL make LD=ld LINKTYPE=dynamic LDDLFLAGS="-shared -O2" make LD=ld LINKTYPE=dynamic LDDLFLAGS="-shared -O2" test make LD=ld LINKTYPE=dynamic LDDLFLAGS="-shared -O2" install ln -s /opt/lib/perl5/site_perl/5.10.0/File/List.pm /opt/lib/perl5/site_perl/5.10.0/Listing.pm
Current issues
- rtorrent conflicts with lighttpd on port 8081. See here: http://forum.qnap.com/viewtopic.php?f=24&t=31239
Helpful links
- http://forum.qnap.com/viewtopic.php?f=257&t=47422 Easy install via a BackupPC qpkg
- http://backuppc.sourceforge.net/ BackupPC project page
- http://wiki.dns323.info/howto:backuppc Installation of BackupPC with lighttpd
- http://forum.qnapclub.de/viewtopic.php?f=45&t=398 Apache2 on TS-439 PRO
- http://wiki.debian.org/DebianEdu/HowTo/BackupPC related to Apache
- http://forum.qnap.com/viewtopic.php?f=32&t=22699 relaunching Apache
- http://wiki.qnap.com/wiki/AWStats Perl + Apache installation info
- http://forum.qnap.com/viewtopic.php?f=32&t=9902 installing Apache2 + PHP + mysql
- http://forum.qnapclub.de/viewtopic.php?f=45&t=6556&start=20 installing Apache2 + PHP
- http://forum.qnap.com/viewtopic.php?f=32&t=14450 QNAP apache installation primer
- http://wiki.yobi.be/wiki/BackupPc short description with apache2 installation
- http://www.sieker.info/blog/2009/01/10/rdiff-backup-qnap-ts-409-pro/ Server starts OpenSSH automatically when system boots
- http://forum.qnap.com/viewtopic.php?f=16&t=26537 start stop restart .sh script
- http://www.mpcclub.com/forum/showthread.php?t=16766 Solution for proper initializing of Optware packages
- http://forum.qnap.com/viewtopic.php?f=85&t=18977&start=0 Explanation of autorun.sh and Optware ipkg server prog.
- http://forum.qnap.com/viewtopic.php?f=35&t=10024 Just another extensive thread about non addressable /opt directories
- http://sourceforge.net/apps/mediawiki/backuppc/index.php?title=Install_Backuppc_with_Lighttpd correcting user backuppc
- http://forum.qnap.com/viewtopic.php?f=94&t=5506&start=0 qnap perl cpan "no space left on device"
- http://opendocs.net/livejournal/server/lj.install.perl_setup.modules.html installing perl cpan modules
- http://www.tumblr.com/tagged/ipkg Missing gcc binary when making Perl-File-RsyncP
- http://forums.zmanda.com/showthread.php?p=8910 missing perl module File::Listing
- http://www.cs.umd.edu/~cdunne/projs/backuppc_guide.html installing BackupPC, configuring BackupPC on windows 7
- http://www.backupcentral.com/phpBB2/two-way-mirrors-of-external-mailing-lists-3/backuppc-21/bakuppc-shutdown-clinets-101543/ shutdown client after finishing backup
- http://forum.qnap.com/viewtopic.php?f=32&t=44291 Trying to install BackupPC with the build in apache web server
- http://forum.synology.com/enu/viewtopic.php?f=27&t=8976 Installing BackupPC on Synology NAS
- http://www.javarants.com/2008/10/30/time-machine-vs-zfs-rsync/ Like TimeMachine, an example of using flogger, fsevents to backup only changes in osx. This can be an option to make rsync more efficient.